Note: This is test shard 1 of 6.
[==========] Running 5 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 4 tests from TabletCopyITest
[ RUN      ] TabletCopyITest.TestRejectRogueLeader
2026-08-12T06:36:13Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:13Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 06:36:13.908723 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:46115
--webserver_interface=127.28.69.62
--webserver_port=0
--builtin_ntp_servers=127.28.69.20:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:46115
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:36:14.017885 28959 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:14.018144 28959 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:14.018193 28959 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:14.021608 28959 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:14.021672 28959 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:14.021695 28959 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:14.021728 28959 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:14.025769 28959 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:46115
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:46115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.28959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:14.026988 28959 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:14.028512 28959 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:14.035094 28967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:14.035125 28970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:14.035138 28968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:14.035312 28959 server_base.cc:1061] running on GCE node
I20260812 06:36:14.035827 28959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:14.036893 28959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:14.038075 28959 hybrid_clock.cc:648] HybridClock initialized: now 1786516574038082 us; error 48 us; skew 500 ppm
I20260812 06:36:14.040140 28959 webserver.cc:533] Webserver started at http://127.28.69.62:45591/ using document root <none> and password file <none>
I20260812 06:36:14.040868 28959 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:14.040930 28959 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:14.041210 28959 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:14.042719 28959 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/data/instance:
uuid: "16dc467a9fe5431db5840cd06137f1d1"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.043175 28959 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/wal/instance:
uuid: "16dc467a9fe5431db5840cd06137f1d1"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.046749 28959 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260812 06:36:14.049125 28982 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.050208 28959 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:14.050339 28959 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "16dc467a9fe5431db5840cd06137f1d1"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.050462 28959 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:14.072588 28959 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:14.073398 28959 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:14.073618 28959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:14.082908 28959 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:46115
I20260812 06:36:14.082921 29079 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:46115 every 8 connection(s)
I20260812 06:36:14.084031 28959 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:14.084764 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 28959
I20260812 06:36:14.084896 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/master-0/wal/instance
I20260812 06:36:14.087520 29080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:14.093354 29080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1: Bootstrap starting.
I20260812 06:36:14.095871 29080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:14.096757 29080 log.cc:826] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:14.098640 29080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1: No bootstrap required, opened a new log
I20260812 06:36:14.101439 29080 raft_consensus.cc:359] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dc467a9fe5431db5840cd06137f1d1" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 46115 } }
I20260812 06:36:14.101651 29080 raft_consensus.cc:385] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:14.101714 29080 raft_consensus.cc:740] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16dc467a9fe5431db5840cd06137f1d1, State: Initialized, Role: FOLLOWER
I20260812 06:36:14.102324 29080 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dc467a9fe5431db5840cd06137f1d1" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 46115 } }
I20260812 06:36:14.102495 29080 raft_consensus.cc:399] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:14.102598 29080 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:14.102731 29080 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:14.103420 29080 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dc467a9fe5431db5840cd06137f1d1" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 46115 } }
I20260812 06:36:14.103876 29080 leader_election.cc:304] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16dc467a9fe5431db5840cd06137f1d1; no voters: 
I20260812 06:36:14.104233 29080 leader_election.cc:290] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:14.104341 29088 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:14.104537 29088 raft_consensus.cc:697] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [term 1 LEADER]: Becoming Leader. State: Replica: 16dc467a9fe5431db5840cd06137f1d1, State: Running, Role: LEADER
I20260812 06:36:14.104990 29088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dc467a9fe5431db5840cd06137f1d1" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 46115 } }
I20260812 06:36:14.105388 29080 sys_catalog.cc:565] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:14.106302 29092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16dc467a9fe5431db5840cd06137f1d1. Latest consensus state: current_term: 1 leader_uuid: "16dc467a9fe5431db5840cd06137f1d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dc467a9fe5431db5840cd06137f1d1" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 46115 } } }
I20260812 06:36:14.106482 29092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:14.106873 29089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16dc467a9fe5431db5840cd06137f1d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16dc467a9fe5431db5840cd06137f1d1" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 46115 } } }
I20260812 06:36:14.107008 29089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:14.106959 29105 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:14.109819 29105 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:14.114981 29105 catalog_manager.cc:1383] Generated new cluster ID: b2794c6cc1424e71b8d5a8757c57b099
I20260812 06:36:14.115037 29105 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:14.135933 29105 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:14.136742 29105 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:14.144897 29105 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 16dc467a9fe5431db5840cd06137f1d1: Generated new TSK 0
I20260812 06:36:14.145520 29105 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:14.152835 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.1:0
--local_ip_for_outbound_sockets=127.28.69.1
--webserver_interface=127.28.69.1
--webserver_port=0
--tserver_master_addrs=127.28.69.62:46115
--builtin_ntp_servers=127.28.69.20:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 06:36:14.255620 29116 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:14.255839 29116 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:14.255861 29116 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:14.255908 29116 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:14.259223 29116 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:14.259321 29116 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.1
I20260812 06:36:14.263048 29116 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.69.1
--webserver_port=0
--tserver_master_addrs=127.28.69.62:46115
--never_fsync=true
--heap_profile_path=/tmp/kudu.29116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:14.264056 29116 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:14.265196 29116 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:14.271850 29122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:14.271914 29125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:14.271922 29121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:14.272513 29116 server_base.cc:1061] running on GCE node
I20260812 06:36:14.272856 29116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:14.273409 29116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:14.274576 29116 hybrid_clock.cc:648] HybridClock initialized: now 1786516574274559 us; error 34 us; skew 500 ppm
I20260812 06:36:14.276206 29116 webserver.cc:533] Webserver started at http://127.28.69.1:35271/ using document root <none> and password file <none>
I20260812 06:36:14.276729 29116 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:14.276784 29116 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:14.276980 29116 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:14.278496 29116 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/data/instance:
uuid: "958ee04f3d494f7fb608e153245f4c2e"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.278999 29116 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance:
uuid: "958ee04f3d494f7fb608e153245f4c2e"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.282083 29116 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260812 06:36:14.284060 29139 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.284992 29116 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:14.285122 29116 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/wal
uuid: "958ee04f3d494f7fb608e153245f4c2e"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.285208 29116 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:14.325651 29116 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:14.326375 29116 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:14.326542 29116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:14.327157 29116 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:14.328299 29116 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:14.328349 29116 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.328389 29116 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:14.328416 29116 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.338039 29116 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.1:44213
I20260812 06:36:14.338073 29337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.1:44213 every 8 connection(s)
I20260812 06:36:14.338961 29116 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:14.339267 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 29116
I20260812 06:36:14.339385 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:14.341970 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.2:0
--local_ip_for_outbound_sockets=127.28.69.2
--webserver_interface=127.28.69.2
--webserver_port=0
--tserver_master_addrs=127.28.69.62:46115
--builtin_ntp_servers=127.28.69.20:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:14.348212 29338 heartbeater.cc:344] Connected to a master server at 127.28.69.62:46115
I20260812 06:36:14.348443 29338 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:14.348942 29338 heartbeater.cc:507] Master 127.28.69.62:46115 requested a full tablet report, sending...
I20260812 06:36:14.350567 29010 ts_manager.cc:194] Registered new tserver with Master: 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213)
I20260812 06:36:14.351853 29010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.1:49209
W20260812 06:36:14.443537 29341 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:14.443751 29341 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:14.443780 29341 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:14.443832 29341 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:14.447000 29341 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:14.447115 29341 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.2
I20260812 06:36:14.450786 29341 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.69.2
--webserver_port=0
--tserver_master_addrs=127.28.69.62:46115
--never_fsync=true
--heap_profile_path=/tmp/kudu.29341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:14.451803 29341 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:14.452868 29341 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:14.459087 29349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:14.459115 29350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:14.459120 29353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:14.459333 29341 server_base.cc:1061] running on GCE node
I20260812 06:36:14.459764 29341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:14.460299 29341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:14.461447 29341 hybrid_clock.cc:648] HybridClock initialized: now 1786516574461424 us; error 37 us; skew 500 ppm
I20260812 06:36:14.465982 29341 webserver.cc:533] Webserver started at http://127.28.69.2:34351/ using document root <none> and password file <none>
I20260812 06:36:14.466555 29341 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:14.466612 29341 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:14.466799 29341 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:14.468397 29341 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/data/instance:
uuid: "8052be9e17234311b89adc9aedca80e2"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.468850 29341 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance:
uuid: "8052be9e17234311b89adc9aedca80e2"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.472283 29341 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 06:36:14.474373 29361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.475342 29341 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:14.475448 29341 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/wal
uuid: "8052be9e17234311b89adc9aedca80e2"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.475533 29341 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:14.491604 29341 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:14.492223 29341 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:14.492388 29341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:14.492905 29341 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:14.494102 29341 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:14.494165 29341 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.494226 29341 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:14.494257 29341 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.505980 29341 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.2:37279
I20260812 06:36:14.506119 29562 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.2:37279 every 8 connection(s)
I20260812 06:36:14.507019 29341 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:14.508486 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 29341
I20260812 06:36:14.508582 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:14.513494 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.3:0
--local_ip_for_outbound_sockets=127.28.69.3
--webserver_interface=127.28.69.3
--webserver_port=0
--tserver_master_addrs=127.28.69.62:46115
--builtin_ntp_servers=127.28.69.20:45137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 06:36:14.517786 29563 heartbeater.cc:344] Connected to a master server at 127.28.69.62:46115
I20260812 06:36:14.518010 29563 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:14.518492 29563 heartbeater.cc:507] Master 127.28.69.62:46115 requested a full tablet report, sending...
I20260812 06:36:14.519490 29010 ts_manager.cc:194] Registered new tserver with Master: 8052be9e17234311b89adc9aedca80e2 (127.28.69.2:37279)
I20260812 06:36:14.520021 29010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.2:47757
W20260812 06:36:14.626791 29570 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:36:14.627097 29570 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:14.627148 29570 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:14.627264 29570 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:14.631669 29570 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:14.631819 29570 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.3
I20260812 06:36:14.636314 29570 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.69.3
--webserver_port=0
--tserver_master_addrs=127.28.69.62:46115
--never_fsync=true
--heap_profile_path=/tmp/kudu.29570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:14.637470 29570 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:14.638604 29570 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:14.644944 29581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:14.644951 29582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:14.644955 29584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:14.645249 29570 server_base.cc:1061] running on GCE node
I20260812 06:36:14.645618 29570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:14.646150 29570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:14.647325 29570 hybrid_clock.cc:648] HybridClock initialized: now 1786516574647267 us; error 73 us; skew 500 ppm
I20260812 06:36:14.648974 29570 webserver.cc:533] Webserver started at http://127.28.69.3:35169/ using document root <none> and password file <none>
I20260812 06:36:14.649559 29570 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:14.649624 29570 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:14.649818 29570 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:14.651320 29570 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/data/instance:
uuid: "d783cdf1dadd4c3d81d716e05c56074a"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.651823 29570 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/wal/instance:
uuid: "d783cdf1dadd4c3d81d716e05c56074a"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.655136 29570 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 06:36:14.657282 29591 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.658411 29570 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:14.658516 29570 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/wal
uuid: "d783cdf1dadd4c3d81d716e05c56074a"
format_stamp: "Formatted at 2026-08-12 06:36:14 on dist-test-slave-k5rr"
I20260812 06:36:14.658603 29570 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:14.674844 29570 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:14.675442 29570 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:14.675611 29570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:14.676148 29570 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:14.677160 29570 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:14.677220 29570 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.677276 29570 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:14.677307 29570 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:14.687480 29570 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.3:41631
I20260812 06:36:14.687505 29789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.3:41631 every 8 connection(s)
I20260812 06:36:14.688400 29570 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:14.689353 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 29570
I20260812 06:36:14.689457 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:14.697449 29791 heartbeater.cc:344] Connected to a master server at 127.28.69.62:46115
I20260812 06:36:14.697649 29791 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:14.698092 29791 heartbeater.cc:507] Master 127.28.69.62:46115 requested a full tablet report, sending...
I20260812 06:36:14.699055 29010 ts_manager.cc:194] Registered new tserver with Master: d783cdf1dadd4c3d81d716e05c56074a (127.28.69.3:41631)
I20260812 06:36:14.699595 29010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.3:41929
I20260812 06:36:14.704671 28948 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:14.726349 29010 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42530:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:14.727665 29010 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:14.744170 29670 tablet_service.cc:1511] Processing CreateTablet for tablet b1e659103246454f8f750a2d4ceb02b7 (DEFAULT_TABLE table=test-workload [id=1cea1b568cb44cbc8f1e39dc089aa4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:14.744252 29219 tablet_service.cc:1511] Processing CreateTablet for tablet b1e659103246454f8f750a2d4ceb02b7 (DEFAULT_TABLE table=test-workload [id=1cea1b568cb44cbc8f1e39dc089aa4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:14.745035 29670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e659103246454f8f750a2d4ceb02b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:14.745040 29219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e659103246454f8f750a2d4ceb02b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:14.746713 29447 tablet_service.cc:1511] Processing CreateTablet for tablet b1e659103246454f8f750a2d4ceb02b7 (DEFAULT_TABLE table=test-workload [id=1cea1b568cb44cbc8f1e39dc089aa4a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:14.747619 29447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e659103246454f8f750a2d4ceb02b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:14.749755 29831 tablet_bootstrap.cc:492] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Bootstrap starting.
I20260812 06:36:14.750986 29834 tablet_bootstrap.cc:492] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a: Bootstrap starting.
I20260812 06:36:14.752022 29831 tablet_bootstrap.cc:654] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:14.752672 29835 tablet_bootstrap.cc:492] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2: Bootstrap starting.
I20260812 06:36:14.752924 29831 log.cc:826] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:14.753041 29834 tablet_bootstrap.cc:654] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:14.753780 29834 log.cc:826] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:14.754637 29835 tablet_bootstrap.cc:654] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:14.754738 29831 tablet_bootstrap.cc:492] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: No bootstrap required, opened a new log
I20260812 06:36:14.754920 29831 ts_tablet_manager.cc:1403] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:14.755330 29835 log.cc:826] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:14.755484 29834 tablet_bootstrap.cc:492] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a: No bootstrap required, opened a new log
I20260812 06:36:14.755656 29834 ts_tablet_manager.cc:1403] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:36:14.756631 29835 tablet_bootstrap.cc:492] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2: No bootstrap required, opened a new log
I20260812 06:36:14.756788 29835 ts_tablet_manager.cc:1403] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 06:36:14.757934 29831 raft_consensus.cc:359] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.758143 29831 raft_consensus.cc:740] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958ee04f3d494f7fb608e153245f4c2e, State: Initialized, Role: FOLLOWER
I20260812 06:36:14.758450 29831 consensus_queue.cc:260] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.758518 29834 raft_consensus.cc:359] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.758706 29834 raft_consensus.cc:740] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d783cdf1dadd4c3d81d716e05c56074a, State: Initialized, Role: FOLLOWER
I20260812 06:36:14.758998 29834 consensus_queue.cc:260] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.759289 29831 ts_tablet_manager.cc:1434] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:14.759433 29835 raft_consensus.cc:359] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.759630 29791 heartbeater.cc:499] Master 127.28.69.62:46115 was elected leader, sending a full tablet report...
I20260812 06:36:14.759654 29338 heartbeater.cc:499] Master 127.28.69.62:46115 was elected leader, sending a full tablet report...
I20260812 06:36:14.759727 29835 raft_consensus.cc:740] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8052be9e17234311b89adc9aedca80e2, State: Initialized, Role: FOLLOWER
I20260812 06:36:14.759783 29834 ts_tablet_manager.cc:1434] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:14.760056 29835 consensus_queue.cc:260] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.760695 29835 ts_tablet_manager.cc:1434] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:14.760697 29563 heartbeater.cc:499] Master 127.28.69.62:46115 was elected leader, sending a full tablet report...
I20260812 06:36:14.781620 28948 tablet_copy-itest.cc:200] loading data...
I20260812 06:36:14.782241 29481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1e659103246454f8f750a2d4ceb02b7"
dest_uuid: "8052be9e17234311b89adc9aedca80e2"
 from {username='slave'} at 127.0.0.1:37348
I20260812 06:36:14.782452 29481 raft_consensus.cc:493] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:14.782537 29481 raft_consensus.cc:3060] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:14.783526 29481 raft_consensus.cc:515] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.784538 29481 leader_election.cc:290] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [CANDIDATE]: Term 1 election: Requested vote from peers 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213), d783cdf1dadd4c3d81d716e05c56074a (127.28.69.3:41631)
I20260812 06:36:14.788452 29704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e659103246454f8f750a2d4ceb02b7" candidate_uuid: "8052be9e17234311b89adc9aedca80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d783cdf1dadd4c3d81d716e05c56074a"
I20260812 06:36:14.788712 29704 raft_consensus.cc:3060] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:14.790066 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e659103246454f8f750a2d4ceb02b7" candidate_uuid: "8052be9e17234311b89adc9aedca80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "958ee04f3d494f7fb608e153245f4c2e"
I20260812 06:36:14.790184 29704 raft_consensus.cc:2468] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8052be9e17234311b89adc9aedca80e2 in term 1.
I20260812 06:36:14.790268 29255 raft_consensus.cc:3060] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:14.790604 29362 leader_election.cc:304] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8052be9e17234311b89adc9aedca80e2, d783cdf1dadd4c3d81d716e05c56074a; no voters: 
I20260812 06:36:14.790830 29845 raft_consensus.cc:2804] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:14.791038 29845 raft_consensus.cc:697] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [term 1 LEADER]: Becoming Leader. State: Replica: 8052be9e17234311b89adc9aedca80e2, State: Running, Role: LEADER
I20260812 06:36:14.791359 29255 raft_consensus.cc:2468] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8052be9e17234311b89adc9aedca80e2 in term 1.
I20260812 06:36:14.791348 29845 consensus_queue.cc:237] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.794816 29008 catalog_manager.cc:5719] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8052be9e17234311b89adc9aedca80e2 (127.28.69.2). New cstate: current_term: 1 leader_uuid: "8052be9e17234311b89adc9aedca80e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:14.840222 29339 tablet.cc:2406] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:14.841987 29704 raft_consensus.cc:1275] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 1 FOLLOWER]: Refusing update from remote peer 8052be9e17234311b89adc9aedca80e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:14.842829 29864 consensus_queue.cc:1048] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:14.844135 29255 raft_consensus.cc:1275] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 1 FOLLOWER]: Refusing update from remote peer 8052be9e17234311b89adc9aedca80e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 06:36:14.844777 29868 consensus_queue.cc:1048] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:14.851397 29859 mvcc.cc:204] Tried to move back new op lower bound from 7317571890555506688 to 7317571890348953600. Current Snapshot: MvccSnapshot[applied={T|T < 7317571890544070656}]
I20260812 06:36:14.857316 29875 mvcc.cc:204] Tried to move back new op lower bound from 7317571890555506688 to 7317571890348953600. Current Snapshot: MvccSnapshot[applied={T|T < 7317571890552844288}]
W20260812 06:36:14.929663 29896 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 06:36:14.941617 29704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1e659103246454f8f750a2d4ceb02b7"
dest_uuid: "d783cdf1dadd4c3d81d716e05c56074a"
 from {username='slave'} at 127.0.0.1:40328
I20260812 06:36:14.941825 29704 raft_consensus.cc:493] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:14.941897 29704 raft_consensus.cc:3060] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:14.942714 29704 raft_consensus.cc:515] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.943696 29704 leader_election.cc:290] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [CANDIDATE]: Term 2 election: Requested vote from peers 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213), 8052be9e17234311b89adc9aedca80e2 (127.28.69.2:37279)
I20260812 06:36:14.946979 29254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e659103246454f8f750a2d4ceb02b7" candidate_uuid: "d783cdf1dadd4c3d81d716e05c56074a" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: true dest_uuid: "958ee04f3d494f7fb608e153245f4c2e"
I20260812 06:36:14.947122 29254 raft_consensus.cc:3060] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:14.947980 29254 raft_consensus.cc:2468] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d783cdf1dadd4c3d81d716e05c56074a in term 2.
I20260812 06:36:14.948328 29599 leader_election.cc:304] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 958ee04f3d494f7fb608e153245f4c2e, d783cdf1dadd4c3d81d716e05c56074a; no voters: 
I20260812 06:36:14.948577 29844 raft_consensus.cc:2804] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:36:14.948771 29844 raft_consensus.cc:697] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [term 2 LEADER]: Becoming Leader. State: Replica: d783cdf1dadd4c3d81d716e05c56074a, State: Running, Role: LEADER
I20260812 06:36:14.949117 29844 consensus_queue.cc:237] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 21, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } }
I20260812 06:36:14.950675 28948 tablet_copy-itest.cc:232] successfully elected new leader
I20260812 06:36:14.951424 29010 catalog_manager.cc:5719] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a reported cstate change: term changed from 1 to 2, leader changed from 8052be9e17234311b89adc9aedca80e2 (127.28.69.2) to d783cdf1dadd4c3d81d716e05c56074a (127.28.69.3). New cstate: current_term: 2 leader_uuid: "d783cdf1dadd4c3d81d716e05c56074a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d783cdf1dadd4c3d81d716e05c56074a" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 41631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8052be9e17234311b89adc9aedca80e2" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 37279 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:14.952967 28948 cluster_itest_util.cc:258] Not converged past 22 yet: 2.22 1.21
I20260812 06:36:15.055095 28948 cluster_itest_util.cc:258] Not converged past 22 yet: 2.22 1.21
I20260812 06:36:15.257215 28948 cluster_itest_util.cc:258] Not converged past 22 yet: 2.22 1.21
I20260812 06:36:15.342835 29254 raft_consensus.cc:1275] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 2 FOLLOWER]: Refusing update from remote peer d783cdf1dadd4c3d81d716e05c56074a: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 2 index: 22. (index mismatch)
I20260812 06:36:15.343393 29844 consensus_queue.cc:1048] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [LEADER]: Connected to new peer: Peer: permanent_uuid: "958ee04f3d494f7fb608e153245f4c2e" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 44213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260812 06:36:15.559367 28948 tablet_copy-itest.cc:244] restarting workload...
W20260812 06:36:17.016021 29601 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.28.69.2:37279 for RPC RequestConsensusVote timed out after 2.071s (ON_OUTBOUND_QUEUE)
W20260812 06:36:18.013777 29898 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 06:36:14.943978 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.28.69.2:37279 (local address 127.28.69.3:58207)
0812 06:36:14.944300 (+   322us) negotiation.cc:107] Waiting for socket to connect
0812 06:36:14.944328 (+    28us) client_negotiation.cc:175] Beginning negotiation
0812 06:36:14.944436 (+   108us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 06:36:18.013268 (+3068832us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.28.69.2:37279: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":248,"spinlock_wait_cycles":20608,"thread_start_us":114,"threads_started":1}
W20260812 06:36:18.014111 29601 leader_election.cc:336] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8052be9e17234311b89adc9aedca80e2 (127.28.69.2:37279): Timed out: Client connection negotiation failed: client connection to 127.28.69.2:37279: received 0 of 4 requested bytes
W20260812 06:36:20.566883 29810 meta_cache.cc:302] tablet b1e659103246454f8f750a2d4ceb02b7: replica 8052be9e17234311b89adc9aedca80e2 (127.28.69.2:37279) has failed: Timed out: Write RPC to 127.28.69.2:37279 timed out after 5.000s (SENT)
W20260812 06:36:20.567061 29810 batcher.cc:441] Timed out: Failed to write batch of 50 ops to tablet b1e659103246454f8f750a2d4ceb02b7 after 1 attempt(s): Failed to write to server: 8052be9e17234311b89adc9aedca80e2 (127.28.69.2:37279): Write RPC to 127.28.69.2:37279 timed out after 5.000s (SENT)
W20260812 06:36:21.089267 29898 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 06:36:18.015085 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.28.69.2:37279 (local address 127.28.69.3:38515)
0812 06:36:18.015230 (+   145us) negotiation.cc:107] Waiting for socket to connect
0812 06:36:18.015245 (+    15us) client_negotiation.cc:175] Beginning negotiation
0812 06:36:18.015346 (+   101us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 06:36:21.089151 (+3073805us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.28.69.2:37279: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 06:36:21.089522 29601 consensus_peers.cc:597] T b1e659103246454f8f750a2d4ceb02b7 P d783cdf1dadd4c3d81d716e05c56074a -> Peer 8052be9e17234311b89adc9aedca80e2 (127.28.69.2:37279): Couldn't send request to peer 8052be9e17234311b89adc9aedca80e2. Status: Timed out: Client connection negotiation failed: client connection to 127.28.69.2:37279: received 0 of 4 requested bytes. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:21.592726 28948 tablet_copy-itest.cc:253] shutting down new leaderd783cdf1dadd4c3d81d716e05c56074a...
I20260812 06:36:21.592850 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 29570
I20260812 06:36:21.608973 28948 tablet_copy-itest.cc:256] tombstoning original follower...
I20260812 06:36:21.609944 29219 tablet_service.cc:1558] Processing DeleteTablet for tablet b1e659103246454f8f750a2d4ceb02b7 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:42980
I20260812 06:36:21.610499 29947 tablet_replica.cc:333] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: stopping tablet replica
I20260812 06:36:21.610796 29947 raft_consensus.cc:2243] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:21.611941 29947 raft_consensus.cc:2272] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:21.613637 29947 ts_tablet_manager.cc:1916] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:21.615737 29947 ts_tablet_manager.cc:1929] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.368
I20260812 06:36:21.615818 29947 log.cc:1199] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestRejectRogueLeader.1786516573877167-28948-0/minicluster-data/ts-0/wal/wals/b1e659103246454f8f750a2d4ceb02b7
I20260812 06:36:21.616961 28948 tablet_copy-itest.cc:261] unpausing old (rogue) leader 8052be9e17234311b89adc9aedca80e2...
W20260812 06:36:21.624351 29362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.69.3:41631: connect: Connection refused (error 111)
W20260812 06:36:21.625805 29951 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 06:36:21.624470 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.28.69.3:48587 (local address 127.28.69.2:37279)
0812 06:36:21.624828 (+   358us) server_negotiation.cc:207] Beginning negotiation
0812 06:36:21.624833 (+     5us) server_negotiation.cc:400] Waiting for connection header
0812 06:36:21.624853 (+    20us) server_negotiation.cc:408] Connection header received
0812 06:36:21.624912 (+    59us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 06:36:21.624916 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 06:36:21.624971 (+    55us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 06:36:21.625158 (+   187us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.69.3:48587: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":82,"threads_started":1}
W20260812 06:36:21.627441 29951 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 06:36:21.625970 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.28.69.3:38515 (local address 127.28.69.2:37279)
0812 06:36:21.626855 (+   885us) server_negotiation.cc:207] Beginning negotiation
0812 06:36:21.626860 (+     5us) server_negotiation.cc:400] Waiting for connection header
0812 06:36:21.626877 (+    17us) server_negotiation.cc:408] Connection header received
0812 06:36:21.626923 (+    46us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 06:36:21.626927 (+     4us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 06:36:21.626974 (+    47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 06:36:21.627094 (+   120us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.69.3:38515: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":62,"threads_started":1}
W20260812 06:36:21.627964 29955 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 06:36:21.626114 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.28.69.3:58207 (local address 127.28.69.2:37279)
0812 06:36:21.627435 (+  1321us) server_negotiation.cc:207] Beginning negotiation
0812 06:36:21.627439 (+     4us) server_negotiation.cc:400] Waiting for connection header
0812 06:36:21.627451 (+    12us) server_negotiation.cc:408] Connection header received
0812 06:36:21.627483 (+    32us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 06:36:21.627485 (+     2us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 06:36:21.627523 (+    38us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 06:36:21.627884 (+   361us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.69.3:58207: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":1147}
W20260812 06:36:21.628427 29362 consensus_peers.cc:597] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer d783cdf1dadd4c3d81d716e05c56074a (127.28.69.3:41631): Couldn't send request to peer d783cdf1dadd4c3d81d716e05c56074a. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.3:41631: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:21.628940 29364 consensus_peers.cc:597] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Couldn't send request to peer 958ee04f3d494f7fb608e153245f4c2e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:22.114104 29964 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:22.114949 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:22.617297 29969 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:22.617776 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:23.064208 29969 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:23.064687 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:23.527424 29969 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:23.527971 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:24.079530 29978 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:24.079941 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:24.461388 29978 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:24.461814 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:24.584002 29362 consensus_peers.cc:597] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer d783cdf1dadd4c3d81d716e05c56074a (127.28.69.3:41631): Couldn't send request to peer d783cdf1dadd4c3d81d716e05c56074a. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.3:41631: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:36:25.035009 29981 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:25.035529 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:25.450698 29981 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:25.451094 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:25.881807 29981 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:25.882272 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:26.323796 29981 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:26.324255 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
I20260812 06:36:26.617966 28948 tablet_copy-itest.cc:273] the rogue leader was not able to tablet copy the tombstoned follower
I20260812 06:36:26.618891 29981 ts_tablet_manager.cc:933] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Initiating tablet copy from peer 8052be9e17234311b89adc9aedca80e2 (127.28.69.2:37279)
I20260812 06:36:26.619566 29981 tablet_copy_client.cc:323] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.2:37279
I20260812 06:36:26.623390 29519 tablet_copy_service.cc:140] P 8052be9e17234311b89adc9aedca80e2: Received BeginTabletCopySession request for tablet b1e659103246454f8f750a2d4ceb02b7 from peer 958ee04f3d494f7fb608e153245f4c2e ({username='slave'} at 127.28.69.1:34265)
I20260812 06:36:26.623507 29519 tablet_copy_service.cc:161] P 8052be9e17234311b89adc9aedca80e2: Beginning new tablet copy session on tablet b1e659103246454f8f750a2d4ceb02b7 from peer 958ee04f3d494f7fb608e153245f4c2e at {username='slave'} at 127.28.69.1:34265: session id = 958ee04f3d494f7fb608e153245f4c2e-b1e659103246454f8f750a2d4ceb02b7
I20260812 06:36:26.624601 29519 tablet_copy_source_session.cc:215] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2: Tablet Copy: opened 0 blocks and 1 log segments
W20260812 06:36:26.823344 29362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.69.3:41631: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20260812 06:36:26.890877 29981 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:26.891302 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:27.247817 29362 consensus_peers.cc:597] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer d783cdf1dadd4c3d81d716e05c56074a (127.28.69.3:41631): Couldn't send request to peer d783cdf1dadd4c3d81d716e05c56074a. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.3:41631: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:36:27.473346 29996 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:27.473798 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:28.063030 30000 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:28.063519 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:28.596896 30003 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:28.597431 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:29.054754 30003 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:29.055182 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:29.468756 30003 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:29.469201 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:29.611145 29362 consensus_peers.cc:597] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer d783cdf1dadd4c3d81d716e05c56074a (127.28.69.3:41631): Couldn't send request to peer d783cdf1dadd4c3d81d716e05c56074a. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.3:41631: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 06:36:29.929888 30003 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:29.930336 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:30.396091 30003 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:30.396581 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:30.928557 30009 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:30.929025 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
W20260812 06:36:31.477911 30019 ts_tablet_manager.cc:732] T b1e659103246454f8f750a2d4ceb02b7 P 958ee04f3d494f7fb608e153245f4c2e: Tablet Copy: Invalid argument: Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20260812 06:36:31.478411 29364 consensus_peers.cc:576] T b1e659103246454f8f750a2d4ceb02b7 P 8052be9e17234311b89adc9aedca80e2 -> Peer 958ee04f3d494f7fb608e153245f4c2e (127.28.69.1:44213): Unable to start Tablet Copy on peer: error { code: INVALID_CONFIG status { code: INVALID_ARGUMENT message: "Leader has replica of tablet b1e659103246454f8f750a2d4ceb02b7 with term 1, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request" } }
I20260812 06:36:31.633842 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 29116
I20260812 06:36:31.647373 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 29341
I20260812 06:36:31.683532 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 28959
2026-08-12T06:36:31Z chronyd exiting
[       OK ] TabletCopyITest.TestRejectRogueLeader (17821 ms)
[ RUN      ] TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest
2026-08-12T06:36:31Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:31Z Disabled control of system clock
I20260812 06:36:31.720021 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:33085
--webserver_interface=127.28.69.62
--webserver_port=0
--builtin_ntp_servers=127.28.69.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:33085 with env {}
W20260812 06:36:31.820988 30024 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:31.821215 30024 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:31.821251 30024 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:31.824438 30024 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:31.824493 30024 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:31.824513 30024 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:31.824529 30024 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:31.828241 30024 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:33085
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:33085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.30024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:31.829278 30024 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:31.830328 30024 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:31.835887 30033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:31.835963 30032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:31.836032 30024 server_base.cc:1061] running on GCE node
W20260812 06:36:31.835958 30039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:31.836568 30024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:31.837484 30024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:31.838640 30024 hybrid_clock.cc:648] HybridClock initialized: now 1786516591838594 us; error 57 us; skew 500 ppm
I20260812 06:36:31.840271 30024 webserver.cc:533] Webserver started at http://127.28.69.62:43201/ using document root <none> and password file <none>
I20260812 06:36:31.840812 30024 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:31.840868 30024 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:31.841089 30024 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:31.842631 30024 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data/instance:
uuid: "370c690e4382415b9db12cd6bd98448a"
format_stamp: "Formatted at 2026-08-12 06:36:31 on dist-test-slave-k5rr"
I20260812 06:36:31.843070 30024 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/wal/instance:
uuid: "370c690e4382415b9db12cd6bd98448a"
format_stamp: "Formatted at 2026-08-12 06:36:31 on dist-test-slave-k5rr"
I20260812 06:36:31.846263 30024 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:31.848302 30046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:31.849284 30024 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:31.849397 30024 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "370c690e4382415b9db12cd6bd98448a"
format_stamp: "Formatted at 2026-08-12 06:36:31 on dist-test-slave-k5rr"
I20260812 06:36:31.849479 30024 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:31.866825 30024 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:31.867529 30024 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:31.867707 30024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:31.874895 30024 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:33085
I20260812 06:36:31.874902 30138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:33085 every 8 connection(s)
I20260812 06:36:31.875905 30024 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:31.878785 30140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:31.883752 30140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a: Bootstrap starting.
I20260812 06:36:31.884692 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 30024
I20260812 06:36:31.884799 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/wal/instance
I20260812 06:36:31.886264 30140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:31.886931 30140 log.cc:826] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:31.888594 30140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a: No bootstrap required, opened a new log
I20260812 06:36:31.891075 30140 raft_consensus.cc:359] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c690e4382415b9db12cd6bd98448a" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 33085 } }
I20260812 06:36:31.891258 30140 raft_consensus.cc:385] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:31.891319 30140 raft_consensus.cc:740] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 370c690e4382415b9db12cd6bd98448a, State: Initialized, Role: FOLLOWER
I20260812 06:36:31.891717 30140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c690e4382415b9db12cd6bd98448a" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 33085 } }
I20260812 06:36:31.891839 30140 raft_consensus.cc:399] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:31.891901 30140 raft_consensus.cc:493] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:31.892004 30140 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:31.892707 30140 raft_consensus.cc:515] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c690e4382415b9db12cd6bd98448a" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 33085 } }
I20260812 06:36:31.893047 30140 leader_election.cc:304] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 370c690e4382415b9db12cd6bd98448a; no voters: 
I20260812 06:36:31.893325 30140 leader_election.cc:290] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:31.893435 30145 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:31.893625 30145 raft_consensus.cc:697] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [term 1 LEADER]: Becoming Leader. State: Replica: 370c690e4382415b9db12cd6bd98448a, State: Running, Role: LEADER
I20260812 06:36:31.893953 30145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c690e4382415b9db12cd6bd98448a" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 33085 } }
I20260812 06:36:31.894348 30140 sys_catalog.cc:565] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:31.895692 30146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "370c690e4382415b9db12cd6bd98448a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c690e4382415b9db12cd6bd98448a" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 33085 } } }
I20260812 06:36:31.896135 30146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:31.896032 30148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 370c690e4382415b9db12cd6bd98448a. Latest consensus state: current_term: 1 leader_uuid: "370c690e4382415b9db12cd6bd98448a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c690e4382415b9db12cd6bd98448a" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 33085 } } }
I20260812 06:36:31.896440 30148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:31.897063 30166 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:31.899863 30166 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:31.904844 30166 catalog_manager.cc:1383] Generated new cluster ID: c6fef7d8e2ed4ad1b1d80a38dc8dc1e3
I20260812 06:36:31.904907 30166 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:31.915897 30166 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:31.916728 30166 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:31.923440 30166 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 370c690e4382415b9db12cd6bd98448a: Generated new TSK 0
I20260812 06:36:31.924010 30166 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:31.927294 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.1:0
--local_ip_for_outbound_sockets=127.28.69.1
--webserver_interface=127.28.69.1
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--builtin_ntp_servers=127.28.69.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260812 06:36:32.032630 30172 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:32.032857 30172 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:32.032914 30172 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:32.036247 30172 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:32.036376 30172 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.1
I20260812 06:36:32.040205 30172 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.69.1
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--never_fsync=true
--heap_profile_path=/tmp/kudu.30172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:32.041327 30172 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:32.042495 30172 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:32.048707 30181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.048723 30182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.048758 30188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:32.049054 30172 server_base.cc:1061] running on GCE node
I20260812 06:36:32.049425 30172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:32.050021 30172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:32.051184 30172 hybrid_clock.cc:648] HybridClock initialized: now 1786516592051164 us; error 34 us; skew 500 ppm
I20260812 06:36:32.053272 30172 webserver.cc:533] Webserver started at http://127.28.69.1:36543/ using document root <none> and password file <none>
I20260812 06:36:32.053958 30172 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:32.054026 30172 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:32.054224 30172 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:32.056260 30172 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data/instance:
uuid: "1de9128dbfcf48d99f0928035c855fb9"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.056912 30172 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance:
uuid: "1de9128dbfcf48d99f0928035c855fb9"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.061072 30172 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260812 06:36:32.063408 30196 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.064373 30172 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:36:32.064476 30172 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/wal
uuid: "1de9128dbfcf48d99f0928035c855fb9"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.064571 30172 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:32.089571 30172 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:32.090245 30172 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:32.090426 30172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:32.091007 30172 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:32.092034 30172 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:32.092084 30172 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.092136 30172 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:32.092164 30172 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.101145 30172 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.1:43171
I20260812 06:36:32.101181 30377 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.1:43171 every 8 connection(s)
I20260812 06:36:32.102092 30172 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:32.104089 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 30172
I20260812 06:36:32.104182 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:32.106312 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.2:0
--local_ip_for_outbound_sockets=127.28.69.2
--webserver_interface=127.28.69.2
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--builtin_ntp_servers=127.28.69.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 06:36:32.110388 30378 heartbeater.cc:344] Connected to a master server at 127.28.69.62:33085
I20260812 06:36:32.110605 30378 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:32.111078 30378 heartbeater.cc:507] Master 127.28.69.62:33085 requested a full tablet report, sending...
I20260812 06:36:32.112488 30077 ts_manager.cc:194] Registered new tserver with Master: 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171)
I20260812 06:36:32.113739 30077 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.1:53699
W20260812 06:36:32.208834 30384 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:32.209057 30384 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:32.209115 30384 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:32.212390 30384 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:32.212492 30384 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.2
I20260812 06:36:32.216288 30384 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.69.2
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--never_fsync=true
--heap_profile_path=/tmp/kudu.30384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:32.217509 30384 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:32.218698 30384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:32.224692 30391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.224677 30397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.224769 30394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:32.225111 30384 server_base.cc:1061] running on GCE node
I20260812 06:36:32.225430 30384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:32.225909 30384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:32.227064 30384 hybrid_clock.cc:648] HybridClock initialized: now 1786516592227048 us; error 32 us; skew 500 ppm
I20260812 06:36:32.228695 30384 webserver.cc:533] Webserver started at http://127.28.69.2:35561/ using document root <none> and password file <none>
I20260812 06:36:32.229272 30384 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:32.229329 30384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:32.229521 30384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:32.230969 30384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data/instance:
uuid: "84064db7f8d24dad92dc287e4afbf163"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.231410 30384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance:
uuid: "84064db7f8d24dad92dc287e4afbf163"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.234499 30384 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:32.236459 30410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.237447 30384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:32.237547 30384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/wal
uuid: "84064db7f8d24dad92dc287e4afbf163"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.237627 30384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:32.261818 30384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:32.262477 30384 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:32.262650 30384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:32.263226 30384 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:32.264211 30384 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:32.264261 30384 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.264313 30384 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:32.264343 30384 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.273463 30384 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.2:36327
I20260812 06:36:32.273510 30612 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.2:36327 every 8 connection(s)
I20260812 06:36:32.274433 30384 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:32.282478 30613 heartbeater.cc:344] Connected to a master server at 127.28.69.62:33085
I20260812 06:36:32.282722 30613 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:32.282917 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 30384
I20260812 06:36:32.283015 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:32.283254 30613 heartbeater.cc:507] Master 127.28.69.62:33085 requested a full tablet report, sending...
I20260812 06:36:32.284480 30076 ts_manager.cc:194] Registered new tserver with Master: 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:32.285118 30076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.2:35345
I20260812 06:36:32.285202 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.3:0
--local_ip_for_outbound_sockets=127.28.69.3
--webserver_interface=127.28.69.3
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--builtin_ntp_servers=127.28.69.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260812 06:36:32.387750 30616 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:32.387964 30616 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:32.388010 30616 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:32.391237 30616 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:32.391345 30616 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.3
I20260812 06:36:32.395140 30616 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.69.3
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--never_fsync=true
--heap_profile_path=/tmp/kudu.30616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:32.396174 30616 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:32.397362 30616 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:32.403393 30628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.403383 30624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.403445 30625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:32.403646 30616 server_base.cc:1061] running on GCE node
I20260812 06:36:32.404007 30616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:32.404536 30616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:32.405714 30616 hybrid_clock.cc:648] HybridClock initialized: now 1786516592405687 us; error 31 us; skew 500 ppm
I20260812 06:36:32.407577 30616 webserver.cc:533] Webserver started at http://127.28.69.3:39173/ using document root <none> and password file <none>
I20260812 06:36:32.408146 30616 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:32.408211 30616 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:32.408404 30616 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:32.410012 30616 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data/instance:
uuid: "f4d6d520e9b34951a4ea36a632e642a7"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.410503 30616 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/wal/instance:
uuid: "f4d6d520e9b34951a4ea36a632e642a7"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.413892 30616 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:36:32.416056 30639 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.417341 30616 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:32.417446 30616 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/wal
uuid: "f4d6d520e9b34951a4ea36a632e642a7"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.417541 30616 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:32.434513 30616 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:32.435132 30616 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:32.435308 30616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:32.435853 30616 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:32.436841 30616 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:32.436892 30616 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.436941 30616 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:32.436966 30616 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.446187 30616 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.3:35697
I20260812 06:36:32.446231 30828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.3:35697 every 8 connection(s)
I20260812 06:36:32.447105 30616 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:32.451280 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 30616
I20260812 06:36:32.451387 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:32.454181 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.4:0
--local_ip_for_outbound_sockets=127.28.69.4
--webserver_interface=127.28.69.4
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--builtin_ntp_servers=127.28.69.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 06:36:32.455557 30829 heartbeater.cc:344] Connected to a master server at 127.28.69.62:33085
I20260812 06:36:32.455907 30829 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:32.456415 30829 heartbeater.cc:507] Master 127.28.69.62:33085 requested a full tablet report, sending...
I20260812 06:36:32.457414 30076 ts_manager.cc:194] Registered new tserver with Master: f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697)
I20260812 06:36:32.457968 30076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.3:42617
W20260812 06:36:32.558938 30837 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:32.559157 30837 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:32.559213 30837 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:32.562500 30837 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:32.562614 30837 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.4
I20260812 06:36:32.566359 30837 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.69.4
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--never_fsync=true
--heap_profile_path=/tmp/kudu.30837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:32.567358 30837 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:32.568413 30837 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:32.574438 30847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.574455 30849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.574626 30846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:32.574659 30837 server_base.cc:1061] running on GCE node
I20260812 06:36:32.575121 30837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:32.575614 30837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:32.576798 30837 hybrid_clock.cc:648] HybridClock initialized: now 1786516592576779 us; error 30 us; skew 500 ppm
I20260812 06:36:32.578469 30837 webserver.cc:533] Webserver started at http://127.28.69.4:43473/ using document root <none> and password file <none>
I20260812 06:36:32.578999 30837 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:32.579052 30837 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:32.579236 30837 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:32.580744 30837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data/instance:
uuid: "ac29ace078f54b2fa033e4d8930420ef"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.581236 30837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/wal/instance:
uuid: "ac29ace078f54b2fa033e4d8930420ef"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.584441 30837 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20260812 06:36:32.586601 30859 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.587622 30837 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:36:32.587725 30837 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/wal
uuid: "ac29ace078f54b2fa033e4d8930420ef"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.587834 30837 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:32.604707 30837 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:32.605363 30837 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:32.605528 30837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:32.606081 30837 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:32.607067 30837 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:32.607115 30837 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.607164 30837 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:32.607192 30837 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.616300 30837 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.4:33503
I20260812 06:36:32.616339 31046 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.4:33503 every 8 connection(s)
I20260812 06:36:32.617233 30837 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
I20260812 06:36:32.620865 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 30837
I20260812 06:36:32.621027 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/wal/instance
I20260812 06:36:32.623098 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.5:0
--local_ip_for_outbound_sockets=127.28.69.5
--webserver_interface=127.28.69.5
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--builtin_ntp_servers=127.28.69.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 06:36:32.625257 31049 heartbeater.cc:344] Connected to a master server at 127.28.69.62:33085
I20260812 06:36:32.625520 31049 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:32.626075 31049 heartbeater.cc:507] Master 127.28.69.62:33085 requested a full tablet report, sending...
I20260812 06:36:32.627071 30076 ts_manager.cc:194] Registered new tserver with Master: ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503)
I20260812 06:36:32.627609 30076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.4:58559
W20260812 06:36:32.728058 31052 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:32.728263 31052 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:32.728322 31052 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:32.731609 31052 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:32.731729 31052 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.5
I20260812 06:36:32.735505 31052 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.5:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data/info.pb
--webserver_interface=127.28.69.5
--webserver_port=0
--tserver_master_addrs=127.28.69.62:33085
--never_fsync=true
--heap_profile_path=/tmp/kudu.31052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.5

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:32.736570 31052 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:32.737715 31052 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:32.743628 31059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.743641 31064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:32.743641 31060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:32.744061 31052 server_base.cc:1061] running on GCE node
I20260812 06:36:32.744390 31052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:32.744894 31052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:32.746047 31052 hybrid_clock.cc:648] HybridClock initialized: now 1786516592746035 us; error 25 us; skew 500 ppm
I20260812 06:36:32.747656 31052 webserver.cc:533] Webserver started at http://127.28.69.5:38451/ using document root <none> and password file <none>
I20260812 06:36:32.748181 31052 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:32.748238 31052 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:32.748406 31052 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:32.749931 31052 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data/instance:
uuid: "25c20b7faacf4a82a17b43d1b092a372"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.750370 31052 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal/instance:
uuid: "25c20b7faacf4a82a17b43d1b092a372"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.753468 31052 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:32.755417 31078 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.756331 31052 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:32.756433 31052 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal
uuid: "25c20b7faacf4a82a17b43d1b092a372"
format_stamp: "Formatted at 2026-08-12 06:36:32 on dist-test-slave-k5rr"
I20260812 06:36:32.756516 31052 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:32.772883 31052 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:32.773474 31052 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:32.773628 31052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:32.774140 31052 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:32.775076 31052 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:32.775125 31052 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.775175 31052 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:32.775202 31052 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:32.784198 31052 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.5:41465
I20260812 06:36:32.784225 31272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.5:41465 every 8 connection(s)
I20260812 06:36:32.785111 31052 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data/info.pb
I20260812 06:36:32.790182 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 31052
I20260812 06:36:32.790294 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal/instance
I20260812 06:36:32.792889 31273 heartbeater.cc:344] Connected to a master server at 127.28.69.62:33085
I20260812 06:36:32.793148 31273 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:32.793623 31273 heartbeater.cc:507] Master 127.28.69.62:33085 requested a full tablet report, sending...
I20260812 06:36:32.794536 30076 ts_manager.cc:194] Registered new tserver with Master: 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465)
I20260812 06:36:32.795087 30076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.5:52733
I20260812 06:36:32.804720 28948 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260812 06:36:32.821254 30076 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48790:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:32.822335 30076 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260812 06:36:32.839833 30271 tablet_service.cc:1511] Processing CreateTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 (DEFAULT_TABLE table=test-workload [id=cb472086b4a64f308c87f93c0e8b91a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:32.839834 30943 tablet_service.cc:1511] Processing CreateTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 (DEFAULT_TABLE table=test-workload [id=cb472086b4a64f308c87f93c0e8b91a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:32.839831 31157 tablet_service.cc:1511] Processing CreateTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 (DEFAULT_TABLE table=test-workload [id=cb472086b4a64f308c87f93c0e8b91a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:32.840838 30271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:32.840839 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:32.840840 31157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:32.844966 30498 tablet_service.cc:1511] Processing CreateTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 (DEFAULT_TABLE table=test-workload [id=cb472086b4a64f308c87f93c0e8b91a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:32.845939 30498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:32.847433 30722 tablet_service.cc:1511] Processing CreateTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 (DEFAULT_TABLE table=test-workload [id=cb472086b4a64f308c87f93c0e8b91a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:32.848322 30722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:32.850575 31324 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Bootstrap starting.
I20260812 06:36:32.852264 31326 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Bootstrap starting.
I20260812 06:36:32.852734 31323 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Bootstrap starting.
I20260812 06:36:32.852887 31324 tablet_bootstrap.cc:654] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:32.853817 31324 log.cc:826] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:32.854452 31326 tablet_bootstrap.cc:654] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:32.854578 31328 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Bootstrap starting.
I20260812 06:36:32.855191 31323 tablet_bootstrap.cc:654] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:32.855247 31326 log.cc:826] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:32.855746 31324 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: No bootstrap required, opened a new log
I20260812 06:36:32.855940 31324 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Time spent bootstrapping tablet: real 0.006s	user 0.002s	sys 0.002s
I20260812 06:36:32.856153 31323 log.cc:826] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:32.856534 31328 tablet_bootstrap.cc:654] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:32.856899 31326 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: No bootstrap required, opened a new log
I20260812 06:36:32.856894 31325 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Bootstrap starting.
I20260812 06:36:32.857323 31326 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:32.858541 31324 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.858709 31324 raft_consensus.cc:385] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:32.858741 31324 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de9128dbfcf48d99f0928035c855fb9, State: Initialized, Role: FOLLOWER
I20260812 06:36:32.859112 31324 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.859292 31325 tablet_bootstrap.cc:654] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:32.859935 31324 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.003s
I20260812 06:36:32.860020 31325 log.cc:826] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:32.860242 31323 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: No bootstrap required, opened a new log
I20260812 06:36:32.860255 30378 heartbeater.cc:499] Master 127.28.69.62:33085 was elected leader, sending a full tablet report...
I20260812 06:36:32.860414 31323 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Time spent bootstrapping tablet: real 0.008s	user 0.003s	sys 0.000s
I20260812 06:36:32.860348 31326 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.860723 31326 raft_consensus.cc:385] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:32.860859 31326 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac29ace078f54b2fa033e4d8930420ef, State: Initialized, Role: FOLLOWER
I20260812 06:36:32.861404 31328 log.cc:826] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:32.861392 31326 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.862304 31326 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:32.862656 31049 heartbeater.cc:499] Master 127.28.69.62:33085 was elected leader, sending a full tablet report...
I20260812 06:36:32.863538 31325 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: No bootstrap required, opened a new log
I20260812 06:36:32.863739 31325 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Time spent bootstrapping tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 06:36:32.864099 31323 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.864328 31323 raft_consensus.cc:385] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:32.864383 31323 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c20b7faacf4a82a17b43d1b092a372, State: Initialized, Role: FOLLOWER
I20260812 06:36:32.864877 31323 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.865427 31328 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: No bootstrap required, opened a new log
I20260812 06:36:32.865622 31328 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.000s
I20260812 06:36:32.865804 31323 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:32.866132 31273 heartbeater.cc:499] Master 127.28.69.62:33085 was elected leader, sending a full tablet report...
I20260812 06:36:32.867175 31325 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.867403 31325 raft_consensus.cc:385] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:32.867457 31325 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84064db7f8d24dad92dc287e4afbf163, State: Initialized, Role: FOLLOWER
I20260812 06:36:32.867897 31325 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
W20260812 06:36:32.868018 31050 tablet.cc:2406] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:32.868942 31325 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:32.869094 30613 heartbeater.cc:499] Master 127.28.69.62:33085 was elected leader, sending a full tablet report...
I20260812 06:36:32.868884 31328 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.869647 31328 raft_consensus.cc:385] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:32.869709 31328 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d6d520e9b34951a4ea36a632e642a7, State: Initialized, Role: FOLLOWER
I20260812 06:36:32.870112 31328 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.871301 30829 heartbeater.cc:499] Master 127.28.69.62:33085 was elected leader, sending a full tablet report...
I20260812 06:36:32.871582 31328 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 06:36:32.889055 31342 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:32.889251 31342 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.890443 31342 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:32.895942 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "25c20b7faacf4a82a17b43d1b092a372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9" is_pre_election: true
I20260812 06:36:32.896063 30531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "25c20b7faacf4a82a17b43d1b092a372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163" is_pre_election: true
I20260812 06:36:32.896299 30531 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25c20b7faacf4a82a17b43d1b092a372 in term 0.
I20260812 06:36:32.896301 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25c20b7faacf4a82a17b43d1b092a372 in term 0.
I20260812 06:36:32.896548 30983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "25c20b7faacf4a82a17b43d1b092a372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef" is_pre_election: true
I20260812 06:36:32.896832 30983 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25c20b7faacf4a82a17b43d1b092a372 in term 0.
I20260812 06:36:32.896975 31081 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1de9128dbfcf48d99f0928035c855fb9, 25c20b7faacf4a82a17b43d1b092a372, 84064db7f8d24dad92dc287e4afbf163; no voters: 
I20260812 06:36:32.897233 30756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "25c20b7faacf4a82a17b43d1b092a372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7" is_pre_election: true
I20260812 06:36:32.897300 31342 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:32.897373 31342 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:32.897425 31342 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:32.897495 30756 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25c20b7faacf4a82a17b43d1b092a372 in term 0.
I20260812 06:36:32.898428 31342 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.898896 31342 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [CANDIDATE]: Term 1 election: Requested vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:32.899209 30983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "25c20b7faacf4a82a17b43d1b092a372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef"
I20260812 06:36:32.899325 30983 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:32.899356 30531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "25c20b7faacf4a82a17b43d1b092a372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163"
I20260812 06:36:32.899365 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "25c20b7faacf4a82a17b43d1b092a372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9"
I20260812 06:36:32.899472 30304 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:32.899474 30531 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:32.900333 30531 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c20b7faacf4a82a17b43d1b092a372 in term 1.
I20260812 06:36:32.900453 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c20b7faacf4a82a17b43d1b092a372 in term 1.
I20260812 06:36:32.900453 30983 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c20b7faacf4a82a17b43d1b092a372 in term 1.
I20260812 06:36:32.900775 31082 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 25c20b7faacf4a82a17b43d1b092a372, 84064db7f8d24dad92dc287e4afbf163, ac29ace078f54b2fa033e4d8930420ef; no voters: 
I20260812 06:36:32.900782 30756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "25c20b7faacf4a82a17b43d1b092a372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7"
I20260812 06:36:32.900885 30756 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:32.900995 31342 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:32.901247 31342 raft_consensus.cc:697] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 LEADER]: Becoming Leader. State: Replica: 25c20b7faacf4a82a17b43d1b092a372, State: Running, Role: LEADER
I20260812 06:36:32.901578 31342 consensus_queue.cc:237] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:32.902046 30756 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25c20b7faacf4a82a17b43d1b092a372 in term 1.
I20260812 06:36:32.904922 30073 catalog_manager.cc:5719] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5). New cstate: current_term: 1 leader_uuid: "25c20b7faacf4a82a17b43d1b092a372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:32.940690 28948 tablet_copy-itest.cc:761] Iteration 1
W20260812 06:36:32.948136 30831 tablet.cc:2406] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:32.958189 30983 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 1 FOLLOWER]: Refusing update from remote peer 25c20b7faacf4a82a17b43d1b092a372: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:32.958189 30531 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 1 FOLLOWER]: Refusing update from remote peer 25c20b7faacf4a82a17b43d1b092a372: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:32.958225 30756 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 1 FOLLOWER]: Refusing update from remote peer 25c20b7faacf4a82a17b43d1b092a372: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:32.958220 30304 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Refusing update from remote peer 25c20b7faacf4a82a17b43d1b092a372: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:32.958923 31342 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:32.959110 31352 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:32.959311 31360 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:32.959483 31361 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:32.968039 31357 mvcc.cc:204] Tried to move back new op lower bound from 7317571964748898304 to 7317571964528848896. Current Snapshot: MvccSnapshot[applied={T|T < 7317571964748898304}]
I20260812 06:36:32.972299 31365 mvcc.cc:204] Tried to move back new op lower bound from 7317571964748898304 to 7317571964528848896. Current Snapshot: MvccSnapshot[applied={T|T < 7317571964748898304}]
I20260812 06:36:32.972499 31364 mvcc.cc:204] Tried to move back new op lower bound from 7317571964748898304 to 7317571964528848896. Current Snapshot: MvccSnapshot[applied={T|T < 7317571964748898304 or (T in {7317571964748898304})}]
I20260812 06:36:33.067785 28948 tablet_copy-itest.cc:780] Tombstoning follower tablet e7b1501f9d8a4fe8a778c44fc46d3c02 on TS 1de9128dbfcf48d99f0928035c855fb9
I20260812 06:36:33.068346 30271 tablet_service.cc:1558] Processing DeleteTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:44162
I20260812 06:36:33.068905 31389 tablet_replica.cc:333] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: stopping tablet replica
I20260812 06:36:33.069260 31389 raft_consensus.cc:2243] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:33.069491 31389 raft_consensus.cc:2272] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 06:36:33.071404 31081 consensus_peers.cc:597] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 -> Peer 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171): Couldn't send request to peer 1de9128dbfcf48d99f0928035c855fb9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:33.072211 31389 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:33.074534 31389 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.22
I20260812 06:36:33.074631 31389 log.cc:1199] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/wal/wals/e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:33.635779 31361 consensus_queue.cc:799] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [LEADER]: Peer 1de9128dbfcf48d99f0928035c855fb9 is lagging by at least 71 ops behind the committed index 
I20260812 06:36:34.207517 31400 ts_tablet_manager.cc:933] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Initiating tablet copy from peer 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465)
I20260812 06:36:34.208153 31400 tablet_copy_client.cc:323] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.5:41465
I20260812 06:36:34.214382 31230 tablet_copy_service.cc:140] P 25c20b7faacf4a82a17b43d1b092a372: Received BeginTabletCopySession request for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer 1de9128dbfcf48d99f0928035c855fb9 ({username='slave'} at 127.28.69.1:49903)
I20260812 06:36:34.214541 31230 tablet_copy_service.cc:161] P 25c20b7faacf4a82a17b43d1b092a372: Beginning new tablet copy session on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer 1de9128dbfcf48d99f0928035c855fb9 at {username='slave'} at 127.28.69.1:49903: session id = 1de9128dbfcf48d99f0928035c855fb9-e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:34.215888 31230 tablet_copy_source_session.cc:215] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:34.218343 31400 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:36:34.220953 31400 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.22
I20260812 06:36:34.221442 31400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:34.223784 31400 tablet_copy_client.cc:806] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:34.224021 31400 tablet_copy_client.cc:670] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:34.225754 28948 tablet_copy-itest.cc:790] Tombstoning leader tablet e7b1501f9d8a4fe8a778c44fc46d3c02 on TS 25c20b7faacf4a82a17b43d1b092a372
I20260812 06:36:34.226281 31157 tablet_service.cc:1558] Processing DeleteTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:43186
I20260812 06:36:34.226719 31406 tablet_replica.cc:333] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: stopping tablet replica
I20260812 06:36:34.226821 31400 tablet_copy_client.cc:538] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:34.227074 31406 raft_consensus.cc:2243] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:36:34.229120 31400 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Bootstrap starting.
I20260812 06:36:34.230171 31406 raft_consensus.cc:2272] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:34.231925 31406 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:34.233878 31406 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.294
I20260812 06:36:34.233954 31406 log.cc:1199] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal/wals/e7b1501f9d8a4fe8a778c44fc46d3c02
W20260812 06:36:34.250773 30909 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54118: Illegal state: replica ac29ace078f54b2fa033e4d8930420ef is not leader of this config: current role FOLLOWER
W20260812 06:36:34.262267 30685 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58094: Illegal state: replica f4d6d520e9b34951a4ea36a632e642a7 is not leader of this config: current role FOLLOWER
W20260812 06:36:34.276937 30465 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47360: Illegal state: replica 84064db7f8d24dad92dc287e4afbf163 is not leader of this config: current role FOLLOWER
I20260812 06:36:34.404444 31400 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Bootstrap replayed 1/1 log segments. Stats: ops{read=292 overwritten=0 applied=291 ignored=0} inserts{seen=290 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:36:34.404788 31400 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Bootstrap complete.
I20260812 06:36:34.404969 31400 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Time spent bootstrapping tablet: real 0.176s	user 0.151s	sys 0.020s
I20260812 06:36:34.405568 31400 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:34.406018 31400 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de9128dbfcf48d99f0928035c855fb9, State: Initialized, Role: FOLLOWER
I20260812 06:36:34.406186 31400 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 291, Last appended: 1.292, Last appended by leader: 292, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:34.406520 31400 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:36:34.407255 31230 tablet_copy_service.cc:342] P 25c20b7faacf4a82a17b43d1b092a372: Request end of tablet copy session 1de9128dbfcf48d99f0928035c855fb9-e7b1501f9d8a4fe8a778c44fc46d3c02 received from {username='slave'} at 127.28.69.1:49903
I20260812 06:36:34.407369 31230 tablet_copy_service.cc:434] P 25c20b7faacf4a82a17b43d1b092a372: ending tablet copy session 1de9128dbfcf48d99f0928035c855fb9-e7b1501f9d8a4fe8a778c44fc46d3c02 on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with peer 1de9128dbfcf48d99f0928035c855fb9
I20260812 06:36:35.728611 31423 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25c20b7faacf4a82a17b43d1b092a372)
I20260812 06:36:35.728812 31423 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:35.728864 31424 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25c20b7faacf4a82a17b43d1b092a372)
I20260812 06:36:35.728996 31424 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:35.730137 31424 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:35.730120 31423 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697)
I20260812 06:36:35.731727 31425 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25c20b7faacf4a82a17b43d1b092a372)
I20260812 06:36:35.732175 31425 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:35.736671 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9" is_pre_election: true
I20260812 06:36:35.736843 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 1.
I20260812 06:36:35.737568 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9" is_pre_election: true
I20260812 06:36:35.737681 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 1.
I20260812 06:36:35.738256 31425 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:35.739508 30526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163" is_pre_election: true
I20260812 06:36:35.739640 30526 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 1.
I20260812 06:36:35.740060 30874 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1de9128dbfcf48d99f0928035c855fb9, 84064db7f8d24dad92dc287e4afbf163, ac29ace078f54b2fa033e4d8930420ef; no voters: 
I20260812 06:36:35.740085 30755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7" is_pre_election: true
I20260812 06:36:35.740211 30755 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 1.
I20260812 06:36:35.740221 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372" is_pre_election: true
I20260812 06:36:35.740377 31199 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.294
I20260812 06:36:35.740414 31424 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:36:35.740471 31424 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25c20b7faacf4a82a17b43d1b092a372)
I20260812 06:36:35.740510 31424 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:35.740496 31199 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 1.
I20260812 06:36:35.742029 31424 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:35.742750 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9"
I20260812 06:36:35.742866 30304 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:35.743793 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 2.
I20260812 06:36:35.743924 30755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7" is_pre_election: true
I20260812 06:36:35.744035 30755 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 1.
I20260812 06:36:35.744259 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372" is_pre_election: true
I20260812 06:36:35.744359 31199 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.294
I20260812 06:36:35.744423 31199 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 1.
I20260812 06:36:35.744427 30416 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1de9128dbfcf48d99f0928035c855fb9, 84064db7f8d24dad92dc287e4afbf163, f4d6d520e9b34951a4ea36a632e642a7; no voters: 
I20260812 06:36:35.744616 31197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372"
I20260812 06:36:35.744712 31197 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.294
I20260812 06:36:35.744725 31423 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:36:35.744771 31197 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:35.744804 31423 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25c20b7faacf4a82a17b43d1b092a372)
I20260812 06:36:35.744845 31423 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:35.745829 31197 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 2.
I20260812 06:36:35.745873 31423 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:35.746138 30874 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1de9128dbfcf48d99f0928035c855fb9, 25c20b7faacf4a82a17b43d1b092a372, ac29ace078f54b2fa033e4d8930420ef; no voters: 
I20260812 06:36:35.746385 31423 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [CANDIDATE]: Term 2 election: Requested vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697)
I20260812 06:36:35.746764 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9"
I20260812 06:36:35.746918 30756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7"
I20260812 06:36:35.746935 30303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9" is_pre_election: true
I20260812 06:36:35.746943 30304 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 84064db7f8d24dad92dc287e4afbf163 in current term 2: Already voted for candidate ac29ace078f54b2fa033e4d8930420ef in this term.
I20260812 06:36:35.747022 30756 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:35.747251 30755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7"
I20260812 06:36:35.747459 31424 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [CANDIDATE]: Term 2 election: Requested vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:35.747586 31424 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:36:35.747653 31424 raft_consensus.cc:697] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 LEADER]: Becoming Leader. State: Replica: ac29ace078f54b2fa033e4d8930420ef, State: Running, Role: LEADER
I20260812 06:36:35.747953 31424 consensus_queue.cc:237] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 294, Committed index: 294, Last appended: 1.294, Last appended by leader: 294, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:35.748045 30756 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 2.
I20260812 06:36:35.748039 31197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372"
I20260812 06:36:35.748121 31197 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.294
I20260812 06:36:35.748248 31197 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 84064db7f8d24dad92dc287e4afbf163 in current term 2: Already voted for candidate ac29ace078f54b2fa033e4d8930420ef in this term.
I20260812 06:36:35.748387 30526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163"
I20260812 06:36:35.748571 30526 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ac29ace078f54b2fa033e4d8930420ef in current term 2: Already voted for candidate 84064db7f8d24dad92dc287e4afbf163 in this term.
I20260812 06:36:35.749454 30982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef" is_pre_election: true
I20260812 06:36:35.749749 30983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef"
I20260812 06:36:35.750394 30416 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 84064db7f8d24dad92dc287e4afbf163, f4d6d520e9b34951a4ea36a632e642a7; no voters: 1de9128dbfcf48d99f0928035c855fb9, 25c20b7faacf4a82a17b43d1b092a372, ac29ace078f54b2fa033e4d8930420ef
I20260812 06:36:35.750620 31423 raft_consensus.cc:2749] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 06:36:35.751271 30526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163" is_pre_election: true
I20260812 06:36:35.751399 30526 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4d6d520e9b34951a4ea36a632e642a7 in current term 2: Already voted for candidate 84064db7f8d24dad92dc287e4afbf163 in this term.
I20260812 06:36:35.751852 31197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372" is_pre_election: true
I20260812 06:36:35.751950 31197 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.294
I20260812 06:36:35.751984 30983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 294 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef" is_pre_election: true
I20260812 06:36:35.752032 31197 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4d6d520e9b34951a4ea36a632e642a7 in current term 2: Already voted for candidate ac29ace078f54b2fa033e4d8930420ef in this term.
I20260812 06:36:35.751901 30073 catalog_manager.cc:5719] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef reported cstate change: term changed from 1 to 2, leader changed from 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5) to ac29ace078f54b2fa033e4d8930420ef (127.28.69.4). New cstate: current_term: 2 leader_uuid: "ac29ace078f54b2fa033e4d8930420ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:35.752333 30646 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: f4d6d520e9b34951a4ea36a632e642a7; no voters: 1de9128dbfcf48d99f0928035c855fb9, 25c20b7faacf4a82a17b43d1b092a372, 84064db7f8d24dad92dc287e4afbf163
I20260812 06:36:35.752543 31425 raft_consensus.cc:2749] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:36:35.758137 30756 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Refusing update from remote peer ac29ace078f54b2fa033e4d8930420ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 294. Preceding OpId from leader: term: 2 index: 296. (index mismatch)
I20260812 06:36:35.758325 30304 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 2 FOLLOWER]: Refusing update from remote peer ac29ace078f54b2fa033e4d8930420ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 292. Preceding OpId from leader: term: 2 index: 296. (index mismatch)
I20260812 06:36:35.758349 30526 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Refusing update from remote peer ac29ace078f54b2fa033e4d8930420ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 294. Preceding OpId from leader: term: 2 index: 296. (index mismatch)
W20260812 06:36:35.758774 30874 consensus_peers.cc:597] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef -> Peer 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465): Couldn't send request to peer 25c20b7faacf4a82a17b43d1b092a372. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:35.758782 31475 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 295, Last known committed idx: 294, Time since last communication: 0.000s
I20260812 06:36:35.759011 31477 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 295, Last known committed idx: 294, Time since last communication: 0.000s
I20260812 06:36:35.759141 31424 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 295, Last known committed idx: 291, Time since last communication: 0.000s
I20260812 06:36:35.766031 31489 mvcc.cc:204] Tried to move back new op lower bound from 7317571976220815360 to 7317571976191909888. Current Snapshot: MvccSnapshot[applied={T|T < 7317571969919418368}]
I20260812 06:36:35.773028 28948 cluster_itest_util.cc:258] Not converged past 1 yet: 2.296 2.296 2.296 <uninitialized op> 2.296
I20260812 06:36:35.877717 28948 cluster_itest_util.cc:258] Not converged past 1 yet: 2.296 2.296 2.296 <uninitialized op> 2.296
I20260812 06:36:36.082226 28948 cluster_itest_util.cc:258] Not converged past 1 yet: 2.296 2.296 2.296 <uninitialized op> 2.296
I20260812 06:36:36.293977 31500 ts_tablet_manager.cc:933] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Initiating tablet copy from peer ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503)
I20260812 06:36:36.294535 31500 tablet_copy_client.cc:323] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.4:33503
I20260812 06:36:36.295269 31012 tablet_copy_service.cc:140] P ac29ace078f54b2fa033e4d8930420ef: Received BeginTabletCopySession request for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer 25c20b7faacf4a82a17b43d1b092a372 ({username='slave'} at 127.28.69.5:44045)
I20260812 06:36:36.295405 31012 tablet_copy_service.cc:161] P ac29ace078f54b2fa033e4d8930420ef: Beginning new tablet copy session on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer 25c20b7faacf4a82a17b43d1b092a372 at {username='slave'} at 127.28.69.5:44045: session id = 25c20b7faacf4a82a17b43d1b092a372-e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:36.296581 31012 tablet_copy_source_session.cc:215] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:36.297863 31500 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:36:36.299588 31500 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.294
I20260812 06:36:36.299750 31500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:36.300724 31500 tablet_copy_client.cc:806] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:36.300884 31500 tablet_copy_client.cc:670] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:36.303021 31500 tablet_copy_client.cc:538] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:36.304215 31500 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Bootstrap starting.
I20260812 06:36:36.386816 28948 cluster_itest_util.cc:258] Not converged past 1 yet: 2.296 2.296 2.296 <uninitialized op> 2.296
I20260812 06:36:36.462771 31500 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Bootstrap replayed 1/1 log segments. Stats: ops{read=296 overwritten=0 applied=296 ignored=0} inserts{seen=294 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:36.463120 31500 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Bootstrap complete.
I20260812 06:36:36.463337 31500 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Time spent bootstrapping tablet: real 0.159s	user 0.146s	sys 0.012s
I20260812 06:36:36.463868 31500 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:36.463985 31500 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c20b7faacf4a82a17b43d1b092a372, State: Initialized, Role: FOLLOWER
I20260812 06:36:36.464130 31500 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 296, Last appended: 2.296, Last appended by leader: 296, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:36.464453 31500 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Time spent starting tablet: real 0.001s	user 0.003s	sys 0.000s
I20260812 06:36:36.465276 31012 tablet_copy_service.cc:342] P ac29ace078f54b2fa033e4d8930420ef: Request end of tablet copy session 25c20b7faacf4a82a17b43d1b092a372-e7b1501f9d8a4fe8a778c44fc46d3c02 received from {username='slave'} at 127.28.69.5:44045
I20260812 06:36:36.465384 31012 tablet_copy_service.cc:434] P ac29ace078f54b2fa033e4d8930420ef: ending tablet copy session 25c20b7faacf4a82a17b43d1b092a372-e7b1501f9d8a4fe8a778c44fc46d3c02 on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with peer 25c20b7faacf4a82a17b43d1b092a372
I20260812 06:36:36.709669 31197 raft_consensus.cc:1217] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.294->[2.295-2.296]   Dedup: 2.296->[]
I20260812 06:36:36.790864 28948 tablet_copy-itest.cc:761] Iteration 2
I20260812 06:36:36.906612 28948 tablet_copy-itest.cc:780] Tombstoning follower tablet e7b1501f9d8a4fe8a778c44fc46d3c02 on TS 25c20b7faacf4a82a17b43d1b092a372
I20260812 06:36:36.907078 31157 tablet_service.cc:1558] Processing DeleteTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:43186
I20260812 06:36:36.908483 31539 tablet_replica.cc:333] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: stopping tablet replica
I20260812 06:36:36.908674 31539 raft_consensus.cc:2243] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:36.908854 31539 raft_consensus.cc:2272] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 06:36:36.908864 30874 consensus_peers.cc:597] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef -> Peer 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465): Couldn't send request to peer 25c20b7faacf4a82a17b43d1b092a372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:36.911729 31539 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:36.914355 31539 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.317
I20260812 06:36:36.914441 31539 log.cc:1199] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/wal/wals/e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:37.369184 31507 consensus_queue.cc:799] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Peer 25c20b7faacf4a82a17b43d1b092a372 is lagging by at least 41 ops behind the committed index 
I20260812 06:36:37.854524 31543 ts_tablet_manager.cc:933] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Initiating tablet copy from peer ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503)
I20260812 06:36:37.854908 31543 tablet_copy_client.cc:323] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.4:33503
I20260812 06:36:37.855571 31012 tablet_copy_service.cc:140] P ac29ace078f54b2fa033e4d8930420ef: Received BeginTabletCopySession request for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer 25c20b7faacf4a82a17b43d1b092a372 ({username='slave'} at 127.28.69.5:44045)
I20260812 06:36:37.855670 31012 tablet_copy_service.cc:161] P ac29ace078f54b2fa033e4d8930420ef: Beginning new tablet copy session on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer 25c20b7faacf4a82a17b43d1b092a372 at {username='slave'} at 127.28.69.5:44045: session id = 25c20b7faacf4a82a17b43d1b092a372-e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:37.856420 31012 tablet_copy_source_session.cc:215] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:37.857199 31543 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:36:37.860443 31543 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.317
I20260812 06:36:37.860672 31543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:37.862130 31543 tablet_copy_client.cc:806] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:37.862422 31543 tablet_copy_client.cc:670] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:37.864774 28948 tablet_copy-itest.cc:790] Tombstoning leader tablet e7b1501f9d8a4fe8a778c44fc46d3c02 on TS ac29ace078f54b2fa033e4d8930420ef
I20260812 06:36:37.865054 31543 tablet_copy_client.cc:538] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:37.865967 30943 tablet_service.cc:1558] Processing DeleteTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:54110
I20260812 06:36:37.867599 31543 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Bootstrap starting.
I20260812 06:36:37.867616 31545 tablet_replica.cc:333] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: stopping tablet replica
I20260812 06:36:37.867959 31545 raft_consensus.cc:2243] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 LEADER]: Raft consensus shutting down.
I20260812 06:36:37.870448 31545 raft_consensus.cc:2272] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:37.873322 31545 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260812 06:36:37.874641 30242 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44172: Illegal state: replica 1de9128dbfcf48d99f0928035c855fb9 is not leader of this config: current role FOLLOWER
I20260812 06:36:37.875828 31545 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.532
I20260812 06:36:37.875932 31545 log.cc:1199] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/wal/wals/e7b1501f9d8a4fe8a778c44fc46d3c02
W20260812 06:36:37.888593 30685 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58094: Illegal state: replica f4d6d520e9b34951a4ea36a632e642a7 is not leader of this config: current role FOLLOWER
W20260812 06:36:37.894380 30465 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:47360: Illegal state: replica 84064db7f8d24dad92dc287e4afbf163 is not leader of this config: current role FOLLOWER
I20260812 06:36:38.186352 31543 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Bootstrap replayed 1/1 log segments. Stats: ops{read=530 overwritten=0 applied=529 ignored=0} inserts{seen=527 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:36:38.186685 31543 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Bootstrap complete.
I20260812 06:36:38.186893 31543 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Time spent bootstrapping tablet: real 0.319s	user 0.308s	sys 0.009s
I20260812 06:36:38.187297 31543 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:38.187709 31543 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c20b7faacf4a82a17b43d1b092a372, State: Initialized, Role: FOLLOWER
I20260812 06:36:38.187896 31543 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 529, Last appended: 2.530, Last appended by leader: 530, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:38.188266 31543 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372: Time spent starting tablet: real 0.001s	user 0.003s	sys 0.000s
I20260812 06:36:38.188892 31012 tablet_copy_service.cc:342] P ac29ace078f54b2fa033e4d8930420ef: Request end of tablet copy session 25c20b7faacf4a82a17b43d1b092a372-e7b1501f9d8a4fe8a778c44fc46d3c02 received from {username='slave'} at 127.28.69.5:44045
I20260812 06:36:38.188992 31012 tablet_copy_service.cc:434] P ac29ace078f54b2fa033e4d8930420ef: ending tablet copy session 25c20b7faacf4a82a17b43d1b092a372-e7b1501f9d8a4fe8a778c44fc46d3c02 on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with peer 25c20b7faacf4a82a17b43d1b092a372
I20260812 06:36:39.368146 31552 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac29ace078f54b2fa033e4d8930420ef)
I20260812 06:36:39.368295 31552 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:39.368851 31553 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ac29ace078f54b2fa033e4d8930420ef)
I20260812 06:36:39.368968 31553 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:39.369257 31552 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697)
I20260812 06:36:39.369364 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9" is_pre_election: true
I20260812 06:36:39.369531 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 2.
I20260812 06:36:39.369834 31197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372" is_pre_election: true
I20260812 06:36:39.369982 31197 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 2.
I20260812 06:36:39.370182 30755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7" is_pre_election: true
I20260812 06:36:39.370234 30982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef" is_pre_election: true
I20260812 06:36:39.370312 30755 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 2.
I20260812 06:36:39.370417 31553 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:39.370381 30982 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.532
I20260812 06:36:39.370488 30982 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 2.
I20260812 06:36:39.370229 30983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef" is_pre_election: true
I20260812 06:36:39.370712 30983 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.532
I20260812 06:36:39.370766 30983 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4d6d520e9b34951a4ea36a632e642a7 in term 2.
I20260812 06:36:39.371225 31197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372" is_pre_election: true
I20260812 06:36:39.371251 30416 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 25c20b7faacf4a82a17b43d1b092a372, 84064db7f8d24dad92dc287e4afbf163, f4d6d520e9b34951a4ea36a632e642a7; no voters: 
I20260812 06:36:39.371313 30531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163" is_pre_election: true
I20260812 06:36:39.371357 31197 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4d6d520e9b34951a4ea36a632e642a7 in term 2.
I20260812 06:36:39.371428 30531 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4d6d520e9b34951a4ea36a632e642a7 in term 2.
I20260812 06:36:39.371531 31552 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 06:36:39.371665 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9" is_pre_election: true
I20260812 06:36:39.371706 31552 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac29ace078f54b2fa033e4d8930420ef)
I20260812 06:36:39.371764 31552 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:36:39.371768 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4d6d520e9b34951a4ea36a632e642a7 in term 2.
I20260812 06:36:39.371976 30646 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 25c20b7faacf4a82a17b43d1b092a372, ac29ace078f54b2fa033e4d8930420ef, f4d6d520e9b34951a4ea36a632e642a7; no voters: 
I20260812 06:36:39.372291 31553 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 06:36:39.372351 31553 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ac29ace078f54b2fa033e4d8930420ef)
I20260812 06:36:39.372391 31553 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:36:39.372903 31552 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:39.373438 31552 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [CANDIDATE]: Term 3 election: Requested vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697)
I20260812 06:36:39.373746 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9"
I20260812 06:36:39.373854 30304 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:36:39.373893 30983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef"
I20260812 06:36:39.373888 31197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372"
I20260812 06:36:39.373973 30983 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.532
I20260812 06:36:39.373994 31197 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:36:39.374024 30983 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:36:39.374854 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 3.
I20260812 06:36:39.374953 30983 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 3.
I20260812 06:36:39.374953 31197 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84064db7f8d24dad92dc287e4afbf163 in term 3.
I20260812 06:36:39.375095 30755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "84064db7f8d24dad92dc287e4afbf163" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7"
I20260812 06:36:39.375352 30416 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1de9128dbfcf48d99f0928035c855fb9, 84064db7f8d24dad92dc287e4afbf163, ac29ace078f54b2fa033e4d8930420ef; no voters: 
I20260812 06:36:39.375310 31553 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:39.375514 31552 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:36:39.375577 30755 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 84064db7f8d24dad92dc287e4afbf163 in current term 3: Already voted for candidate f4d6d520e9b34951a4ea36a632e642a7 in this term.
I20260812 06:36:39.376022 31553 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [CANDIDATE]: Term 3 election: Requested vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:39.375682 31552 raft_consensus.cc:697] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 LEADER]: Becoming Leader. State: Replica: 84064db7f8d24dad92dc287e4afbf163, State: Running, Role: LEADER
I20260812 06:36:39.376356 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9"
I20260812 06:36:39.376403 30531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163"
I20260812 06:36:39.376399 31197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372"
I20260812 06:36:39.376499 30304 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4d6d520e9b34951a4ea36a632e642a7 in current term 3: Already voted for candidate 84064db7f8d24dad92dc287e4afbf163 in this term.
I20260812 06:36:39.376546 31197 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4d6d520e9b34951a4ea36a632e642a7 in current term 3: Already voted for candidate 84064db7f8d24dad92dc287e4afbf163 in this term.
I20260812 06:36:39.376699 31552 consensus_queue.cc:237] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 531, Committed index: 531, Last appended: 2.532, Last appended by leader: 532, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:39.376994 30646 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: f4d6d520e9b34951a4ea36a632e642a7; no voters: 1de9128dbfcf48d99f0928035c855fb9, 25c20b7faacf4a82a17b43d1b092a372, 84064db7f8d24dad92dc287e4afbf163
I20260812 06:36:39.377066 30983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "f4d6d520e9b34951a4ea36a632e642a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 532 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef"
I20260812 06:36:39.377168 30983 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 2.532
I20260812 06:36:39.377264 30983 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4d6d520e9b34951a4ea36a632e642a7 in current term 3: Already voted for candidate 84064db7f8d24dad92dc287e4afbf163 in this term.
I20260812 06:36:39.378166 31553 raft_consensus.cc:2749] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 06:36:39.379735 30076 catalog_manager.cc:5719] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 reported cstate change: term changed from 2 to 3, leader changed from ac29ace078f54b2fa033e4d8930420ef (127.28.69.4) to 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2). New cstate: current_term: 3 leader_uuid: "84064db7f8d24dad92dc287e4afbf163" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } health_report { overall_health: HEALTHY } } }
I20260812 06:36:39.386873 31197 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 3 FOLLOWER]: Refusing update from remote peer 84064db7f8d24dad92dc287e4afbf163: Log matching property violated. Preceding OpId in replica: term: 2 index: 530. Preceding OpId from leader: term: 3 index: 534. (index mismatch)
I20260812 06:36:39.386865 30304 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 3 FOLLOWER]: Refusing update from remote peer 84064db7f8d24dad92dc287e4afbf163: Log matching property violated. Preceding OpId in replica: term: 2 index: 532. Preceding OpId from leader: term: 3 index: 534. (index mismatch)
I20260812 06:36:39.387039 30755 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Refusing update from remote peer 84064db7f8d24dad92dc287e4afbf163: Log matching property violated. Preceding OpId in replica: term: 2 index: 532. Preceding OpId from leader: term: 3 index: 534. (index mismatch)
I20260812 06:36:39.387436 31552 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 533, Last known committed idx: 532, Time since last communication: 0.000s
W20260812 06:36:39.387607 30416 consensus_peers.cc:597] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 -> Peer ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503): Couldn't send request to peer ac29ace078f54b2fa033e4d8930420ef. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:39.387611 31554 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 533, Last known committed idx: 529, Time since last communication: 0.000s
I20260812 06:36:39.387773 31575 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 533, Last known committed idx: 532, Time since last communication: 0.000s
I20260812 06:36:39.401043 28948 cluster_itest_util.cc:258] Not converged past 1 yet: 3.534 3.534 3.534 3.534 <uninitialized op>
I20260812 06:36:39.505482 28948 cluster_itest_util.cc:258] Not converged past 1 yet: 3.534 3.534 3.534 3.534 <uninitialized op>
I20260812 06:36:39.710178 28948 cluster_itest_util.cc:258] Not converged past 1 yet: 3.534 3.534 3.534 3.534 <uninitialized op>
I20260812 06:36:39.791790 31601 ts_tablet_manager.cc:933] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Initiating tablet copy from peer 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:39.792389 31601 tablet_copy_client.cc:323] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.2:36327
I20260812 06:36:39.793285 30566 tablet_copy_service.cc:140] P 84064db7f8d24dad92dc287e4afbf163: Received BeginTabletCopySession request for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer ac29ace078f54b2fa033e4d8930420ef ({username='slave'} at 127.28.69.4:34811)
I20260812 06:36:39.793437 30566 tablet_copy_service.cc:161] P 84064db7f8d24dad92dc287e4afbf163: Beginning new tablet copy session on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer ac29ace078f54b2fa033e4d8930420ef at {username='slave'} at 127.28.69.4:34811: session id = ac29ace078f54b2fa033e4d8930420ef-e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:39.794852 30566 tablet_copy_source_session.cc:215] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:39.796036 31601 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:36:39.797884 31601 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.532
I20260812 06:36:39.798079 31601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:39.799064 31601 tablet_copy_client.cc:806] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:39.799234 31601 tablet_copy_client.cc:670] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:39.801550 31601 tablet_copy_client.cc:538] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:39.802820 31601 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Bootstrap starting.
I20260812 06:36:40.014779 28948 cluster_itest_util.cc:258] Not converged past 1 yet: 3.534 3.534 3.534 3.534 <uninitialized op>
I20260812 06:36:40.088985 31601 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=534 overwritten=0 applied=534 ignored=0} inserts{seen=531 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:40.089365 31601 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Bootstrap complete.
I20260812 06:36:40.089607 31601 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Time spent bootstrapping tablet: real 0.287s	user 0.267s	sys 0.020s
I20260812 06:36:40.090173 31601 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:40.090291 31601 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac29ace078f54b2fa033e4d8930420ef, State: Initialized, Role: FOLLOWER
I20260812 06:36:40.090436 31601 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 534, Last appended: 3.534, Last appended by leader: 534, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:40.090778 31601 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:36:40.091605 30566 tablet_copy_service.cc:342] P 84064db7f8d24dad92dc287e4afbf163: Request end of tablet copy session ac29ace078f54b2fa033e4d8930420ef-e7b1501f9d8a4fe8a778c44fc46d3c02 received from {username='slave'} at 127.28.69.4:34811
I20260812 06:36:40.091745 30566 tablet_copy_service.cc:434] P 84064db7f8d24dad92dc287e4afbf163: ending tablet copy session ac29ace078f54b2fa033e4d8930420ef-e7b1501f9d8a4fe8a778c44fc46d3c02 on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with peer ac29ace078f54b2fa033e4d8930420ef
I20260812 06:36:40.415449 30983 raft_consensus.cc:1217] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Deduplicated request from leader. Original: 2.532->[3.533-3.534]   Dedup: 3.534->[]
I20260812 06:36:40.419220 28948 tablet_copy-itest.cc:761] Iteration 3
I20260812 06:36:40.531682 28948 tablet_copy-itest.cc:780] Tombstoning follower tablet e7b1501f9d8a4fe8a778c44fc46d3c02 on TS f4d6d520e9b34951a4ea36a632e642a7
I20260812 06:36:40.532346 30722 tablet_service.cc:1558] Processing DeleteTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:58084
I20260812 06:36:40.532864 31639 tablet_replica.cc:333] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: stopping tablet replica
I20260812 06:36:40.533224 31639 raft_consensus.cc:2243] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:40.533483 31639 raft_consensus.cc:2272] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260812 06:36:40.536626 30416 consensus_peers.cc:597] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 -> Peer f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697): Couldn't send request to peer f4d6d520e9b34951a4ea36a632e642a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:40.537071 31639 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:40.541632 31639 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.555
I20260812 06:36:40.541805 31639 log.cc:1199] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/wal/wals/e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:41.096336 31599 consensus_queue.cc:799] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [LEADER]: Peer f4d6d520e9b34951a4ea36a632e642a7 is lagging by at least 63 ops behind the committed index 
I20260812 06:36:41.630554 31640 ts_tablet_manager.cc:933] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Initiating tablet copy from peer 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:41.631253 31640 tablet_copy_client.cc:323] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.2:36327
I20260812 06:36:41.632637 30566 tablet_copy_service.cc:140] P 84064db7f8d24dad92dc287e4afbf163: Received BeginTabletCopySession request for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer f4d6d520e9b34951a4ea36a632e642a7 ({username='slave'} at 127.28.69.3:42577)
I20260812 06:36:41.632755 30566 tablet_copy_service.cc:161] P 84064db7f8d24dad92dc287e4afbf163: Beginning new tablet copy session on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer f4d6d520e9b34951a4ea36a632e642a7 at {username='slave'} at 127.28.69.3:42577: session id = f4d6d520e9b34951a4ea36a632e642a7-e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:41.633939 30566 tablet_copy_source_session.cc:215] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:41.636395 31640 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:36:41.639515 31640 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 3.555
I20260812 06:36:41.639732 31640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:41.641664 31640 tablet_copy_client.cc:806] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:41.641934 31640 tablet_copy_client.cc:670] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:41.641955 28948 tablet_copy-itest.cc:790] Tombstoning leader tablet e7b1501f9d8a4fe8a778c44fc46d3c02 on TS 84064db7f8d24dad92dc287e4afbf163
I20260812 06:36:41.643728 30498 tablet_service.cc:1558] Processing DeleteTablet for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47346
I20260812 06:36:41.644241 31644 tablet_replica.cc:333] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: stopping tablet replica
I20260812 06:36:41.644582 31644 raft_consensus.cc:2243] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 LEADER]: Raft consensus shutting down.
W20260812 06:36:41.644842 31599 consensus_queue.cc:1175] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1de9128dbfcf48d99f0928035c855fb9" responder_term: 3 status { last_received { term: 3 index: 799 } last_committed_idx: 799 last_received_current_leader { term: 3 index: 799 } }
I20260812 06:36:41.645277 31640 tablet_copy_client.cc:538] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:41.646000 31644 raft_consensus.cc:2272] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:41.646675 31640 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Bootstrap starting.
I20260812 06:36:41.648919 31644 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:36:41.650710 31644 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.799
I20260812 06:36:41.650801 31644 log.cc:1199] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/wal/wals/e7b1501f9d8a4fe8a778c44fc46d3c02
W20260812 06:36:41.651131 30242 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:44172: Illegal state: replica 1de9128dbfcf48d99f0928035c855fb9 is not leader of this config: current role FOLLOWER
W20260812 06:36:41.655587 30909 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54118: Illegal state: replica ac29ace078f54b2fa033e4d8930420ef is not leader of this config: current role FOLLOWER
W20260812 06:36:41.659996 31131 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43190: Illegal state: replica 25c20b7faacf4a82a17b43d1b092a372 is not leader of this config: current role FOLLOWER
I20260812 06:36:42.094810 31640 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=797 overwritten=0 applied=797 ignored=0} inserts{seen=794 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:42.095110 31640 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Bootstrap complete.
I20260812 06:36:42.095359 31640 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Time spent bootstrapping tablet: real 0.449s	user 0.415s	sys 0.032s
I20260812 06:36:42.095920 31640 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:42.096038 31640 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4d6d520e9b34951a4ea36a632e642a7, State: Initialized, Role: FOLLOWER
I20260812 06:36:42.096202 31640 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 797, Last appended: 3.797, Last appended by leader: 797, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:42.096549 31640 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7: Time spent starting tablet: real 0.001s	user 0.003s	sys 0.000s
I20260812 06:36:42.097345 30566 tablet_copy_service.cc:342] P 84064db7f8d24dad92dc287e4afbf163: Request end of tablet copy session f4d6d520e9b34951a4ea36a632e642a7-e7b1501f9d8a4fe8a778c44fc46d3c02 received from {username='slave'} at 127.28.69.3:42577
I20260812 06:36:42.097451 30566 tablet_copy_service.cc:434] P 84064db7f8d24dad92dc287e4afbf163: ending tablet copy session f4d6d520e9b34951a4ea36a632e642a7-e7b1501f9d8a4fe8a778c44fc46d3c02 on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with peer f4d6d520e9b34951a4ea36a632e642a7
I20260812 06:36:43.142062 31650 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 84064db7f8d24dad92dc287e4afbf163)
I20260812 06:36:43.142234 31650 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:43.142823 31650 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:43.143362 30531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163" is_pre_election: true
I20260812 06:36:43.143384 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9" is_pre_election: true
I20260812 06:36:43.143369 30755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7" is_pre_election: true
I20260812 06:36:43.143524 30755 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 3.
I20260812 06:36:43.143515 30531 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 3.799
I20260812 06:36:43.143532 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372" is_pre_election: true
I20260812 06:36:43.143626 30531 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 3.
I20260812 06:36:43.143659 31199 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 3.
I20260812 06:36:43.143952 30874 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 84064db7f8d24dad92dc287e4afbf163, ac29ace078f54b2fa033e4d8930420ef, f4d6d520e9b34951a4ea36a632e642a7; no voters: 
I20260812 06:36:43.144124 31650 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 06:36:43.144189 31650 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Starting leader election (detected failure of leader 84064db7f8d24dad92dc287e4afbf163)
I20260812 06:36:43.144235 31650 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:36:43.145164 31650 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:43.145320 31652 raft_consensus.cc:493] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 84064db7f8d24dad92dc287e4afbf163)
I20260812 06:36:43.145429 31652 raft_consensus.cc:515] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:43.145648 31650 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [CANDIDATE]: Term 4 election: Requested vote from peers 1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:43.146015 30531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163"
I20260812 06:36:43.146023 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372"
I20260812 06:36:43.146124 31199 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:36:43.146114 30531 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 FOLLOWER]: voting while tombstoned based on last-logged opid 3.799
I20260812 06:36:43.146173 30531 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:36:43.146148 30755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7"
I20260812 06:36:43.146245 30755 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:36:43.147156 30755 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 4.
I20260812 06:36:43.147156 30531 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 4.
I20260812 06:36:43.147223 31199 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 4.
I20260812 06:36:43.147614 30874 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 84064db7f8d24dad92dc287e4afbf163, ac29ace078f54b2fa033e4d8930420ef, f4d6d520e9b34951a4ea36a632e642a7; no voters: 
I20260812 06:36:43.147809 31650 raft_consensus.cc:2804] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 4 FOLLOWER]: Leader election won for term 4
I20260812 06:36:43.147840 30304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "ac29ace078f54b2fa033e4d8930420ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "1de9128dbfcf48d99f0928035c855fb9"
I20260812 06:36:43.147964 30304 raft_consensus.cc:3060] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:36:43.147996 31650 raft_consensus.cc:697] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [term 4 LEADER]: Becoming Leader. State: Replica: ac29ace078f54b2fa033e4d8930420ef, State: Running, Role: LEADER
I20260812 06:36:43.148150 31650 consensus_queue.cc:237] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 798, Committed index: 798, Last appended: 3.799, Last appended by leader: 799, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:43.148442 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "1de9128dbfcf48d99f0928035c855fb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "25c20b7faacf4a82a17b43d1b092a372" is_pre_election: true
I20260812 06:36:43.148556 31199 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de9128dbfcf48d99f0928035c855fb9 in current term 4: Already voted for candidate ac29ace078f54b2fa033e4d8930420ef in this term.
I20260812 06:36:43.148965 30304 raft_consensus.cc:2468] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac29ace078f54b2fa033e4d8930420ef in term 4.
I20260812 06:36:43.147840 31652 leader_election.cc:290] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503), 25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465), f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697), 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327)
I20260812 06:36:43.150663 30077 catalog_manager.cc:5719] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef reported cstate change: term changed from 3 to 4, leader changed from 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2) to ac29ace078f54b2fa033e4d8930420ef (127.28.69.4). New cstate: current_term: 4 leader_uuid: "ac29ace078f54b2fa033e4d8930420ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:43.152287 30983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "1de9128dbfcf48d99f0928035c855fb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "ac29ace078f54b2fa033e4d8930420ef" is_pre_election: true
I20260812 06:36:43.153371 30755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "1de9128dbfcf48d99f0928035c855fb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "f4d6d520e9b34951a4ea36a632e642a7" is_pre_election: true
I20260812 06:36:43.153537 30755 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de9128dbfcf48d99f0928035c855fb9 in current term 4: Already voted for candidate ac29ace078f54b2fa033e4d8930420ef in this term.
I20260812 06:36:43.153867 30201 leader_election.cc:304] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 1de9128dbfcf48d99f0928035c855fb9; no voters: 25c20b7faacf4a82a17b43d1b092a372, ac29ace078f54b2fa033e4d8930420ef, f4d6d520e9b34951a4ea36a632e642a7
I20260812 06:36:43.154116 31652 raft_consensus.cc:2749] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 06:36:43.154935 30531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b1501f9d8a4fe8a778c44fc46d3c02" candidate_uuid: "1de9128dbfcf48d99f0928035c855fb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 799 } } ignore_live_leader: false dest_uuid: "84064db7f8d24dad92dc287e4afbf163" is_pre_election: true
I20260812 06:36:43.155036 30531 raft_consensus.cc:1803] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 4 FOLLOWER]: voting while tombstoned based on last-logged opid 3.799
I20260812 06:36:43.155125 30531 raft_consensus.cc:2393] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1de9128dbfcf48d99f0928035c855fb9 in current term 4: Already voted for candidate ac29ace078f54b2fa033e4d8930420ef in this term.
I20260812 06:36:43.158049 30755 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P f4d6d520e9b34951a4ea36a632e642a7 [term 4 FOLLOWER]: Refusing update from remote peer ac29ace078f54b2fa033e4d8930420ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 797. Preceding OpId from leader: term: 4 index: 801. (index mismatch)
I20260812 06:36:43.158069 30304 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 1de9128dbfcf48d99f0928035c855fb9 [term 4 FOLLOWER]: Refusing update from remote peer ac29ace078f54b2fa033e4d8930420ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 799. Preceding OpId from leader: term: 4 index: 801. (index mismatch)
I20260812 06:36:43.158146 31199 raft_consensus.cc:1275] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 25c20b7faacf4a82a17b43d1b092a372 [term 4 FOLLOWER]: Refusing update from remote peer ac29ace078f54b2fa033e4d8930420ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 799. Preceding OpId from leader: term: 4 index: 801. (index mismatch)
W20260812 06:36:43.158368 30874 consensus_peers.cc:597] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef -> Peer 84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327): Couldn't send request to peer 84064db7f8d24dad92dc287e4afbf163. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:43.158499 31679 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 800, Last known committed idx: 797, Time since last communication: 0.000s
I20260812 06:36:43.158655 31680 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 800, Last known committed idx: 799, Time since last communication: 0.000s
I20260812 06:36:43.158833 31650 consensus_queue.cc:1048] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 800, Last known committed idx: 799, Time since last communication: 0.000s
I20260812 06:36:43.162833 31685 mvcc.cc:204] Tried to move back new op lower bound from 7317572006530920448 to 7317572006497746944. Current Snapshot: MvccSnapshot[applied={T|T < 7317572000292470784}]
I20260812 06:36:43.169440 28948 cluster_itest_util.cc:258] Not converged past 1 yet: <uninitialized op> 4.801 4.801 4.801 4.801
I20260812 06:36:43.273874 28948 cluster_itest_util.cc:258] Not converged past 1 yet: <uninitialized op> 4.801 4.801 4.801 4.801
I20260812 06:36:43.478044 28948 cluster_itest_util.cc:258] Not converged past 1 yet: <uninitialized op> 4.801 4.801 4.801 4.801
I20260812 06:36:43.571424 31707 ts_tablet_manager.cc:933] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Initiating tablet copy from peer ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503)
I20260812 06:36:43.572083 31707 tablet_copy_client.cc:323] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.4:33503
I20260812 06:36:43.572717 31012 tablet_copy_service.cc:140] P ac29ace078f54b2fa033e4d8930420ef: Received BeginTabletCopySession request for tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer 84064db7f8d24dad92dc287e4afbf163 ({username='slave'} at 127.28.69.2:46875)
I20260812 06:36:43.572835 31012 tablet_copy_service.cc:161] P ac29ace078f54b2fa033e4d8930420ef: Beginning new tablet copy session on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 from peer 84064db7f8d24dad92dc287e4afbf163 at {username='slave'} at 127.28.69.2:46875: session id = 84064db7f8d24dad92dc287e4afbf163-e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:43.573621 31012 tablet_copy_source_session.cc:215] T e7b1501f9d8a4fe8a778c44fc46d3c02 P ac29ace078f54b2fa033e4d8930420ef: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:43.574604 31707 ts_tablet_manager.cc:1916] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:36:43.576447 31707 ts_tablet_manager.cc:1929] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 3.799
I20260812 06:36:43.576625 31707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b1501f9d8a4fe8a778c44fc46d3c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:43.577780 31707 tablet_copy_client.cc:806] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:43.577991 31707 tablet_copy_client.cc:670] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:43.581248 31707 tablet_copy_client.cc:538] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:43.582608 31707 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Bootstrap starting.
I20260812 06:36:43.782330 28948 cluster_itest_util.cc:258] Not converged past 1 yet: <uninitialized op> 4.801 4.801 4.801 4.801
I20260812 06:36:44.005043 31707 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Bootstrap replayed 1/1 log segments. Stats: ops{read=801 overwritten=0 applied=801 ignored=0} inserts{seen=797 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:44.005373 31707 tablet_bootstrap.cc:492] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Bootstrap complete.
I20260812 06:36:44.005616 31707 ts_tablet_manager.cc:1403] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Time spent bootstrapping tablet: real 0.423s	user 0.367s	sys 0.056s
I20260812 06:36:44.006157 31707 raft_consensus.cc:359] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:44.006273 31707 raft_consensus.cc:740] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84064db7f8d24dad92dc287e4afbf163, State: Initialized, Role: FOLLOWER
I20260812 06:36:44.006419 31707 consensus_queue.cc:260] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 801, Last appended: 4.801, Last appended by leader: 801, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de9128dbfcf48d99f0928035c855fb9" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 43171 } } peers { permanent_uuid: "ac29ace078f54b2fa033e4d8930420ef" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 33503 } } peers { permanent_uuid: "25c20b7faacf4a82a17b43d1b092a372" member_type: VOTER last_known_addr { host: "127.28.69.5" port: 41465 } } peers { permanent_uuid: "f4d6d520e9b34951a4ea36a632e642a7" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 35697 } } peers { permanent_uuid: "84064db7f8d24dad92dc287e4afbf163" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 36327 } }
I20260812 06:36:44.006793 31707 ts_tablet_manager.cc:1434] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:36:44.007380 31012 tablet_copy_service.cc:342] P ac29ace078f54b2fa033e4d8930420ef: Request end of tablet copy session 84064db7f8d24dad92dc287e4afbf163-e7b1501f9d8a4fe8a778c44fc46d3c02 received from {username='slave'} at 127.28.69.2:46875
I20260812 06:36:44.007486 31012 tablet_copy_service.cc:434] P ac29ace078f54b2fa033e4d8930420ef: ending tablet copy session 84064db7f8d24dad92dc287e4afbf163-e7b1501f9d8a4fe8a778c44fc46d3c02 on tablet e7b1501f9d8a4fe8a778c44fc46d3c02 with peer 84064db7f8d24dad92dc287e4afbf163
I20260812 06:36:44.249782 30943 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 06:36:44.249969 31157 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:44.250080 30271 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:44.250090 30498 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:44.258174 30722 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 370c690e4382415b9db12cd6bd98448a | 127.28.69.62:33085 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                       Value                                                                                       |      Tags       |         Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:35141 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 1de9128dbfcf48d99f0928035c855fb9 | 127.28.69.1:43171 | HEALTHY | <none>   |       0        |       0
 25c20b7faacf4a82a17b43d1b092a372 | 127.28.69.5:41465 | HEALTHY | <none>   |       0        |       0
 84064db7f8d24dad92dc287e4afbf163 | 127.28.69.2:36327 | HEALTHY | <none>   |       0        |       0
 ac29ace078f54b2fa033e4d8930420ef | 127.28.69.4:33503 | HEALTHY | <none>   |       1        |       0
 f4d6d520e9b34951a4ea36a632e642a7 | 127.28.69.3:35697 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       5

Unusual flags for Tablet Server:
               Flag               |                                                                                     Value                                                                                     |      Tags       |      Tablet Server
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_server_key_size             | 768                                                                                                                                                                           | experimental    | all 5 server(s) checked
 local_ip_for_outbound_sockets    | 127.28.69.1                                                                                                                                                                   | experimental    | 127.28.69.1:43171
 local_ip_for_outbound_sockets    | 127.28.69.2                                                                                                                                                                   | experimental    | 127.28.69.2:36327
 local_ip_for_outbound_sockets    | 127.28.69.3                                                                                                                                                                   | experimental    | 127.28.69.3:35697
 local_ip_for_outbound_sockets    | 127.28.69.4                                                                                                                                                                   | experimental    | 127.28.69.4:33503
 local_ip_for_outbound_sockets    | 127.28.69.5                                                                                                                                                                   | experimental    | 127.28.69.5:41465
 never_fsync                      | true                                                                                                                                                                          | unsafe,advanced | all 5 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                             | unsafe,hidden   | all 5 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                          | unsafe          | all 5 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                            | hidden          | all 5 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.28.69.1:43171
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.28.69.2:36327
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.28.69.3:35697
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb | hidden          | 127.28.69.4:33503
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data/info.pb | hidden          | 127.28.69.5:41465

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:35141 | all 5 server(s) checked
 time_source         | builtin            | all 5 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 6 server(s) checked

Tablet Summary
Tablet e7b1501f9d8a4fe8a778c44fc46d3c02 of table 'test-workload' is conflicted: 1 replicas' active configs disagree with the leader master's
  1de9128dbfcf48d99f0928035c855fb9 (127.28.69.1:43171): RUNNING
  ac29ace078f54b2fa033e4d8930420ef (127.28.69.4:33503): RUNNING [LEADER]
  25c20b7faacf4a82a17b43d1b092a372 (127.28.69.5:41465): RUNNING
  f4d6d520e9b34951a4ea36a632e642a7 (127.28.69.3:35697): RUNNING
  84064db7f8d24dad92dc287e4afbf163 (127.28.69.2:36327): RUNNING
All reported replicas are:
  A = 1de9128dbfcf48d99f0928035c855fb9
  B = ac29ace078f54b2fa033e4d8930420ef
  C = 25c20b7faacf4a82a17b43d1b092a372
  D = f4d6d520e9b34951a4ea36a632e642a7
  E = 84064db7f8d24dad92dc287e4afbf163
The consensus matrix is:
 Config source |       Replicas       | Current term | Config index | Committed?
---------------+----------------------+--------------+--------------+------------
 master        | A   B*  C   D   E    |              |              | Yes
 A             | A   B*  C   D   E    | 4            | -1           | Yes
 B             | A   B*  C   D   E    | 4            | -1           | Yes
 C             | A   B*  C   D   E    | 4            | -1           | Yes
 D             | A   B*  C   D   E    | 4            | -1           | Yes
 E             | A   B   C   D   E    | 4            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 5  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 5
 Tables         | 1
 Tablets        | 1
 Replicas       | 5

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 06:36:44.290875 28948 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:36:44.422987 30531 raft_consensus.cc:1217] T e7b1501f9d8a4fe8a778c44fc46d3c02 P 84064db7f8d24dad92dc287e4afbf163 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 3.799->[4.800-4.801]   Dedup: 4.801->[]
I20260812 06:36:44.495111 30943 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 06:36:44.495642 31157 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:44.495666 30271 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:44.495992 30498 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:36:44.505935 30722 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 370c690e4382415b9db12cd6bd98448a | 127.28.69.62:33085 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                       Value                                                                                       |      Tags       |         Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:35141 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 1de9128dbfcf48d99f0928035c855fb9 | 127.28.69.1:43171 | HEALTHY | <none>   |       0        |       0
 25c20b7faacf4a82a17b43d1b092a372 | 127.28.69.5:41465 | HEALTHY | <none>   |       0        |       0
 84064db7f8d24dad92dc287e4afbf163 | 127.28.69.2:36327 | HEALTHY | <none>   |       0        |       0
 ac29ace078f54b2fa033e4d8930420ef | 127.28.69.4:33503 | HEALTHY | <none>   |       1        |       0
 f4d6d520e9b34951a4ea36a632e642a7 | 127.28.69.3:35697 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       5

Unusual flags for Tablet Server:
               Flag               |                                                                                     Value                                                                                     |      Tags       |      Tablet Server
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_server_key_size             | 768                                                                                                                                                                           | experimental    | all 5 server(s) checked
 local_ip_for_outbound_sockets    | 127.28.69.1                                                                                                                                                                   | experimental    | 127.28.69.1:43171
 local_ip_for_outbound_sockets    | 127.28.69.2                                                                                                                                                                   | experimental    | 127.28.69.2:36327
 local_ip_for_outbound_sockets    | 127.28.69.3                                                                                                                                                                   | experimental    | 127.28.69.3:35697
 local_ip_for_outbound_sockets    | 127.28.69.4                                                                                                                                                                   | experimental    | 127.28.69.4:33503
 local_ip_for_outbound_sockets    | 127.28.69.5                                                                                                                                                                   | experimental    | 127.28.69.5:41465
 never_fsync                      | true                                                                                                                                                                          | unsafe,advanced | all 5 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                             | unsafe,hidden   | all 5 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                          | unsafe          | all 5 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                            | hidden          | all 5 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.28.69.1:43171
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.28.69.2:36327
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.28.69.3:35697
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb | hidden          | 127.28.69.4:33503
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest.1786516573877167-28948-0/minicluster-data/ts-4/data/info.pb | hidden          | 127.28.69.5:41465

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:35141 | all 5 server(s) checked
 time_source         | builtin            | all 5 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 6 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 5  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 5
 Tables         | 1
 Tablets        | 1
 Replicas       | 5

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 06:36:44.534788 28948 log_verifier.cc:126] Checking tablet e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:44.875975 28948 log_verifier.cc:177] Verified matching terms for 801 ops in tablet e7b1501f9d8a4fe8a778c44fc46d3c02
I20260812 06:36:44.915686 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 30172
I20260812 06:36:44.935921 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 30384
I20260812 06:36:44.953430 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 30616
I20260812 06:36:45.001381 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 30837
I20260812 06:36:45.015534 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 31052
I20260812 06:36:45.029270 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 30024
2026-08-12T06:36:45Z chronyd exiting
[       OK ] TabletCopyITest.TestDeleteLeaderDuringTabletCopyStressTest (13353 ms)
[ RUN      ] TabletCopyITest.TestTabletCopyThrottling
2026-08-12T06:36:45Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:45Z Disabled control of system clock
I20260812 06:36:45.074084 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:42535
--webserver_interface=127.28.69.62
--webserver_port=0
--builtin_ntp_servers=127.28.69.20:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:42535
--master_tombstone_evicted_tablet_replicas=false with env {}
W20260812 06:36:45.177400 31830 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:45.177649 31830 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:45.177692 31830 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:45.180896 31830 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:45.180955 31830 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:45.180974 31830 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:45.180990 31830 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:45.184876 31830 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:42535
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:42535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.31830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:45.185954 31830 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:45.187047 31830 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:45.192332 31842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:45.192307 31841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:45.192301 31844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:45.192624 31830 server_base.cc:1061] running on GCE node
I20260812 06:36:45.193130 31830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:45.194000 31830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:45.195159 31830 hybrid_clock.cc:648] HybridClock initialized: now 1786516605195141 us; error 34 us; skew 500 ppm
I20260812 06:36:45.196872 31830 webserver.cc:533] Webserver started at http://127.28.69.62:45207/ using document root <none> and password file <none>
I20260812 06:36:45.197463 31830 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:45.197525 31830 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:45.197713 31830 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:45.199280 31830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/instance:
uuid: "fc0e76ce152f453c82fd8f955981864b"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.199743 31830 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal/instance:
uuid: "fc0e76ce152f453c82fd8f955981864b"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.203064 31830 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:45.205220 31853 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:45.206238 31830 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:45.206367 31830 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "fc0e76ce152f453c82fd8f955981864b"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.206456 31830 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:45.224875 31830 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:45.225663 31830 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:45.225850 31830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:45.233359 31830 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:42535
I20260812 06:36:45.233355 31944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:42535 every 8 connection(s)
I20260812 06:36:45.234397 31830 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:45.237254 31945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:45.239169 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 31830
I20260812 06:36:45.239301 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal/instance
I20260812 06:36:45.242873 31945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Bootstrap starting.
I20260812 06:36:45.245409 31945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:45.246218 31945 log.cc:826] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:45.248163 31945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: No bootstrap required, opened a new log
I20260812 06:36:45.251207 31945 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } }
I20260812 06:36:45.251438 31945 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:45.251519 31945 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0e76ce152f453c82fd8f955981864b, State: Initialized, Role: FOLLOWER
I20260812 06:36:45.251883 31945 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } }
I20260812 06:36:45.251989 31945 raft_consensus.cc:399] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:45.252031 31945 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:45.252104 31945 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:45.252839 31945 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } }
I20260812 06:36:45.253175 31945 leader_election.cc:304] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc0e76ce152f453c82fd8f955981864b; no voters: 
I20260812 06:36:45.253440 31945 leader_election.cc:290] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:45.253515 31952 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:45.253743 31952 raft_consensus.cc:697] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 1 LEADER]: Becoming Leader. State: Replica: fc0e76ce152f453c82fd8f955981864b, State: Running, Role: LEADER
I20260812 06:36:45.254082 31952 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } }
I20260812 06:36:45.254563 31945 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:45.255769 31953 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc0e76ce152f453c82fd8f955981864b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } } }
I20260812 06:36:45.255749 31954 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc0e76ce152f453c82fd8f955981864b. Latest consensus state: current_term: 1 leader_uuid: "fc0e76ce152f453c82fd8f955981864b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } } }
I20260812 06:36:45.255889 31953 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:45.255889 31954 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:45.256623 31965 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:45.259646 31965 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:45.264936 31965 catalog_manager.cc:1383] Generated new cluster ID: 36ba9a510bc04fa68751eb6e68939a93
I20260812 06:36:45.265039 31965 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:45.274231 31965 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:45.275022 31965 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:45.281718 31965 catalog_manager.cc:6092] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Generated new TSK 0
I20260812 06:36:45.282349 31965 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:45.285159 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.1:0
--local_ip_for_outbound_sockets=127.28.69.1
--webserver_interface=127.28.69.1
--webserver_port=0
--tserver_master_addrs=127.28.69.62:42535
--builtin_ntp_servers=127.28.69.20:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=1 with env {}
W20260812 06:36:45.388664 31983 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:45.388877 31983 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:45.388942 31983 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:45.392374 31983 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:45.392591 31983 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.1
I20260812 06:36:45.396533 31983 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.69.1
--webserver_port=0
--tserver_master_addrs=127.28.69.62:42535
--num_tablets_to_copy_simultaneously=1
--never_fsync=true
--heap_profile_path=/tmp/kudu.31983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:45.397644 31983 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:45.398754 31983 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:45.405104 31989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:45.405233 31983 server_base.cc:1061] running on GCE node
W20260812 06:36:45.405121 31998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:45.405404 31990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:45.405758 31983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:45.406266 31983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:45.407447 31983 hybrid_clock.cc:648] HybridClock initialized: now 1786516605407431 us; error 32 us; skew 500 ppm
I20260812 06:36:45.409157 31983 webserver.cc:533] Webserver started at http://127.28.69.1:39341/ using document root <none> and password file <none>
I20260812 06:36:45.409688 31983 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:45.409746 31983 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:45.409926 31983 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:45.411484 31983 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/data/instance:
uuid: "46ce1ace244a4185b710b63f5aae0e93"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.411916 31983 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance:
uuid: "46ce1ace244a4185b710b63f5aae0e93"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.415081 31983 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 06:36:45.417142 32005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:45.418154 31983 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:45.418273 31983 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/wal
uuid: "46ce1ace244a4185b710b63f5aae0e93"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.418358 31983 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:45.429862 31983 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:45.430428 31983 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:45.430583 31983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:45.431084 31983 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:45.432019 31983 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:45.432067 31983 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:45.432116 31983 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:45.432142 31983 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:45.440675 31983 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.1:45459
I20260812 06:36:45.440703 32200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.1:45459 every 8 connection(s)
I20260812 06:36:45.441617 31983 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:45.443115 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 31983
I20260812 06:36:45.443219 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:45.445739 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.2:0
--local_ip_for_outbound_sockets=127.28.69.2
--webserver_interface=127.28.69.2
--webserver_port=0
--tserver_master_addrs=127.28.69.62:42535
--builtin_ntp_servers=127.28.69.20:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=1 with env {}
I20260812 06:36:45.450132 32203 heartbeater.cc:344] Connected to a master server at 127.28.69.62:42535
I20260812 06:36:45.450402 32203 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:45.451017 32203 heartbeater.cc:507] Master 127.28.69.62:42535 requested a full tablet report, sending...
I20260812 06:36:45.452544 31886 ts_manager.cc:194] Registered new tserver with Master: 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1:45459)
I20260812 06:36:45.453735 31886 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.1:59909
W20260812 06:36:45.553231 32210 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:45.553438 32210 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:45.553496 32210 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:45.556802 32210 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:45.556937 32210 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.2
I20260812 06:36:45.560673 32210 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.69.2
--webserver_port=0
--tserver_master_addrs=127.28.69.62:42535
--num_tablets_to_copy_simultaneously=1
--never_fsync=true
--heap_profile_path=/tmp/kudu.32210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:45.561724 32210 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:45.562826 32210 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:45.569023 32218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:45.568995 32224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:45.568994 32216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:45.569289 32210 server_base.cc:1061] running on GCE node
I20260812 06:36:45.569634 32210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:45.570137 32210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:45.571296 32210 hybrid_clock.cc:648] HybridClock initialized: now 1786516605571287 us; error 25 us; skew 500 ppm
I20260812 06:36:45.572933 32210 webserver.cc:533] Webserver started at http://127.28.69.2:38833/ using document root <none> and password file <none>
I20260812 06:36:45.573474 32210 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:45.573531 32210 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:45.573704 32210 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:45.575114 32210 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/instance:
uuid: "d6b5bb140b02446caf7c9f44a4d2b85c"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.575562 32210 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance:
uuid: "d6b5bb140b02446caf7c9f44a4d2b85c"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.578662 32210 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:45.580644 32232 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:45.581568 32210 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:45.581669 32210 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
uuid: "d6b5bb140b02446caf7c9f44a4d2b85c"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.581748 32210 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:45.597251 32210 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:45.597867 32210 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:45.598024 32210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:45.598565 32210 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:45.599522 32210 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:45.599572 32210 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:45.599625 32210 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:45.599650 32210 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:45.608428 32210 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.2:38579
I20260812 06:36:45.608469 32416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.2:38579 every 8 connection(s)
I20260812 06:36:45.609438 32210 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:45.612535 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 32210
I20260812 06:36:45.612636 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:45.617623 32420 heartbeater.cc:344] Connected to a master server at 127.28.69.62:42535
I20260812 06:36:45.617861 32420 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:45.618353 32420 heartbeater.cc:507] Master 127.28.69.62:42535 requested a full tablet report, sending...
I20260812 06:36:45.619369 31886 ts_manager.cc:194] Registered new tserver with Master: d6b5bb140b02446caf7c9f44a4d2b85c (127.28.69.2:38579)
I20260812 06:36:45.619921 31886 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.2:49923
I20260812 06:36:45.626863 28948 external_mini_cluster.cc:955] 2 TS(s) registered with all masters
I20260812 06:36:45.634979 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 32210
I20260812 06:36:45.655259 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 31830
I20260812 06:36:45.667927 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:42535
--webserver_interface=127.28.69.62
--webserver_port=45207
--builtin_ntp_servers=127.28.69.20:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:42535
--master_tombstone_evicted_tablet_replicas=false with env {}
W20260812 06:36:45.771035 32436 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:45.771257 32436 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:45.771312 32436 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:45.774554 32436 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:45.774611 32436 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:45.774637 32436 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:45.774659 32436 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:45.778458 32436 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:42535
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:42535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=45207
--never_fsync=true
--heap_profile_path=/tmp/kudu.32436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:45.779533 32436 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:45.780642 32436 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:45.785725 32441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:45.785756 32442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:45.785784 32448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:45.786145 32436 server_base.cc:1061] running on GCE node
I20260812 06:36:45.786545 32436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:45.787335 32436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:45.788481 32436 hybrid_clock.cc:648] HybridClock initialized: now 1786516605788465 us; error 29 us; skew 500 ppm
I20260812 06:36:45.790136 32436 webserver.cc:533] Webserver started at http://127.28.69.62:45207/ using document root <none> and password file <none>
I20260812 06:36:45.790661 32436 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:45.790740 32436 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:45.793924 32436 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:45.795792 32458 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:45.796700 32436 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:45.796815 32436 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "fc0e76ce152f453c82fd8f955981864b"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:45.797236 32436 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:45.814030 32436 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:45.814698 32436 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:45.814867 32436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:45.821991 32561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:42535 every 8 connection(s)
I20260812 06:36:45.821997 32436 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:42535
I20260812 06:36:45.823104 32436 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:45.823707 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 32436
I20260812 06:36:45.827876 32567 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:36:45.829758 32567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Bootstrap starting.
I20260812 06:36:45.843444 32567 log.cc:826] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:45.849773 32567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:45.850138 32567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Bootstrap complete.
I20260812 06:36:45.853242 32567 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } }
I20260812 06:36:45.853557 32567 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0e76ce152f453c82fd8f955981864b, State: Initialized, Role: FOLLOWER
I20260812 06:36:45.853983 32567 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } }
I20260812 06:36:45.854101 32567 raft_consensus.cc:399] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:45.854166 32567 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:45.854275 32567 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:45.855700 32567 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } }
I20260812 06:36:45.856015 32567 leader_election.cc:304] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc0e76ce152f453c82fd8f955981864b; no voters: 
I20260812 06:36:45.856305 32567 leader_election.cc:290] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 06:36:45.856415 32572 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:36:45.856640 32572 raft_consensus.cc:697] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [term 2 LEADER]: Becoming Leader. State: Replica: fc0e76ce152f453c82fd8f955981864b, State: Running, Role: LEADER
I20260812 06:36:45.856942 32572 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } }
I20260812 06:36:45.857506 32567 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:45.857924 32574 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc0e76ce152f453c82fd8f955981864b. Latest consensus state: current_term: 2 leader_uuid: "fc0e76ce152f453c82fd8f955981864b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } } }
I20260812 06:36:45.858033 32574 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:45.858259 32573 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fc0e76ce152f453c82fd8f955981864b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc0e76ce152f453c82fd8f955981864b" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42535 } } }
I20260812 06:36:45.858372 32573 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:45.858938 32576 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:45.861863 32576 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:45.862530 32576 catalog_manager.cc:1295] Loaded cluster ID: 36ba9a510bc04fa68751eb6e68939a93
I20260812 06:36:45.862581 32576 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:45.864115 32576 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:45.864693 32576 catalog_manager.cc:6103] T 00000000000000000000000000000000 P fc0e76ce152f453c82fd8f955981864b: Loaded TSK: 0
I20260812 06:36:45.865505 32576 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:46.456004 32203 heartbeater.cc:499] Master 127.28.69.62:42535 was elected leader, sending a full tablet report...
I20260812 06:36:46.460909 32487 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" instance_seqno: 1786516605438425) as {username='slave'} at 127.28.69.1:38547; Asking this server to re-register.
I20260812 06:36:46.461494 32203 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:46.461671 32203 heartbeater.cc:507] Master 127.28.69.62:42535 requested a full tablet report, sending...
I20260812 06:36:46.462626 32487 ts_manager.cc:194] Registered new tserver with Master: 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1:45459)
I20260812 06:36:46.468943 28948 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260812 06:36:46.479314 32487 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44604:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
  rows: "<redacted>""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:36:46.496752 32089 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1635620cd14ed1952cb7e816d0d784 (DEFAULT_TABLE table=test-workload [id=9f722ee515cf4d4e92113b4a5f4dc391]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20260812 06:36:46.496752 32084 tablet_service.cc:1511] Processing CreateTablet for tablet b89c2404e400460cac207ecbf6000e14 (DEFAULT_TABLE table=test-workload [id=9f722ee515cf4d4e92113b4a5f4dc391]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20260812 06:36:46.496745 32090 tablet_service.cc:1511] Processing CreateTablet for tablet 9431d42e2d134f37a44136cea6ae3b0b (DEFAULT_TABLE table=test-workload [id=9f722ee515cf4d4e92113b4a5f4dc391]), partition=RANGE (key) PARTITION VALUES < 536870911
I20260812 06:36:46.496745 32085 tablet_service.cc:1511] Processing CreateTablet for tablet 65d9b8aaf0f5409f86d0647da5fcc724 (DEFAULT_TABLE table=test-workload [id=9f722ee515cf4d4e92113b4a5f4dc391]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20260812 06:36:46.498212 32090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9431d42e2d134f37a44136cea6ae3b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:46.498556 32089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1635620cd14ed1952cb7e816d0d784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:46.498725 32084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b89c2404e400460cac207ecbf6000e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:46.498899 32085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d9b8aaf0f5409f86d0647da5fcc724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:46.504212 32623 tablet_bootstrap.cc:492] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93: Bootstrap starting.
I20260812 06:36:46.506361 32623 tablet_bootstrap.cc:654] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:46.507055 32623 log.cc:826] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:46.508633 32623 tablet_bootstrap.cc:492] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93: No bootstrap required, opened a new log
I20260812 06:36:46.508795 32623 ts_tablet_manager.cc:1403] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:36:46.511020 32623 raft_consensus.cc:359] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.511180 32623 raft_consensus.cc:385] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:46.511214 32623 raft_consensus.cc:740] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46ce1ace244a4185b710b63f5aae0e93, State: Initialized, Role: FOLLOWER
I20260812 06:36:46.511557 32623 consensus_queue.cc:260] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.511659 32623 raft_consensus.cc:399] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:46.511700 32623 raft_consensus.cc:493] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:46.511782 32623 raft_consensus.cc:3060] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:46.512460 32623 raft_consensus.cc:515] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.512795 32623 leader_election.cc:304] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46ce1ace244a4185b710b63f5aae0e93; no voters: 
I20260812 06:36:46.513137 32623 leader_election.cc:290] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:46.513285 32628 raft_consensus.cc:2804] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:46.513492 32628 raft_consensus.cc:697] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 LEADER]: Becoming Leader. State: Replica: 46ce1ace244a4185b710b63f5aae0e93, State: Running, Role: LEADER
I20260812 06:36:46.513785 32628 consensus_queue.cc:237] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.513906 32623 ts_tablet_manager.cc:1434] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260812 06:36:46.514130 32623 tablet_bootstrap.cc:492] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93: Bootstrap starting.
I20260812 06:36:46.515077 32623 tablet_bootstrap.cc:654] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:46.516204 32623 tablet_bootstrap.cc:492] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93: No bootstrap required, opened a new log
I20260812 06:36:46.516299 32623 ts_tablet_manager.cc:1403] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.001s
I20260812 06:36:46.516745 32623 raft_consensus.cc:359] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.516817 32623 raft_consensus.cc:385] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:46.516837 32623 raft_consensus.cc:740] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46ce1ace244a4185b710b63f5aae0e93, State: Initialized, Role: FOLLOWER
I20260812 06:36:46.516942 32623 consensus_queue.cc:260] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.517030 32623 raft_consensus.cc:399] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:46.517069 32623 raft_consensus.cc:493] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:46.517115 32623 raft_consensus.cc:3060] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:46.517335 32487 catalog_manager.cc:5719] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1). New cstate: current_term: 1 leader_uuid: "46ce1ace244a4185b710b63f5aae0e93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260812 06:36:46.517774 32623 raft_consensus.cc:515] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.517879 32623 leader_election.cc:304] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46ce1ace244a4185b710b63f5aae0e93; no voters: 
I20260812 06:36:46.517979 32623 leader_election.cc:290] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:46.518029 32628 raft_consensus.cc:2804] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:46.518107 32628 raft_consensus.cc:697] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 LEADER]: Becoming Leader. State: Replica: 46ce1ace244a4185b710b63f5aae0e93, State: Running, Role: LEADER
I20260812 06:36:46.518219 32623 ts_tablet_manager.cc:1434] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:46.518205 32628 consensus_queue.cc:237] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.518392 32623 tablet_bootstrap.cc:492] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93: Bootstrap starting.
I20260812 06:36:46.519258 32623 tablet_bootstrap.cc:654] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:46.520552 32623 tablet_bootstrap.cc:492] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93: No bootstrap required, opened a new log
I20260812 06:36:46.520627 32623 ts_tablet_manager.cc:1403] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:46.521070 32623 raft_consensus.cc:359] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.521149 32623 raft_consensus.cc:385] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:46.521181 32623 raft_consensus.cc:740] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46ce1ace244a4185b710b63f5aae0e93, State: Initialized, Role: FOLLOWER
I20260812 06:36:46.521139 32487 catalog_manager.cc:5719] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1). New cstate: current_term: 1 leader_uuid: "46ce1ace244a4185b710b63f5aae0e93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260812 06:36:46.521294 32623 consensus_queue.cc:260] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.521371 32623 raft_consensus.cc:399] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:46.521404 32623 raft_consensus.cc:493] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:46.521448 32623 raft_consensus.cc:3060] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:46.522297 32623 raft_consensus.cc:515] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.522420 32623 leader_election.cc:304] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46ce1ace244a4185b710b63f5aae0e93; no voters: 
I20260812 06:36:46.522511 32623 leader_election.cc:290] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:46.522555 32628 raft_consensus.cc:2804] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:46.522655 32628 raft_consensus.cc:697] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [term 1 LEADER]: Becoming Leader. State: Replica: 46ce1ace244a4185b710b63f5aae0e93, State: Running, Role: LEADER
I20260812 06:36:46.522733 32623 ts_tablet_manager.cc:1434] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:46.522768 32628 consensus_queue.cc:237] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.522891 32623 tablet_bootstrap.cc:492] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93: Bootstrap starting.
I20260812 06:36:46.523728 32623 tablet_bootstrap.cc:654] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:46.524626 32487 catalog_manager.cc:5719] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1). New cstate: current_term: 1 leader_uuid: "46ce1ace244a4185b710b63f5aae0e93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260812 06:36:46.524758 32623 tablet_bootstrap.cc:492] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93: No bootstrap required, opened a new log
I20260812 06:36:46.524818 32623 ts_tablet_manager.cc:1403] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:46.525226 32623 raft_consensus.cc:359] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.525317 32623 raft_consensus.cc:385] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:46.525357 32623 raft_consensus.cc:740] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46ce1ace244a4185b710b63f5aae0e93, State: Initialized, Role: FOLLOWER
I20260812 06:36:46.525472 32623 consensus_queue.cc:260] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.525553 32623 raft_consensus.cc:399] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:46.525594 32623 raft_consensus.cc:493] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:46.525640 32623 raft_consensus.cc:3060] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:46.526357 32623 raft_consensus.cc:515] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.526471 32623 leader_election.cc:304] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46ce1ace244a4185b710b63f5aae0e93; no voters: 
I20260812 06:36:46.526559 32623 leader_election.cc:290] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:46.526610 32628 raft_consensus.cc:2804] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:46.526701 32628 raft_consensus.cc:697] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [term 1 LEADER]: Becoming Leader. State: Replica: 46ce1ace244a4185b710b63f5aae0e93, State: Running, Role: LEADER
I20260812 06:36:46.526760 32623 ts_tablet_manager.cc:1434] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:46.526827 32628 consensus_queue.cc:237] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:46.527968 32487 catalog_manager.cc:5719] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1). New cstate: current_term: 1 leader_uuid: "46ce1ace244a4185b710b63f5aae0e93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260812 06:36:47.275987 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.2:38579
--local_ip_for_outbound_sockets=127.28.69.2
--tserver_master_addrs=127.28.69.62:42535
--webserver_port=38833
--webserver_interface=127.28.69.2
--builtin_ntp_servers=127.28.69.20:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=1 with env {}
W20260812 06:36:47.381232 32688 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:47.381443 32688 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:47.381490 32688 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:47.384784 32688 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:47.384902 32688 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.2
I20260812 06:36:47.388756 32688 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.2:38579
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.69.2
--webserver_port=38833
--tserver_master_addrs=127.28.69.62:42535
--num_tablets_to_copy_simultaneously=1
--never_fsync=true
--heap_profile_path=/tmp/kudu.32688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:47.389838 32688 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:47.390974 32688 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:47.397449 32695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:47.397439 32696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:47.397439 32698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:47.397766 32688 server_base.cc:1061] running on GCE node
I20260812 06:36:47.398128 32688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:47.398684 32688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:47.399870 32688 hybrid_clock.cc:648] HybridClock initialized: now 1786516607399852 us; error 32 us; skew 500 ppm
I20260812 06:36:47.401860 32688 webserver.cc:533] Webserver started at http://127.28.69.2:38833/ using document root <none> and password file <none>
I20260812 06:36:47.402477 32688 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:47.402559 32688 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:47.405977 32688 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:47.407850 32710 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:47.408819 32688 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:47.408917 32688 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
uuid: "d6b5bb140b02446caf7c9f44a4d2b85c"
format_stamp: "Formatted at 2026-08-12 06:36:45 on dist-test-slave-k5rr"
I20260812 06:36:47.409330 32688 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:47.417933 32688 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:47.418478 32688 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:47.418627 32688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:47.419142 32688 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:47.420071 32688 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:47.420117 32688 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:47.420156 32688 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:47.420184 32688 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:47.429033 32688 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.2:38579
I20260812 06:36:47.429087   425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.2:38579 every 8 connection(s)
I20260812 06:36:47.430116 32688 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestTabletCopyThrottling.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:47.433108 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 32688
I20260812 06:36:47.438856   426 heartbeater.cc:344] Connected to a master server at 127.28.69.62:42535
I20260812 06:36:47.439081   426 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:47.439596   426 heartbeater.cc:507] Master 127.28.69.62:42535 requested a full tablet report, sending...
I20260812 06:36:47.440100   431 ts_tablet_manager.cc:933] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: Initiating tablet copy from peer 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1:45459)
I20260812 06:36:47.440678   431 tablet_copy_client.cc:323] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.1:45459
I20260812 06:36:47.440841 32472 ts_manager.cc:194] Registered new tserver with Master: d6b5bb140b02446caf7c9f44a4d2b85c (127.28.69.2:38579)
I20260812 06:36:47.441949 32472 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.2:33339
I20260812 06:36:47.444762 32159 tablet_copy_service.cc:140] P 46ce1ace244a4185b710b63f5aae0e93: Received BeginTabletCopySession request for tablet 65d9b8aaf0f5409f86d0647da5fcc724 from peer d6b5bb140b02446caf7c9f44a4d2b85c ({username='slave'} at 127.28.69.2:37099)
I20260812 06:36:47.444900 32159 tablet_copy_service.cc:161] P 46ce1ace244a4185b710b63f5aae0e93: Beginning new tablet copy session on tablet 65d9b8aaf0f5409f86d0647da5fcc724 from peer d6b5bb140b02446caf7c9f44a4d2b85c at {username='slave'} at 127.28.69.2:37099: session id = d6b5bb140b02446caf7c9f44a4d2b85c-65d9b8aaf0f5409f86d0647da5fcc724
I20260812 06:36:47.446142 32159 tablet_copy_source_session.cc:215] T 65d9b8aaf0f5409f86d0647da5fcc724 P 46ce1ace244a4185b710b63f5aae0e93: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:47.449582   431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d9b8aaf0f5409f86d0647da5fcc724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:47.455988   431 tablet_copy_client.cc:806] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:47.456184   431 tablet_copy_client.cc:670] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:47.459154   431 tablet_copy_client.cc:538] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:47.461149   431 tablet_bootstrap.cc:492] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap starting.
I20260812 06:36:47.485836   431 log.cc:826] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:47.676489   431 tablet_bootstrap.cc:492] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap replayed 1/1 log segments. Stats: ops{read=219 overwritten=0 applied=219 ignored=0} inserts{seen=2754 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:47.676923   431 tablet_bootstrap.cc:492] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap complete.
I20260812 06:36:47.677383   431 ts_tablet_manager.cc:1403] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: Time spent bootstrapping tablet: real 0.216s	user 0.209s	sys 0.008s
I20260812 06:36:47.679718   431 raft_consensus.cc:359] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:47.679966   431 raft_consensus.cc:740] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: d6b5bb140b02446caf7c9f44a4d2b85c, State: Initialized, Role: NON_PARTICIPANT
I20260812 06:36:47.680334   431 consensus_queue.cc:260] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 219, Last appended: 1.219, Last appended by leader: 219, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:47.681071   426 heartbeater.cc:499] Master 127.28.69.62:42535 was elected leader, sending a full tablet report...
I20260812 06:36:47.681265   431 ts_tablet_manager.cc:1434] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:47.681985 32159 tablet_copy_service.cc:342] P 46ce1ace244a4185b710b63f5aae0e93: Request end of tablet copy session d6b5bb140b02446caf7c9f44a4d2b85c-65d9b8aaf0f5409f86d0647da5fcc724 received from {username='slave'} at 127.28.69.2:37099
I20260812 06:36:47.682086 32159 tablet_copy_service.cc:434] P 46ce1ace244a4185b710b63f5aae0e93: ending tablet copy session d6b5bb140b02446caf7c9f44a4d2b85c-65d9b8aaf0f5409f86d0647da5fcc724 on tablet 65d9b8aaf0f5409f86d0647da5fcc724 with peer d6b5bb140b02446caf7c9f44a4d2b85c
I20260812 06:36:47.683513   431 ts_tablet_manager.cc:933] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: Initiating tablet copy from peer 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1:45459)
I20260812 06:36:47.683784   431 tablet_copy_client.cc:323] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.1:45459
I20260812 06:36:47.684231 32159 tablet_copy_service.cc:140] P 46ce1ace244a4185b710b63f5aae0e93: Received BeginTabletCopySession request for tablet 8a1635620cd14ed1952cb7e816d0d784 from peer d6b5bb140b02446caf7c9f44a4d2b85c ({username='slave'} at 127.28.69.2:37099)
I20260812 06:36:47.684350 32159 tablet_copy_service.cc:161] P 46ce1ace244a4185b710b63f5aae0e93: Beginning new tablet copy session on tablet 8a1635620cd14ed1952cb7e816d0d784 from peer d6b5bb140b02446caf7c9f44a4d2b85c at {username='slave'} at 127.28.69.2:37099: session id = d6b5bb140b02446caf7c9f44a4d2b85c-8a1635620cd14ed1952cb7e816d0d784
I20260812 06:36:47.685277 32159 tablet_copy_source_session.cc:215] T 8a1635620cd14ed1952cb7e816d0d784 P 46ce1ace244a4185b710b63f5aae0e93: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:47.686028   431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1635620cd14ed1952cb7e816d0d784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:47.687528   431 tablet_copy_client.cc:806] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:47.687654   431 tablet_copy_client.cc:670] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:47.690001   431 tablet_copy_client.cc:538] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:47.691300   431 tablet_bootstrap.cc:492] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap starting.
I20260812 06:36:47.879729   431 tablet_bootstrap.cc:492] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap replayed 1/1 log segments. Stats: ops{read=219 overwritten=0 applied=219 ignored=0} inserts{seen=2660 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:47.880012   431 tablet_bootstrap.cc:492] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap complete.
I20260812 06:36:47.880196   431 ts_tablet_manager.cc:1403] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: Time spent bootstrapping tablet: real 0.189s	user 0.183s	sys 0.004s
I20260812 06:36:47.880743   431 raft_consensus.cc:359] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:47.880854   431 raft_consensus.cc:740] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: d6b5bb140b02446caf7c9f44a4d2b85c, State: Initialized, Role: NON_PARTICIPANT
I20260812 06:36:47.880939   431 consensus_queue.cc:260] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 219, Last appended: 1.219, Last appended by leader: 219, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:47.881220   431 ts_tablet_manager.cc:1434] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 06:36:47.881778 32159 tablet_copy_service.cc:342] P 46ce1ace244a4185b710b63f5aae0e93: Request end of tablet copy session d6b5bb140b02446caf7c9f44a4d2b85c-8a1635620cd14ed1952cb7e816d0d784 received from {username='slave'} at 127.28.69.2:37099
I20260812 06:36:47.881886 32159 tablet_copy_service.cc:434] P 46ce1ace244a4185b710b63f5aae0e93: ending tablet copy session d6b5bb140b02446caf7c9f44a4d2b85c-8a1635620cd14ed1952cb7e816d0d784 on tablet 8a1635620cd14ed1952cb7e816d0d784 with peer d6b5bb140b02446caf7c9f44a4d2b85c
W20260812 06:36:47.883242   431 ts_tablet_manager.cc:732] T 8a1635620cd14ed1952cb7e816d0d784 P d6b5bb140b02446caf7c9f44a4d2b85c: Tablet Copy: Invalid argument: Leader has replica of tablet 8a1635620cd14ed1952cb7e816d0d784 with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 06:36:47.885241   431 ts_tablet_manager.cc:933] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: Initiating tablet copy from peer 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1:45459)
I20260812 06:36:47.885545   431 tablet_copy_client.cc:323] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.1:45459
I20260812 06:36:47.886019 32159 tablet_copy_service.cc:140] P 46ce1ace244a4185b710b63f5aae0e93: Received BeginTabletCopySession request for tablet 9431d42e2d134f37a44136cea6ae3b0b from peer d6b5bb140b02446caf7c9f44a4d2b85c ({username='slave'} at 127.28.69.2:37099)
I20260812 06:36:47.886133 32159 tablet_copy_service.cc:161] P 46ce1ace244a4185b710b63f5aae0e93: Beginning new tablet copy session on tablet 9431d42e2d134f37a44136cea6ae3b0b from peer d6b5bb140b02446caf7c9f44a4d2b85c at {username='slave'} at 127.28.69.2:37099: session id = d6b5bb140b02446caf7c9f44a4d2b85c-9431d42e2d134f37a44136cea6ae3b0b
I20260812 06:36:47.886896 32159 tablet_copy_source_session.cc:215] T 9431d42e2d134f37a44136cea6ae3b0b P 46ce1ace244a4185b710b63f5aae0e93: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:47.887610   431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9431d42e2d134f37a44136cea6ae3b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:47.889144   431 tablet_copy_client.cc:806] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:47.889288   431 tablet_copy_client.cc:670] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:47.891163   431 tablet_copy_client.cc:538] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:47.892269   431 tablet_bootstrap.cc:492] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap starting.
I20260812 06:36:48.081509   431 tablet_bootstrap.cc:492] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap replayed 1/1 log segments. Stats: ops{read=219 overwritten=0 applied=219 ignored=0} inserts{seen=2686 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:48.081825   431 tablet_bootstrap.cc:492] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap complete.
I20260812 06:36:48.082048   431 ts_tablet_manager.cc:1403] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: Time spent bootstrapping tablet: real 0.190s	user 0.182s	sys 0.008s
I20260812 06:36:48.082474   431 raft_consensus.cc:359] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:48.082566   431 raft_consensus.cc:740] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: d6b5bb140b02446caf7c9f44a4d2b85c, State: Initialized, Role: NON_PARTICIPANT
I20260812 06:36:48.082644   431 consensus_queue.cc:260] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 219, Last appended: 1.219, Last appended by leader: 219, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:48.082871   431 ts_tablet_manager.cc:1434] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:36:48.083444 32159 tablet_copy_service.cc:342] P 46ce1ace244a4185b710b63f5aae0e93: Request end of tablet copy session d6b5bb140b02446caf7c9f44a4d2b85c-9431d42e2d134f37a44136cea6ae3b0b received from {username='slave'} at 127.28.69.2:37099
I20260812 06:36:48.083552 32159 tablet_copy_service.cc:434] P 46ce1ace244a4185b710b63f5aae0e93: ending tablet copy session d6b5bb140b02446caf7c9f44a4d2b85c-9431d42e2d134f37a44136cea6ae3b0b on tablet 9431d42e2d134f37a44136cea6ae3b0b with peer d6b5bb140b02446caf7c9f44a4d2b85c
W20260812 06:36:48.084889   431 ts_tablet_manager.cc:732] T 9431d42e2d134f37a44136cea6ae3b0b P d6b5bb140b02446caf7c9f44a4d2b85c: Tablet Copy: Invalid argument: Leader has replica of tablet 9431d42e2d134f37a44136cea6ae3b0b with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 06:36:48.086122   431 ts_tablet_manager.cc:933] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: Initiating tablet copy from peer 46ce1ace244a4185b710b63f5aae0e93 (127.28.69.1:45459)
I20260812 06:36:48.086382   431 tablet_copy_client.cc:323] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.1:45459
I20260812 06:36:48.086833 32159 tablet_copy_service.cc:140] P 46ce1ace244a4185b710b63f5aae0e93: Received BeginTabletCopySession request for tablet b89c2404e400460cac207ecbf6000e14 from peer d6b5bb140b02446caf7c9f44a4d2b85c ({username='slave'} at 127.28.69.2:37099)
I20260812 06:36:48.086934 32159 tablet_copy_service.cc:161] P 46ce1ace244a4185b710b63f5aae0e93: Beginning new tablet copy session on tablet b89c2404e400460cac207ecbf6000e14 from peer d6b5bb140b02446caf7c9f44a4d2b85c at {username='slave'} at 127.28.69.2:37099: session id = d6b5bb140b02446caf7c9f44a4d2b85c-b89c2404e400460cac207ecbf6000e14
I20260812 06:36:48.087652 32159 tablet_copy_source_session.cc:215] T b89c2404e400460cac207ecbf6000e14 P 46ce1ace244a4185b710b63f5aae0e93: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:48.088328   431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b89c2404e400460cac207ecbf6000e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:48.089859   431 tablet_copy_client.cc:806] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:48.090009   431 tablet_copy_client.cc:670] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:48.091888   431 tablet_copy_client.cc:538] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:48.092921   431 tablet_bootstrap.cc:492] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap starting.
I20260812 06:36:48.276717   431 tablet_bootstrap.cc:492] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap replayed 1/1 log segments. Stats: ops{read=219 overwritten=0 applied=219 ignored=0} inserts{seen=2800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:48.277025   431 tablet_bootstrap.cc:492] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: Bootstrap complete.
I20260812 06:36:48.277217   431 ts_tablet_manager.cc:1403] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: Time spent bootstrapping tablet: real 0.184s	user 0.181s	sys 0.004s
I20260812 06:36:48.277712   431 raft_consensus.cc:359] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:48.277814   431 raft_consensus.cc:740] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: d6b5bb140b02446caf7c9f44a4d2b85c, State: Initialized, Role: NON_PARTICIPANT
I20260812 06:36:48.277894   431 consensus_queue.cc:260] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 219, Last appended: 1.219, Last appended by leader: 219, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46ce1ace244a4185b710b63f5aae0e93" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 45459 } }
I20260812 06:36:48.278180   431 ts_tablet_manager.cc:1434] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:36:48.278831 32159 tablet_copy_service.cc:342] P 46ce1ace244a4185b710b63f5aae0e93: Request end of tablet copy session d6b5bb140b02446caf7c9f44a4d2b85c-b89c2404e400460cac207ecbf6000e14 received from {username='slave'} at 127.28.69.2:37099
I20260812 06:36:48.278945 32159 tablet_copy_service.cc:434] P 46ce1ace244a4185b710b63f5aae0e93: ending tablet copy session d6b5bb140b02446caf7c9f44a4d2b85c-b89c2404e400460cac207ecbf6000e14 on tablet b89c2404e400460cac207ecbf6000e14 with peer d6b5bb140b02446caf7c9f44a4d2b85c
W20260812 06:36:48.281255   431 ts_tablet_manager.cc:732] T 65d9b8aaf0f5409f86d0647da5fcc724 P d6b5bb140b02446caf7c9f44a4d2b85c: Tablet Copy: Invalid argument: Leader has replica of tablet 65d9b8aaf0f5409f86d0647da5fcc724 with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
W20260812 06:36:48.282754   431 ts_tablet_manager.cc:732] T b89c2404e400460cac207ecbf6000e14 P d6b5bb140b02446caf7c9f44a4d2b85c: Tablet Copy: Invalid argument: Leader has replica of tablet b89c2404e400460cac207ecbf6000e14 with term 0, which is lower than last-logged term 1 on local replica. Rejecting tablet copy request
I20260812 06:36:48.284475 28948 tablet_copy-itest.cc:1252] Number of Service unavailable responses: 559
I20260812 06:36:48.284518 28948 tablet_copy-itest.cc:1253] Number of in progress responses: 255
I20260812 06:36:48.284894 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 31983
I20260812 06:36:48.320592 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 32688
I20260812 06:36:48.336633 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 32436
2026-08-12T06:36:48Z chronyd exiting
[       OK ] TabletCopyITest.TestTabletCopyThrottling (3301 ms)
[ RUN      ] TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate
2026-08-12T06:36:48Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:48Z Disabled control of system clock
I20260812 06:36:48.374859 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:42067
--webserver_interface=127.28.69.62
--webserver_port=0
--builtin_ntp_servers=127.28.69.20:45771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:42067 with env {}
W20260812 06:36:48.477415   455 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:48.477626   455 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:48.477667   455 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:48.480909   455 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:48.480966   455 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:48.480985   455 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:48.481022   455 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:48.484763   455 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:42067
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:42067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:48.485883   455 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:48.487013   455 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:48.492422   463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:48.492411   460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:48.492532   455 server_base.cc:1061] running on GCE node
W20260812 06:36:48.492412   461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:48.493193   455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:48.494071   455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:48.495221   455 hybrid_clock.cc:648] HybridClock initialized: now 1786516608495209 us; error 26 us; skew 500 ppm
I20260812 06:36:48.496867   455 webserver.cc:533] Webserver started at http://127.28.69.62:34321/ using document root <none> and password file <none>
I20260812 06:36:48.497427   455 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:48.497488   455 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:48.497666   455 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:48.499153   455 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data/instance:
uuid: "2834247f9f124fad8af262498b5bad9f"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.499615   455 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/wal/instance:
uuid: "2834247f9f124fad8af262498b5bad9f"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.502763   455 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:48.504877   474 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:48.505880   455 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:48.505976   455 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "2834247f9f124fad8af262498b5bad9f"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.506054   455 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:48.527956   455 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:48.528576   455 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:48.528729   455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:48.536016   455 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:42067
I20260812 06:36:48.536064   572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:42067 every 8 connection(s)
I20260812 06:36:48.537057   455 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:48.539960   573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:48.540185 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 455
I20260812 06:36:48.540320 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/wal/instance
I20260812 06:36:48.545112   573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f: Bootstrap starting.
I20260812 06:36:48.547258   573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:48.548005   573 log.cc:826] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:48.549634   573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f: No bootstrap required, opened a new log
I20260812 06:36:48.552023   573 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2834247f9f124fad8af262498b5bad9f" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42067 } }
I20260812 06:36:48.552204   573 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:48.552261   573 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2834247f9f124fad8af262498b5bad9f, State: Initialized, Role: FOLLOWER
I20260812 06:36:48.552646   573 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2834247f9f124fad8af262498b5bad9f" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42067 } }
I20260812 06:36:48.552778   573 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:48.552838   573 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:48.552939   573 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:48.553664   573 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2834247f9f124fad8af262498b5bad9f" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42067 } }
I20260812 06:36:48.553977   573 leader_election.cc:304] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2834247f9f124fad8af262498b5bad9f; no voters: 
I20260812 06:36:48.554226   573 leader_election.cc:290] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:48.554376   580 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:48.554597   580 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [term 1 LEADER]: Becoming Leader. State: Replica: 2834247f9f124fad8af262498b5bad9f, State: Running, Role: LEADER
I20260812 06:36:48.554880   580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2834247f9f124fad8af262498b5bad9f" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42067 } }
I20260812 06:36:48.555244   573 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:48.556310   584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2834247f9f124fad8af262498b5bad9f. Latest consensus state: current_term: 1 leader_uuid: "2834247f9f124fad8af262498b5bad9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2834247f9f124fad8af262498b5bad9f" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42067 } } }
I20260812 06:36:48.556437   584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:48.557175   596 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:48.557610   583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2834247f9f124fad8af262498b5bad9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2834247f9f124fad8af262498b5bad9f" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 42067 } } }
I20260812 06:36:48.558077   583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:48.559684   596 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:48.564474   596 catalog_manager.cc:1383] Generated new cluster ID: c7e383f4a68945848f4f397fd88b7a9d
I20260812 06:36:48.564540   596 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:48.581418   596 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:48.582574   596 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:48.600574   596 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 2834247f9f124fad8af262498b5bad9f: Generated new TSK 0
I20260812 06:36:48.601379   596 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:48.613803 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.1:0
--local_ip_for_outbound_sockets=127.28.69.1
--webserver_interface=127.28.69.1
--webserver_port=0
--tserver_master_addrs=127.28.69.62:42067
--builtin_ntp_servers=127.28.69.20:45771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_flush_memrowset=false
--enable_flush_deltamemstores=false
--tablet_copy_download_threads_nums_per_session=4
--log_segment_size_mb=1 with env {}
W20260812 06:36:48.716717   614 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:48.716918   614 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:48.716951   614 flags.cc:432] Enabled unsafe flag: --enable_flush_deltamemstores=false
W20260812 06:36:48.716966   614 flags.cc:432] Enabled unsafe flag: --enable_flush_memrowset=false
W20260812 06:36:48.716997   614 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:48.720206   614 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:48.720319   614 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.1
I20260812 06:36:48.724015   614 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.69.1
--webserver_port=0
--enable_flush_deltamemstores=false
--enable_flush_memrowset=false
--tserver_master_addrs=127.28.69.62:42067
--never_fsync=true
--heap_profile_path=/tmp/kudu.614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:48.724987   614 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:48.726076   614 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:48.731961   621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:48.731963   622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:48.732045   628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:48.732107   614 server_base.cc:1061] running on GCE node
I20260812 06:36:48.732517   614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:48.733033   614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:48.734177   614 hybrid_clock.cc:648] HybridClock initialized: now 1786516608734162 us; error 37 us; skew 500 ppm
I20260812 06:36:48.735730   614 webserver.cc:533] Webserver started at http://127.28.69.1:39547/ using document root <none> and password file <none>
I20260812 06:36:48.736249   614 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:48.736305   614 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:48.736480   614 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:48.737974   614 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data/instance:
uuid: "f21b1dbf84ce4f1ab4fea53e14da9784"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.738411   614 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance:
uuid: "f21b1dbf84ce4f1ab4fea53e14da9784"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.741484   614 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:48.743508   637 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:48.744426   614 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:48.744527   614 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/wal
uuid: "f21b1dbf84ce4f1ab4fea53e14da9784"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.744608   614 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:48.755741   614 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:48.756390   614 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:48.756574   614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:48.757141   614 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:48.758139   614 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:48.758185   614 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:48.758221   614 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:48.758249   614 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:48.766834   614 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.1:34715
I20260812 06:36:48.766891   835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.1:34715 every 8 connection(s)
I20260812 06:36:48.767778   614 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:48.770347 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 614
I20260812 06:36:48.770488 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:48.772891 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.2:0
--local_ip_for_outbound_sockets=127.28.69.2
--webserver_interface=127.28.69.2
--webserver_port=0
--tserver_master_addrs=127.28.69.62:42067
--builtin_ntp_servers=127.28.69.20:45771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_flush_memrowset=false
--enable_flush_deltamemstores=false
--tablet_copy_download_threads_nums_per_session=4
--log_segment_size_mb=1 with env {}
I20260812 06:36:48.776274   836 heartbeater.cc:344] Connected to a master server at 127.28.69.62:42067
I20260812 06:36:48.776494   836 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:48.776958   836 heartbeater.cc:507] Master 127.28.69.62:42067 requested a full tablet report, sending...
I20260812 06:36:48.778373   497 ts_manager.cc:194] Registered new tserver with Master: f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1:34715)
I20260812 06:36:48.779489   497 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.1:33659
W20260812 06:36:48.876487   843 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:48.876706   843 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:48.876749   843 flags.cc:432] Enabled unsafe flag: --enable_flush_deltamemstores=false
W20260812 06:36:48.876771   843 flags.cc:432] Enabled unsafe flag: --enable_flush_memrowset=false
W20260812 06:36:48.876822   843 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:48.880117   843 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:48.880244   843 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.2
I20260812 06:36:48.883941   843 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.69.2
--webserver_port=0
--enable_flush_deltamemstores=false
--enable_flush_memrowset=false
--tserver_master_addrs=127.28.69.62:42067
--never_fsync=true
--heap_profile_path=/tmp/kudu.843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:48.884966   843 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:48.886096   843 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:48.892032   856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:48.892076   858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:48.892105   862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:48.892627   843 server_base.cc:1061] running on GCE node
I20260812 06:36:48.892990   843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:48.893546   843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:48.894697   843 hybrid_clock.cc:648] HybridClock initialized: now 1786516608894670 us; error 39 us; skew 500 ppm
I20260812 06:36:48.896384   843 webserver.cc:533] Webserver started at http://127.28.69.2:36785/ using document root <none> and password file <none>
I20260812 06:36:48.896916   843 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:48.896973   843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:48.897185   843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:48.898707   843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data/instance:
uuid: "47712b5497f74933b74c5143b90867d1"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.899173   843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance:
uuid: "47712b5497f74933b74c5143b90867d1"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.902314   843 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260812 06:36:48.904289   870 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:48.905267   843 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:48.905375   843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/wal
uuid: "47712b5497f74933b74c5143b90867d1"
format_stamp: "Formatted at 2026-08-12 06:36:48 on dist-test-slave-k5rr"
I20260812 06:36:48.905452   843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:48.925807   843 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:48.926434   843 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:48.926604   843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:48.927145   843 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:48.928107   843 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:48.928156   843 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:48.928207   843 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:48.928236   843 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:48.936882   843 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.2:39765
I20260812 06:36:48.936909  1052 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.2:39765 every 8 connection(s)
I20260812 06:36:48.937788   843 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:48.939929 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 843
I20260812 06:36:48.940045 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:48.942370 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.3:0
--local_ip_for_outbound_sockets=127.28.69.3
--webserver_interface=127.28.69.3
--webserver_port=0
--tserver_master_addrs=127.28.69.62:42067
--builtin_ntp_servers=127.28.69.20:45771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_flush_memrowset=false
--enable_flush_deltamemstores=false
--tablet_copy_download_threads_nums_per_session=4
--log_segment_size_mb=1 with env {}
I20260812 06:36:48.945977  1054 heartbeater.cc:344] Connected to a master server at 127.28.69.62:42067
I20260812 06:36:48.946193  1054 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:48.946653  1054 heartbeater.cc:507] Master 127.28.69.62:42067 requested a full tablet report, sending...
I20260812 06:36:48.947690   497 ts_manager.cc:194] Registered new tserver with Master: 47712b5497f74933b74c5143b90867d1 (127.28.69.2:39765)
I20260812 06:36:48.948414   497 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.2:60607
W20260812 06:36:49.046495  1059 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:49.046684  1059 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:49.046715  1059 flags.cc:432] Enabled unsafe flag: --enable_flush_deltamemstores=false
W20260812 06:36:49.046730  1059 flags.cc:432] Enabled unsafe flag: --enable_flush_memrowset=false
W20260812 06:36:49.046761  1059 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:49.050028  1059 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:49.050136  1059 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.3
I20260812 06:36:49.053874  1059 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:45771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.69.3
--webserver_port=0
--enable_flush_deltamemstores=false
--enable_flush_memrowset=false
--tserver_master_addrs=127.28.69.62:42067
--never_fsync=true
--heap_profile_path=/tmp/kudu.1059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:49.054853  1059 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:49.055958  1059 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:49.062462  1073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:49.062469  1072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:49.062462  1078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:49.062553  1059 server_base.cc:1061] running on GCE node
I20260812 06:36:49.063066  1059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:49.063581  1059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:49.064735  1059 hybrid_clock.cc:648] HybridClock initialized: now 1786516609064713 us; error 32 us; skew 500 ppm
I20260812 06:36:49.066396  1059 webserver.cc:533] Webserver started at http://127.28.69.3:43233/ using document root <none> and password file <none>
I20260812 06:36:49.066933  1059 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:49.066992  1059 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:49.067189  1059 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:49.068686  1059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data/instance:
uuid: "0467fee2fcfd449f8439b3e08760bf6e"
format_stamp: "Formatted at 2026-08-12 06:36:49 on dist-test-slave-k5rr"
I20260812 06:36:49.069200  1059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/wal/instance:
uuid: "0467fee2fcfd449f8439b3e08760bf6e"
format_stamp: "Formatted at 2026-08-12 06:36:49 on dist-test-slave-k5rr"
I20260812 06:36:49.072252  1059 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 06:36:49.074417  1092 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:49.075384  1059 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:49.075488  1059 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/wal
uuid: "0467fee2fcfd449f8439b3e08760bf6e"
format_stamp: "Formatted at 2026-08-12 06:36:49 on dist-test-slave-k5rr"
I20260812 06:36:49.075570  1059 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:49.110246  1059 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:49.110917  1059 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:49.111085  1059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:49.111666  1059 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:49.112675  1059 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:49.112735  1059 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:49.112787  1059 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:49.112811  1059 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:49.121676  1059 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.3:44851
I20260812 06:36:49.121716  1289 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.3:44851 every 8 connection(s)
I20260812 06:36:49.122642  1059 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:49.129628 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 1059
I20260812 06:36:49.129763 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:49.130913  1290 heartbeater.cc:344] Connected to a master server at 127.28.69.62:42067
I20260812 06:36:49.131181  1290 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:49.131796  1290 heartbeater.cc:507] Master 127.28.69.62:42067 requested a full tablet report, sending...
I20260812 06:36:49.132861   497 ts_manager.cc:194] Registered new tserver with Master: 0467fee2fcfd449f8439b3e08760bf6e (127.28.69.3:44851)
I20260812 06:36:49.133426   497 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.3:59875
I20260812 06:36:49.144097 28948 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:49.160261   497 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58232:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:49.161464   497 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:49.177994   947 tablet_service.cc:1511] Processing CreateTablet for tablet 503e02ca969744bdbf41677881feeeb5 (DEFAULT_TABLE table=test-workload [id=6086315109b24bc49cbb1effb3527eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:49.178021   717 tablet_service.cc:1511] Processing CreateTablet for tablet 503e02ca969744bdbf41677881feeeb5 (DEFAULT_TABLE table=test-workload [id=6086315109b24bc49cbb1effb3527eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:49.178020  1174 tablet_service.cc:1511] Processing CreateTablet for tablet 503e02ca969744bdbf41677881feeeb5 (DEFAULT_TABLE table=test-workload [id=6086315109b24bc49cbb1effb3527eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:49.178911   947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503e02ca969744bdbf41677881feeeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:49.178925  1174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503e02ca969744bdbf41677881feeeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:49.178925   717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503e02ca969744bdbf41677881feeeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:49.183940  1335 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Bootstrap starting.
I20260812 06:36:49.184962  1340 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784: Bootstrap starting.
I20260812 06:36:49.186539  1335 tablet_bootstrap.cc:654] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:49.186736  1340 tablet_bootstrap.cc:654] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:49.187261  1335 log.cc:826] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:49.187345  1340 log.cc:826] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:49.187956  1337 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e: Bootstrap starting.
I20260812 06:36:49.188933  1340 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784: No bootstrap required, opened a new log
I20260812 06:36:49.189131  1340 ts_tablet_manager.cc:1403] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784: Time spent bootstrapping tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:49.189743  1337 tablet_bootstrap.cc:654] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:49.190363  1337 log.cc:826] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:49.191831  1335 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: No bootstrap required, opened a new log
I20260812 06:36:49.191823  1340 raft_consensus.cc:359] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.192015  1335 ts_tablet_manager.cc:1403] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Time spent bootstrapping tablet: real 0.008s	user 0.004s	sys 0.000s
I20260812 06:36:49.192024  1340 raft_consensus.cc:385] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:49.192076  1340 raft_consensus.cc:740] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f21b1dbf84ce4f1ab4fea53e14da9784, State: Initialized, Role: FOLLOWER
I20260812 06:36:49.192483  1340 consensus_queue.cc:260] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.193156   836 heartbeater.cc:499] Master 127.28.69.62:42067 was elected leader, sending a full tablet report...
I20260812 06:36:49.193300  1340 ts_tablet_manager.cc:1434] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:49.194723  1335 raft_consensus.cc:359] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.194895  1335 raft_consensus.cc:385] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:49.194962  1335 raft_consensus.cc:740] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47712b5497f74933b74c5143b90867d1, State: Initialized, Role: FOLLOWER
I20260812 06:36:49.195309  1335 consensus_queue.cc:260] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.195955  1054 heartbeater.cc:499] Master 127.28.69.62:42067 was elected leader, sending a full tablet report...
I20260812 06:36:49.196127  1335 ts_tablet_manager.cc:1434] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:49.197451  1337 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e: No bootstrap required, opened a new log
I20260812 06:36:49.197638  1337 ts_tablet_manager.cc:1403] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.000s
I20260812 06:36:49.200413  1337 raft_consensus.cc:359] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.200577  1337 raft_consensus.cc:385] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:49.200621  1337 raft_consensus.cc:740] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0467fee2fcfd449f8439b3e08760bf6e, State: Initialized, Role: FOLLOWER
I20260812 06:36:49.200984  1337 consensus_queue.cc:260] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.201601  1290 heartbeater.cc:499] Master 127.28.69.62:42067 was elected leader, sending a full tablet report...
I20260812 06:36:49.201690  1337 ts_tablet_manager.cc:1434] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:49.240929  1350 raft_consensus.cc:493] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:49.241151  1350 raft_consensus.cc:515] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.242272  1350 leader_election.cc:290] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1:34715), 47712b5497f74933b74c5143b90867d1 (127.28.69.2:39765)
I20260812 06:36:49.246531   759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5" candidate_uuid: "0467fee2fcfd449f8439b3e08760bf6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" is_pre_election: true
I20260812 06:36:49.246872   759 raft_consensus.cc:2468] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0467fee2fcfd449f8439b3e08760bf6e in term 0.
I20260812 06:36:49.247164   981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5" candidate_uuid: "0467fee2fcfd449f8439b3e08760bf6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47712b5497f74933b74c5143b90867d1" is_pre_election: true
I20260812 06:36:49.247383  1098 leader_election.cc:304] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0467fee2fcfd449f8439b3e08760bf6e, f21b1dbf84ce4f1ab4fea53e14da9784; no voters: 
I20260812 06:36:49.247442   981 raft_consensus.cc:2468] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0467fee2fcfd449f8439b3e08760bf6e in term 0.
I20260812 06:36:49.247670  1350 raft_consensus.cc:2804] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:49.247752  1350 raft_consensus.cc:493] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:49.247835  1350 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:49.248723  1350 raft_consensus.cc:515] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.249106  1350 leader_election.cc:290] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [CANDIDATE]: Term 1 election: Requested vote from peers f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1:34715), 47712b5497f74933b74c5143b90867d1 (127.28.69.2:39765)
I20260812 06:36:49.249461   759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5" candidate_uuid: "0467fee2fcfd449f8439b3e08760bf6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784"
I20260812 06:36:49.249490   981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5" candidate_uuid: "0467fee2fcfd449f8439b3e08760bf6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47712b5497f74933b74c5143b90867d1"
I20260812 06:36:49.249564   759 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:49.249629   981 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:49.250815   759 raft_consensus.cc:2468] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0467fee2fcfd449f8439b3e08760bf6e in term 1.
I20260812 06:36:49.250967   981 raft_consensus.cc:2468] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0467fee2fcfd449f8439b3e08760bf6e in term 1.
I20260812 06:36:49.251152  1098 leader_election.cc:304] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0467fee2fcfd449f8439b3e08760bf6e, f21b1dbf84ce4f1ab4fea53e14da9784; no voters: 
I20260812 06:36:49.251345  1350 raft_consensus.cc:2804] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:49.251546  1350 raft_consensus.cc:697] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 1 LEADER]: Becoming Leader. State: Replica: 0467fee2fcfd449f8439b3e08760bf6e, State: Running, Role: LEADER
I20260812 06:36:49.251838  1350 consensus_queue.cc:237] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.255249   497 catalog_manager.cc:5719] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0467fee2fcfd449f8439b3e08760bf6e (127.28.69.3). New cstate: current_term: 1 leader_uuid: "0467fee2fcfd449f8439b3e08760bf6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } health_report { overall_health: UNKNOWN } } }
W20260812 06:36:49.268903   837 tablet.cc:2406] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:49.269151   837 tablet_replica_mm_ops.cc:240] Deltamemstore flush is disabled (check --enable_flush_deltamemstores)
W20260812 06:36:49.269193   837 tablet_replica_mm_ops.cc:163] Memrowset flush is disabled (check --enable_flush_memrowset)
I20260812 06:36:49.278875   759 raft_consensus.cc:1275] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 1 FOLLOWER]: Refusing update from remote peer 0467fee2fcfd449f8439b3e08760bf6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:49.278887   981 raft_consensus.cc:1275] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 1 FOLLOWER]: Refusing update from remote peer 0467fee2fcfd449f8439b3e08760bf6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:49.279560  1350 consensus_queue.cc:1048] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:49.279731  1352 consensus_queue.cc:1048] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:49.289115  1358 mvcc.cc:204] Tried to move back new op lower bound from 7317572031599513600 to 7317572031498592256. Current Snapshot: MvccSnapshot[applied={T|T < 7317572031599513600}]
I20260812 06:36:49.309623   759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5"
dest_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784"
 from {username='slave'} at 127.0.0.1:39168
I20260812 06:36:49.309824   759 raft_consensus.cc:493] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:36:49.309890   759 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:49.310751   759 raft_consensus.cc:515] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.311787   759 leader_election.cc:290] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [CANDIDATE]: Term 2 election: Requested vote from peers 0467fee2fcfd449f8439b3e08760bf6e (127.28.69.3:44851), 47712b5497f74933b74c5143b90867d1 (127.28.69.2:39765)
I20260812 06:36:49.317250  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5" candidate_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0467fee2fcfd449f8439b3e08760bf6e"
I20260812 06:36:49.317361   981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5" candidate_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "47712b5497f74933b74c5143b90867d1"
I20260812 06:36:49.317479  1212 raft_consensus.cc:3055] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 1 LEADER]: Stepping down as leader of term 1
I20260812 06:36:49.317502   981 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:49.317540  1212 raft_consensus.cc:740] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0467fee2fcfd449f8439b3e08760bf6e, State: Running, Role: LEADER
I20260812 06:36:49.317755  1212 consensus_queue.cc:260] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:36:49.318084  1212 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:49.318547   981 raft_consensus.cc:2468] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f21b1dbf84ce4f1ab4fea53e14da9784 in term 2.
I20260812 06:36:49.319089   642 leader_election.cc:304] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47712b5497f74933b74c5143b90867d1, f21b1dbf84ce4f1ab4fea53e14da9784; no voters: 
I20260812 06:36:49.319200  1212 raft_consensus.cc:2468] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f21b1dbf84ce4f1ab4fea53e14da9784 in term 2.
I20260812 06:36:49.319388  1347 raft_consensus.cc:2804] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:36:49.319614  1347 raft_consensus.cc:697] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 2 LEADER]: Becoming Leader. State: Replica: f21b1dbf84ce4f1ab4fea53e14da9784, State: Running, Role: LEADER
I20260812 06:36:49.319943  1347 consensus_queue.cc:237] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
W20260812 06:36:49.323002  1130 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54466: Illegal state: replica 0467fee2fcfd449f8439b3e08760bf6e is not leader of this config: current role FOLLOWER
I20260812 06:36:49.324854   495 catalog_manager.cc:5719] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 reported cstate change: term changed from 1 to 2, leader changed from 0467fee2fcfd449f8439b3e08760bf6e (127.28.69.3) to f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1). New cstate: current_term: 2 leader_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } health_report { overall_health: UNKNOWN } } }
W20260812 06:36:49.326256  1130 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54466: Illegal state: replica 0467fee2fcfd449f8439b3e08760bf6e is not leader of this config: current role FOLLOWER
W20260812 06:36:49.327766  1130 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54466: Illegal state: replica 0467fee2fcfd449f8439b3e08760bf6e is not leader of this config: current role FOLLOWER
W20260812 06:36:49.328611  1130 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54466: Illegal state: replica 0467fee2fcfd449f8439b3e08760bf6e is not leader of this config: current role FOLLOWER
W20260812 06:36:49.328931  1129 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54466: Illegal state: replica 0467fee2fcfd449f8439b3e08760bf6e is not leader of this config: current role FOLLOWER
I20260812 06:36:49.336627   981 raft_consensus.cc:1275] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 2 FOLLOWER]: Refusing update from remote peer f21b1dbf84ce4f1ab4fea53e14da9784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 06:36:49.336630  1212 raft_consensus.cc:1275] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 2 FOLLOWER]: Refusing update from remote peer f21b1dbf84ce4f1ab4fea53e14da9784: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 06:36:49.337212  1385 consensus_queue.cc:1048] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:36:49.337385  1347 consensus_queue.cc:1048] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:36:49.346346  1355 mvcc.cc:204] Tried to move back new op lower bound from 7317572031837364224 to 7317572031777644544. Current Snapshot: MvccSnapshot[applied={T|T < 7317572031837364224 or (T in {7317572031837364224})}]
W20260812 06:36:49.373781  1293 tablet_replica_mm_ops.cc:240] Deltamemstore flush is disabled (check --enable_flush_deltamemstores)
W20260812 06:36:49.373867  1293 tablet_replica_mm_ops.cc:163] Memrowset flush is disabled (check --enable_flush_memrowset)
I20260812 06:36:49.374372  1356 mvcc.cc:204] Tried to move back new op lower bound from 7317572031969943552 to 7317572031777644544. Current Snapshot: MvccSnapshot[applied={T|T < 7317572031969943552 or (T in {7317572031969943552})}]
W20260812 06:36:49.439487  1057 tablet_replica_mm_ops.cc:240] Deltamemstore flush is disabled (check --enable_flush_deltamemstores)
W20260812 06:36:49.439568  1057 tablet_replica_mm_ops.cc:163] Memrowset flush is disabled (check --enable_flush_memrowset)
I20260812 06:37:02.461970   947 tablet_service.cc:1558] Processing DeleteTablet for tablet 503e02ca969744bdbf41677881feeeb5 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:56792
I20260812 06:37:02.462514  1460 tablet_replica.cc:333] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: stopping tablet replica
I20260812 06:37:02.462780  1460 raft_consensus.cc:2243] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:02.463016  1460 raft_consensus.cc:2272] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:02.465306  1460 ts_tablet_manager.cc:1916] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:02.467367  1460 ts_tablet_manager.cc:1929] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.2488
I20260812 06:37:02.467453  1460 log.cc:1199] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/wal/wals/503e02ca969744bdbf41677881feeeb5
W20260812 06:37:02.718108   642 consensus_peers.cc:597] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 -> Peer 47712b5497f74933b74c5143b90867d1 (127.28.69.2:39765): Couldn't send request to peer 47712b5497f74933b74c5143b90867d1. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:03.238405  1464 ts_tablet_manager.cc:933] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Initiating tablet copy from peer f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1:34715)
I20260812 06:37:03.239024  1464 tablet_copy_client.cc:323] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.1:34715
I20260812 06:37:03.242581   791 tablet_copy_service.cc:140] P f21b1dbf84ce4f1ab4fea53e14da9784: Received BeginTabletCopySession request for tablet 503e02ca969744bdbf41677881feeeb5 from peer 47712b5497f74933b74c5143b90867d1 ({username='slave'} at 127.28.69.2:54329)
I20260812 06:37:03.242707   791 tablet_copy_service.cc:161] P f21b1dbf84ce4f1ab4fea53e14da9784: Beginning new tablet copy session on tablet 503e02ca969744bdbf41677881feeeb5 from peer 47712b5497f74933b74c5143b90867d1 at {username='slave'} at 127.28.69.2:54329: session id = 47712b5497f74933b74c5143b90867d1-503e02ca969744bdbf41677881feeeb5
I20260812 06:37:03.243881   791 tablet_copy_source_session.cc:215] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784: Tablet Copy: opened 0 blocks and 5 log segments
I20260812 06:37:03.245277  1464 ts_tablet_manager.cc:1916] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:37:03.247061  1464 ts_tablet_manager.cc:1929] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.2488
I20260812 06:37:03.247246  1464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503e02ca969744bdbf41677881feeeb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:03.248299  1464 tablet_copy_client.cc:806] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: tablet copy: Starting download of 0 data blocks...
I20260812 06:37:03.248456  1464 tablet_copy_client.cc:670] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: tablet copy: Starting download of 5 WAL segments...
I20260812 06:37:03.260846  1464 tablet_copy_client.cc:538] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:37:03.262567  1464 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Bootstrap starting.
I20260812 06:37:03.925060  1464 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Bootstrap replayed 1/5 log segments. Stats: ops{read=622 overwritten=0 applied=621 ignored=0} inserts{seen=1 ignored=0} mutations{seen=30900 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:37:04.624656  1464 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Bootstrap replayed 2/5 log segments. Stats: ops{read=1242 overwritten=0 applied=1241 ignored=0} inserts{seen=1 ignored=0} mutations{seen=61900 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:37:05.332121  1464 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Bootstrap replayed 3/5 log segments. Stats: ops{read=1861 overwritten=0 applied=1860 ignored=0} inserts{seen=1 ignored=0} mutations{seen=92850 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260812 06:37:05.636693   642 consensus_peers.cc:597] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 -> Peer 47712b5497f74933b74c5143b90867d1 (127.28.69.2:39765): Couldn't send request to peer 47712b5497f74933b74c5143b90867d1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260812 06:37:05.985081  1464 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Bootstrap replayed 4/5 log segments. Stats: ops{read=2480 overwritten=0 applied=2479 ignored=0} inserts{seen=1 ignored=0} mutations{seen=123800 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:37:05.994666  1464 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Bootstrap replayed 5/5 log segments. Stats: ops{read=2488 overwritten=0 applied=2488 ignored=0} inserts{seen=1 ignored=0} mutations{seen=124250 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:05.995059  1464 tablet_bootstrap.cc:492] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Bootstrap complete.
I20260812 06:37:05.996001  1464 ts_tablet_manager.cc:1403] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Time spent bootstrapping tablet: real 2.733s	user 2.615s	sys 0.116s
I20260812 06:37:05.996551  1464 raft_consensus.cc:359] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:37:05.996661  1464 raft_consensus.cc:740] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47712b5497f74933b74c5143b90867d1, State: Initialized, Role: FOLLOWER
I20260812 06:37:05.996819  1464 consensus_queue.cc:260] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2488, Last appended: 2.2488, Last appended by leader: 2488, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:37:05.997177  1464 ts_tablet_manager.cc:1434] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.004s
I20260812 06:37:05.997946   788 tablet_copy_service.cc:342] P f21b1dbf84ce4f1ab4fea53e14da9784: Request end of tablet copy session 47712b5497f74933b74c5143b90867d1-503e02ca969744bdbf41677881feeeb5 received from {username='slave'} at 127.28.69.2:54329
I20260812 06:37:05.998066   788 tablet_copy_service.cc:434] P f21b1dbf84ce4f1ab4fea53e14da9784: ending tablet copy session 47712b5497f74933b74c5143b90867d1-503e02ca969744bdbf41677881feeeb5 on tablet 503e02ca969744bdbf41677881feeeb5 with peer 47712b5497f74933b74c5143b90867d1
I20260812 06:37:05.999140   981 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5"
dest_uuid: "47712b5497f74933b74c5143b90867d1"
 from {username='slave'} at 127.0.0.1:56792
I20260812 06:37:05.999294   981 raft_consensus.cc:493] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:37:05.999373   981 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:06.000329   981 raft_consensus.cc:515] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:37:06.001273   981 leader_election.cc:290] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [CANDIDATE]: Term 3 election: Requested vote from peers f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1:34715), 0467fee2fcfd449f8439b3e08760bf6e (127.28.69.3:44851)
I20260812 06:37:06.001634   759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5" candidate_uuid: "47712b5497f74933b74c5143b90867d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2488 } } ignore_live_leader: true dest_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784"
I20260812 06:37:06.001775   759 raft_consensus.cc:3055] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 06:37:06.001820   759 raft_consensus.cc:740] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f21b1dbf84ce4f1ab4fea53e14da9784, State: Running, Role: LEADER
I20260812 06:37:06.001991   759 consensus_queue.cc:260] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2488, Committed index: 2488, Last appended: 2.2488, Last appended by leader: 2488, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:37:06.002230   759 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:06.002955   759 raft_consensus.cc:2468] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47712b5497f74933b74c5143b90867d1 in term 3.
I20260812 06:37:06.003307   882 leader_election.cc:304] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47712b5497f74933b74c5143b90867d1, f21b1dbf84ce4f1ab4fea53e14da9784; no voters: 
I20260812 06:37:06.003547  1485 raft_consensus.cc:2804] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:37:06.003728  1485 raft_consensus.cc:697] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [term 3 LEADER]: Becoming Leader. State: Replica: 47712b5497f74933b74c5143b90867d1, State: Running, Role: LEADER
I20260812 06:37:06.003978  1485 consensus_queue.cc:237] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2488, Committed index: 2488, Last appended: 2.2488, Last appended by leader: 2488, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } }
I20260812 06:37:06.005728  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503e02ca969744bdbf41677881feeeb5" candidate_uuid: "47712b5497f74933b74c5143b90867d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2488 } } ignore_live_leader: true dest_uuid: "0467fee2fcfd449f8439b3e08760bf6e"
I20260812 06:37:06.005851  1212 raft_consensus.cc:3060] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:06.006129   495 catalog_manager.cc:5719] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 reported cstate change: term changed from 2 to 3, leader changed from f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1) to 47712b5497f74933b74c5143b90867d1 (127.28.69.2). New cstate: current_term: 3 leader_uuid: "47712b5497f74933b74c5143b90867d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47712b5497f74933b74c5143b90867d1" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 39765 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:06.006808  1212 raft_consensus.cc:2468] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47712b5497f74933b74c5143b90867d1 in term 3.
I20260812 06:37:06.054981  1174 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:06.055476   717 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:06.055487   947 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 2834247f9f124fad8af262498b5bad9f | 127.28.69.62:42067 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                      Value                                                                                      |      Tags       |         Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                             | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                             | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                            | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                               | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                            | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                            | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                              | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                             | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:45771 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 0467fee2fcfd449f8439b3e08760bf6e | 127.28.69.3:44851 | HEALTHY | <none>   |       0        |       0
 47712b5497f74933b74c5143b90867d1 | 127.28.69.2:39765 | HEALTHY | <none>   |       1        |       0
 f21b1dbf84ce4f1ab4fea53e14da9784 | 127.28.69.1:34715 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                    Value                                                                                    |      Tags       |      Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_flush_deltamemstores      | false                                                                                                                                                                       | unsafe,runtime  | all 3 server(s) checked
 enable_flush_memrowset           | false                                                                                                                                                                       | unsafe,runtime  | all 3 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                         | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.28.69.1                                                                                                                                                                 | experimental    | 127.28.69.1:34715
 local_ip_for_outbound_sockets    | 127.28.69.2                                                                                                                                                                 | experimental    | 127.28.69.2:39765
 local_ip_for_outbound_sockets    | 127.28.69.3                                                                                                                                                                 | experimental    | 127.28.69.3:44851
 never_fsync                      | true                                                                                                                                                                        | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                           | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                        | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                          | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.28.69.1:34715
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.28.69.2:39765
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.28.69.3:44851

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:45771 | all 3 server(s) checked
 time_source         | builtin            | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 503e02ca969744bdbf41677881feeeb5 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
  f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1:34715): RUNNING
  0467fee2fcfd449f8439b3e08760bf6e (127.28.69.3:44851): RUNNING
  47712b5497f74933b74c5143b90867d1 (127.28.69.2:39765): RUNNING [LEADER]
All reported replicas are:
  A = f21b1dbf84ce4f1ab4fea53e14da9784
  B = 0467fee2fcfd449f8439b3e08760bf6e
  C = 47712b5497f74933b74c5143b90867d1
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B   C*   |              |              | Yes
 A             | A   B   C    | 3            | -1           | Yes
 B             | A   B   C    | 3            | -1           | Yes
 C             | A   B   C*   | 3            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 06:37:06.079799 28948 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:37:06.277828  1174 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:06.277980   947 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 06:37:06.279428   717 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 2834247f9f124fad8af262498b5bad9f | 127.28.69.62:42067 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                      Value                                                                                      |      Tags       |         Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                             | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                             | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                            | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                               | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                            | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                            | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                              | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                             | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:45771 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 0467fee2fcfd449f8439b3e08760bf6e | 127.28.69.3:44851 | HEALTHY | <none>   |       0        |       0
 47712b5497f74933b74c5143b90867d1 | 127.28.69.2:39765 | HEALTHY | <none>   |       1        |       0
 f21b1dbf84ce4f1ab4fea53e14da9784 | 127.28.69.1:34715 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                    Value                                                                                    |      Tags       |      Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_flush_deltamemstores      | false                                                                                                                                                                       | unsafe,runtime  | all 3 server(s) checked
 enable_flush_memrowset           | false                                                                                                                                                                       | unsafe,runtime  | all 3 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                         | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.28.69.1                                                                                                                                                                 | experimental    | 127.28.69.1:34715
 local_ip_for_outbound_sockets    | 127.28.69.2                                                                                                                                                                 | experimental    | 127.28.69.2:39765
 local_ip_for_outbound_sockets    | 127.28.69.3                                                                                                                                                                 | experimental    | 127.28.69.3:44851
 never_fsync                      | true                                                                                                                                                                        | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                           | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                        | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                          | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.28.69.1:34715
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.28.69.2:39765
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.28.69.3:44851

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:45771 | all 3 server(s) checked
 time_source         | builtin            | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 503e02ca969744bdbf41677881feeeb5 of table 'test-workload' is conflicted: 2 replicas' active configs disagree with the leader master's
  f21b1dbf84ce4f1ab4fea53e14da9784 (127.28.69.1:34715): RUNNING
  0467fee2fcfd449f8439b3e08760bf6e (127.28.69.3:44851): RUNNING
  47712b5497f74933b74c5143b90867d1 (127.28.69.2:39765): RUNNING [LEADER]
All reported replicas are:
  A = f21b1dbf84ce4f1ab4fea53e14da9784
  B = 0467fee2fcfd449f8439b3e08760bf6e
  C = 47712b5497f74933b74c5143b90867d1
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B   C*   |              |              | Yes
 A             | A   B   C    | 3            | -1           | Yes
 B             | A   B   C    | 3            | -1           | Yes
 C             | A   B   C*   | 3            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 06:37:06.304405 28948 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:37:06.476413   759 raft_consensus.cc:1275] T 503e02ca969744bdbf41677881feeeb5 P f21b1dbf84ce4f1ab4fea53e14da9784 [term 3 FOLLOWER]: Refusing update from remote peer 47712b5497f74933b74c5143b90867d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2488. Preceding OpId from leader: term: 3 index: 2489. (index mismatch)
I20260812 06:37:06.477121  1485 consensus_queue.cc:1048] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f21b1dbf84ce4f1ab4fea53e14da9784" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 34715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2489, Last known committed idx: 2488, Time since last communication: 0.000s
I20260812 06:37:06.481501  1212 raft_consensus.cc:1275] T 503e02ca969744bdbf41677881feeeb5 P 0467fee2fcfd449f8439b3e08760bf6e [term 3 FOLLOWER]: Refusing update from remote peer 47712b5497f74933b74c5143b90867d1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2488. Preceding OpId from leader: term: 3 index: 2489. (index mismatch)
I20260812 06:37:06.482015  1598 consensus_queue.cc:1048] T 503e02ca969744bdbf41677881feeeb5 P 47712b5497f74933b74c5143b90867d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0467fee2fcfd449f8439b3e08760bf6e" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 44851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2489, Last known committed idx: 2488, Time since last communication: 0.000s
I20260812 06:37:06.578716   947 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 06:37:06.579334  1174 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:06.579385   717 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 2834247f9f124fad8af262498b5bad9f | 127.28.69.62:42067 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                      Value                                                                                      |      Tags       |         Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                             | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                             | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                            | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                               | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                            | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                            | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                              | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                             | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:45771 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 0467fee2fcfd449f8439b3e08760bf6e | 127.28.69.3:44851 | HEALTHY | <none>   |       0        |       0
 47712b5497f74933b74c5143b90867d1 | 127.28.69.2:39765 | HEALTHY | <none>   |       1        |       0
 f21b1dbf84ce4f1ab4fea53e14da9784 | 127.28.69.1:34715 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                    Value                                                                                    |      Tags       |      Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_flush_deltamemstores      | false                                                                                                                                                                       | unsafe,runtime  | all 3 server(s) checked
 enable_flush_memrowset           | false                                                                                                                                                                       | unsafe,runtime  | all 3 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                         | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.28.69.1                                                                                                                                                                 | experimental    | 127.28.69.1:34715
 local_ip_for_outbound_sockets    | 127.28.69.2                                                                                                                                                                 | experimental    | 127.28.69.2:39765
 local_ip_for_outbound_sockets    | 127.28.69.3                                                                                                                                                                 | experimental    | 127.28.69.3:44851
 never_fsync                      | true                                                                                                                                                                        | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                           | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                        | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                          | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.28.69.1:34715
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.28.69.2:39765
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.28.69.3:44851

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:45771 | all 3 server(s) checked
 time_source         | builtin            | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 06:37:06.604467 28948 log_verifier.cc:126] Checking tablet 503e02ca969744bdbf41677881feeeb5
I20260812 06:37:07.069931 28948 log_verifier.cc:177] Verified matching terms for 2489 ops in tablet 503e02ca969744bdbf41677881feeeb5
I20260812 06:37:07.234759 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 614
I20260812 06:37:07.251921 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 843
I20260812 06:37:07.271477 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 1059
I20260812 06:37:07.286979 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 455
2026-08-12T06:37:07Z chronyd exiting
[       OK ] TabletCopyITest.TestDownloadWalInParallelWithHeavyUpdate (18955 ms)
[----------] 4 tests from TabletCopyITest (53431 ms total)

[----------] 1 test from FaultFlags/BadTabletCopyITest
[ RUN      ] FaultFlags/BadTabletCopyITest.TestBadCopy/1
2026-08-12T06:37:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:07Z Disabled control of system clock
I20260812 06:37:07.332123 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:45359
--webserver_interface=127.28.69.62
--webserver_port=0
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:45359
--tserver_unresponsive_timeout_ms=5000 with env {}
W20260812 06:37:07.439703  1647 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:07.439908  1647 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:07.439946  1647 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:07.443127  1647 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:07.443183  1647 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:07.443200  1647 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:07.443223  1647 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:07.446967  1647 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:45359
--tserver_unresponsive_timeout_ms=5000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:45359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:07.447988  1647 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:07.449066  1647 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 06:37:07.454599  1647 server_base.cc:1061] running on GCE node
W20260812 06:37:07.454525  1660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:07.454684  1657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:07.454516  1656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:07.455241  1647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:07.456133  1647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:07.457289  1647 hybrid_clock.cc:648] HybridClock initialized: now 1786516627457273 us; error 33 us; skew 500 ppm
I20260812 06:37:07.459051  1647 webserver.cc:533] Webserver started at http://127.28.69.62:35325/ using document root <none> and password file <none>
I20260812 06:37:07.459579  1647 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:07.459637  1647 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:07.459820  1647 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:07.461313  1647 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/instance:
uuid: "33279f4c81234d6e86ca874b7fbaec88"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.461769  1647 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal/instance:
uuid: "33279f4c81234d6e86ca874b7fbaec88"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.464886  1647 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20260812 06:37:07.466991  1672 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:07.467995  1647 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:07.468106  1647 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "33279f4c81234d6e86ca874b7fbaec88"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.468194  1647 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:07.490916  1647 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:07.491671  1647 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:07.491858  1647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:07.499112  1647 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:45359
I20260812 06:37:07.499109  1758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:45359 every 8 connection(s)
I20260812 06:37:07.500145  1647 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:07.503055  1759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:07.508054  1759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap starting.
I20260812 06:37:07.508131 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 1647
I20260812 06:37:07.508266 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal/instance
I20260812 06:37:07.510682  1759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:07.511389  1759 log.cc:826] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:07.512951  1759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: No bootstrap required, opened a new log
I20260812 06:37:07.515491  1759 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:07.515671  1759 raft_consensus.cc:385] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:07.515729  1759 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33279f4c81234d6e86ca874b7fbaec88, State: Initialized, Role: FOLLOWER
I20260812 06:37:07.516119  1759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:07.516281  1759 raft_consensus.cc:399] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:07.516356  1759 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:07.516467  1759 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:07.517405  1759 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:07.517721  1759 leader_election.cc:304] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33279f4c81234d6e86ca874b7fbaec88; no voters: 
I20260812 06:37:07.517971  1759 leader_election.cc:290] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:07.518064  1769 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:07.518270  1769 raft_consensus.cc:697] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 1 LEADER]: Becoming Leader. State: Replica: 33279f4c81234d6e86ca874b7fbaec88, State: Running, Role: LEADER
I20260812 06:37:07.518563  1769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:07.518998  1759 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:07.519968  1773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33279f4c81234d6e86ca874b7fbaec88. Latest consensus state: current_term: 1 leader_uuid: "33279f4c81234d6e86ca874b7fbaec88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } } }
I20260812 06:37:07.520074  1773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:07.520545  1772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33279f4c81234d6e86ca874b7fbaec88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } } }
I20260812 06:37:07.520705  1772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:07.521131  1782 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:07.524091  1782 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:07.528795  1782 catalog_manager.cc:1383] Generated new cluster ID: c304629ce447447bb63251930c3831e9
I20260812 06:37:07.528861  1782 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:07.536183  1782 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:07.536953  1782 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:07.544497  1782 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Generated new TSK 0
I20260812 06:37:07.545045  1782 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:07.549306 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.1:0
--local_ip_for_outbound_sockets=127.28.69.1
--webserver_interface=127.28.69.1
--webserver_port=0
--tserver_master_addrs=127.28.69.62:45359
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
W20260812 06:37:07.654762  1802 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:07.654990  1802 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:07.655050  1802 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 06:37:07.655086  1802 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:07.658411  1802 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:07.658499  1802 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:07.658563  1802 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.1
I20260812 06:37:07.662389  1802 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.69.1
--webserver_port=0
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.1802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:07.663432  1802 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:07.664574  1802 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:07.670835  1812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:07.670852  1811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:07.670851  1815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:07.671314  1802 server_base.cc:1061] running on GCE node
I20260812 06:37:07.671658  1802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:07.672185  1802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:07.673370  1802 hybrid_clock.cc:648] HybridClock initialized: now 1786516627673356 us; error 29 us; skew 500 ppm
I20260812 06:37:07.675186  1802 webserver.cc:533] Webserver started at http://127.28.69.1:46389/ using document root <none> and password file <none>
I20260812 06:37:07.675719  1802 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:07.675788  1802 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:07.675982  1802 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:07.677518  1802 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/instance:
uuid: "eeb870ecb7fc4d3a9badf303402e8b26"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.677963  1802 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance:
uuid: "eeb870ecb7fc4d3a9badf303402e8b26"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.681128  1802 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:07.683225  1825 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:07.684263  1802 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:07.684366  1802 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
uuid: "eeb870ecb7fc4d3a9badf303402e8b26"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.684450  1802 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:07.714601  1802 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:07.715329  1802 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:07.715512  1802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:07.716121  1802 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:07.717268  1802 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:07.717320  1802 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:07.717375  1802 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:07.717398  1802 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:07.726649  1802 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.1:40457
I20260812 06:37:07.726768  2014 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.1:40457 every 8 connection(s)
I20260812 06:37:07.727671  1802 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:07.735875  2015 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:07.736150  2015 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:07.736699  2015 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:07.737103 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 1802
I20260812 06:37:07.737236 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:07.738384  1700 ts_manager.cc:194] Registered new tserver with Master: eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457)
I20260812 06:37:07.739555  1700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.1:36507
I20260812 06:37:07.739629 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.2:0
--local_ip_for_outbound_sockets=127.28.69.2
--webserver_interface=127.28.69.2
--webserver_port=0
--tserver_master_addrs=127.28.69.62:45359
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
W20260812 06:37:07.844164  2019 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:07.844381  2019 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:07.844422  2019 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 06:37:07.844444  2019 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:07.847647  2019 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:07.847723  2019 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:07.847779  2019 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.2
I20260812 06:37:07.851524  2019 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.69.2
--webserver_port=0
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.2019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:07.852578  2019 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:07.853739  2019 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:07.859875  2027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:07.859943  2031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:07.860042  2019 server_base.cc:1061] running on GCE node
W20260812 06:37:07.859918  2028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:07.860461  2019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:07.860956  2019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:07.862123  2019 hybrid_clock.cc:648] HybridClock initialized: now 1786516627862107 us; error 29 us; skew 500 ppm
I20260812 06:37:07.863709  2019 webserver.cc:533] Webserver started at http://127.28.69.2:38329/ using document root <none> and password file <none>
I20260812 06:37:07.864264  2019 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:07.864331  2019 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:07.864507  2019 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:07.866031  2019 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/instance:
uuid: "5abf71a349bf4a0f9cc53eb677c76e14"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.866487  2019 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance:
uuid: "5abf71a349bf4a0f9cc53eb677c76e14"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.869911  2019 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:07.871990  2043 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:07.873102  2019 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:07.873204  2019 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
uuid: "5abf71a349bf4a0f9cc53eb677c76e14"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:07.873292  2019 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:07.892853  2019 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:07.893527  2019 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:07.893689  2019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:07.894224  2019 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:07.895193  2019 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:07.895241  2019 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:07.895290  2019 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:07.895313  2019 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:07.904922  2019 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.2:34071
I20260812 06:37:07.904958  2241 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.2:34071 every 8 connection(s)
I20260812 06:37:07.905910  2019 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:07.906793 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 2019
I20260812 06:37:07.906895 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:07.909497 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.3:0
--local_ip_for_outbound_sockets=127.28.69.3
--webserver_interface=127.28.69.3
--webserver_port=0
--tserver_master_addrs=127.28.69.62:45359
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
I20260812 06:37:07.914636  2242 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:07.914901  2242 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:07.915436  2242 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:07.916481  1700 ts_manager.cc:194] Registered new tserver with Master: 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071)
I20260812 06:37:07.917081  1700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.2:50629
W20260812 06:37:08.016374  2250 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:08.016594  2250 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:08.016654  2250 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 06:37:08.016690  2250 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:08.020087  2250 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:08.020171  2250 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:08.020239  2250 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.3
I20260812 06:37:08.024171  2250 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.69.3
--webserver_port=0
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.2250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:08.025290  2250 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:08.026466  2250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:08.032740  2264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:08.032838  2262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:08.032963  2250 server_base.cc:1061] running on GCE node
W20260812 06:37:08.032833  2268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:08.033440  2250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:08.033936  2250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:08.035099  2250 hybrid_clock.cc:648] HybridClock initialized: now 1786516628035079 us; error 32 us; skew 500 ppm
I20260812 06:37:08.036779  2250 webserver.cc:533] Webserver started at http://127.28.69.3:42603/ using document root <none> and password file <none>
I20260812 06:37:08.037359  2250 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:08.037415  2250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:08.037599  2250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:08.039058  2250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/instance:
uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:08.039499  2250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal/instance:
uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:08.042678  2250 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:37:08.044945  2282 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:08.046085  2250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:08.046182  2250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:08.046288  2250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:08.062687  2250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:08.063371  2250 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:08.063547  2250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:08.064124  2250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:08.065176  2250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:08.065234  2250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:08.065289  2250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:08.065317  2250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:08.074381  2250 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.3:37315
I20260812 06:37:08.074404  2469 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.3:37315 every 8 connection(s)
I20260812 06:37:08.075357  2250 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:08.077306 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 2250
I20260812 06:37:08.077407 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:08.079766 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.4:0
--local_ip_for_outbound_sockets=127.28.69.4
--webserver_interface=127.28.69.4
--webserver_port=0
--tserver_master_addrs=127.28.69.62:45359
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
I20260812 06:37:08.084190  2470 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:08.084470  2470 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:08.085058  2470 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:08.086117  1700 ts_manager.cc:194] Registered new tserver with Master: 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:08.086640  1700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.3:47815
W20260812 06:37:08.185418  2473 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:08.185673  2473 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:08.185741  2473 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 06:37:08.185767  2473 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:08.189072  2473 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:08.189149  2473 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:08.189213  2473 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.4
I20260812 06:37:08.193063  2473 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.69.4
--webserver_port=0
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.2473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:08.194077  2473 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:08.195166  2473 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:08.201586  2482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:08.201761  2473 server_base.cc:1061] running on GCE node
W20260812 06:37:08.201601  2486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:08.201632  2484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:08.202224  2473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:08.202744  2473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:08.203897  2473 hybrid_clock.cc:648] HybridClock initialized: now 1786516628203886 us; error 31 us; skew 500 ppm
I20260812 06:37:08.205655  2473 webserver.cc:533] Webserver started at http://127.28.69.4:42693/ using document root <none> and password file <none>
I20260812 06:37:08.206244  2473 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:08.206303  2473 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:08.206486  2473 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:08.208005  2473 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/instance:
uuid: "840bc222ec4f491aa051a73e4903f520"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:08.208460  2473 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal/instance:
uuid: "840bc222ec4f491aa051a73e4903f520"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:08.211694  2473 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:37:08.213842  2495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:08.214818  2473 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:08.214923  2473 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
uuid: "840bc222ec4f491aa051a73e4903f520"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:08.215008  2473 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:08.225363  2473 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:08.225965  2473 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:08.226131  2473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:08.226666  2473 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:08.227742  2473 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:08.227792  2473 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:08.227829  2473 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:08.227842  2473 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:08.236910  2473 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.4:43241
I20260812 06:37:08.236935  2700 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.4:43241 every 8 connection(s)
I20260812 06:37:08.237890  2473 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
I20260812 06:37:08.246460  2702 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:08.246739  2702 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:08.247320  2702 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:08.247443 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 2473
I20260812 06:37:08.247563 28948 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal/instance
I20260812 06:37:08.248514  1700 ts_manager.cc:194] Registered new tserver with Master: 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241)
I20260812 06:37:08.249272  1700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.4:59449
I20260812 06:37:08.250104 28948 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 06:37:08.258435 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 2473
I20260812 06:37:08.282349 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 1647
I20260812 06:37:08.295792 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:45359
--webserver_interface=127.28.69.62
--webserver_port=35325
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:45359
--tserver_unresponsive_timeout_ms=5000 with env {}
W20260812 06:37:08.403007  2716 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:08.403231  2716 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:08.403290  2716 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:08.406566  2716 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:08.406634  2716 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:08.406659  2716 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:08.406682  2716 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:08.410561  2716 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:45359
--tserver_unresponsive_timeout_ms=5000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:45359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=35325
--never_fsync=true
--heap_profile_path=/tmp/kudu.2716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:08.411728  2716 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:08.412832  2716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:08.418243  2722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:08.418336  2727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:08.418439  2716 server_base.cc:1061] running on GCE node
W20260812 06:37:08.418243  2731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:08.418960  2716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:08.419849  2716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:08.421065  2716 hybrid_clock.cc:648] HybridClock initialized: now 1786516628421058 us; error 32 us; skew 500 ppm
I20260812 06:37:08.422847  2716 webserver.cc:533] Webserver started at http://127.28.69.62:35325/ using document root <none> and password file <none>
I20260812 06:37:08.423398  2716 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:08.423477  2716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:08.426797  2716 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:08.428853  2740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:08.429908  2716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:08.430012  2716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "33279f4c81234d6e86ca874b7fbaec88"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:08.430403  2716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:08.447523  2716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:08.448149  2716 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:08.448325  2716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:08.455628  2841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:45359 every 8 connection(s)
I20260812 06:37:08.455629  2716 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:45359
I20260812 06:37:08.456705  2716 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:08.460655  2844 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:37:08.462184  2844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap starting.
I20260812 06:37:08.462303 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 2716
I20260812 06:37:08.476986  2844 log.cc:826] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:08.483417  2844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:08.483763  2844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap complete.
I20260812 06:37:08.486960  2844 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:08.487284  2844 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33279f4c81234d6e86ca874b7fbaec88, State: Initialized, Role: FOLLOWER
I20260812 06:37:08.487725  2844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:08.487843  2844 raft_consensus.cc:399] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:08.487908  2844 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:08.488014  2844 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:08.489596  2844 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:08.489904  2844 leader_election.cc:304] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33279f4c81234d6e86ca874b7fbaec88; no voters: 
I20260812 06:37:08.490175  2844 leader_election.cc:290] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 06:37:08.490296  2850 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:08.490500  2850 raft_consensus.cc:697] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 2 LEADER]: Becoming Leader. State: Replica: 33279f4c81234d6e86ca874b7fbaec88, State: Running, Role: LEADER
I20260812 06:37:08.490923  2850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:08.491232  2844 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:08.492267  2852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33279f4c81234d6e86ca874b7fbaec88. Latest consensus state: current_term: 2 leader_uuid: "33279f4c81234d6e86ca874b7fbaec88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } } }
I20260812 06:37:08.492396  2852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:08.492636  2851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "33279f4c81234d6e86ca874b7fbaec88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } } }
I20260812 06:37:08.492722  2851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:08.492864  2876 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:08.495283  2876 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:08.495934  2876 catalog_manager.cc:1295] Loaded cluster ID: c304629ce447447bb63251930c3831e9
I20260812 06:37:08.495982  2876 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:08.497602  2876 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:08.498142  2876 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Loaded TSK: 0
I20260812 06:37:08.498859  2876 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:08.741878  2015 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:08.746666  2767 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" instance_seqno: 1786516627724098) as {username='slave'} at 127.28.69.1:59127; Asking this server to re-register.
I20260812 06:37:08.747256  2015 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:08.747462  2015 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:08.748436  2767 ts_manager.cc:194] Registered new tserver with Master: eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457)
I20260812 06:37:08.918917  2242 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:08.923207  2767 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" instance_seqno: 1786516627902520) as {username='slave'} at 127.28.69.2:48691; Asking this server to re-register.
I20260812 06:37:08.923682  2242 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:08.923890  2242 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:08.924525  2767 ts_manager.cc:194] Registered new tserver with Master: 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071)
I20260812 06:37:09.088414  2470 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:09.092386  2767 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" instance_seqno: 1786516628071743) as {username='slave'} at 127.28.69.3:57265; Asking this server to re-register.
I20260812 06:37:09.092906  2470 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:09.093113  2470 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:09.093722  2767 ts_manager.cc:194] Registered new tserver with Master: 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:09.149284  2767 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43428:
name: "table_a"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:09.150761  2767 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table table_a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:09.166663  1904 tablet_service.cc:1511] Processing CreateTablet for tablet 08ccabf80cd448c5b4dd6daa500eab29 (DEFAULT_TABLE table=table_a [id=8dafa06424db448c82a7187443121b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:09.166958  2121 tablet_service.cc:1511] Processing CreateTablet for tablet 08ccabf80cd448c5b4dd6daa500eab29 (DEFAULT_TABLE table=table_a [id=8dafa06424db448c82a7187443121b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:09.167580  1904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ccabf80cd448c5b4dd6daa500eab29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:09.167433  2364 tablet_service.cc:1511] Processing CreateTablet for tablet 08ccabf80cd448c5b4dd6daa500eab29 (DEFAULT_TABLE table=table_a [id=8dafa06424db448c82a7187443121b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:09.167906  2121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ccabf80cd448c5b4dd6daa500eab29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:09.168303  2364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ccabf80cd448c5b4dd6daa500eab29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:09.172602  2914 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Bootstrap starting.
I20260812 06:37:09.173944  2917 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Bootstrap starting.
I20260812 06:37:09.174682  2914 tablet_bootstrap.cc:654] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:09.175336  2914 log.cc:826] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:09.175554  2917 tablet_bootstrap.cc:654] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:09.175957  2915 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Bootstrap starting.
I20260812 06:37:09.176205  2917 log.cc:826] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:09.177874  2915 tablet_bootstrap.cc:654] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:09.178010  2917 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: No bootstrap required, opened a new log
I20260812 06:37:09.178197  2917 ts_tablet_manager.cc:1403] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Time spent bootstrapping tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:09.178218  2914 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: No bootstrap required, opened a new log
I20260812 06:37:09.178385  2914 ts_tablet_manager.cc:1403] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.000s
I20260812 06:37:09.178627  2915 log.cc:826] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:09.180284  2915 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: No bootstrap required, opened a new log
I20260812 06:37:09.180449  2915 ts_tablet_manager.cc:1403] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:37:09.180883  2914 raft_consensus.cc:359] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.181118  2914 raft_consensus.cc:385] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:09.181181  2914 raft_consensus.cc:740] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb870ecb7fc4d3a9badf303402e8b26, State: Initialized, Role: FOLLOWER
I20260812 06:37:09.181126  2917 raft_consensus.cc:359] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.181334  2917 raft_consensus.cc:385] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:09.181396  2917 raft_consensus.cc:740] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abf71a349bf4a0f9cc53eb677c76e14, State: Initialized, Role: FOLLOWER
I20260812 06:37:09.181607  2914 consensus_queue.cc:260] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.181768  2917 consensus_queue.cc:260] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.182449  2914 ts_tablet_manager.cc:1434] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:37:09.182928  2917 ts_tablet_manager.cc:1434] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:09.184415  2915 raft_consensus.cc:359] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.184604  2915 raft_consensus.cc:385] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:09.184725  2915 raft_consensus.cc:740] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1dcd5d40ed4ec187b2d1b53e7b8068, State: Initialized, Role: FOLLOWER
I20260812 06:37:09.185161  2915 consensus_queue.cc:260] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.185992  2915 ts_tablet_manager.cc:1434] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
W20260812 06:37:09.190375  2245 tablet.cc:2406] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:37:09.191054  2471 tablet.cc:2406] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:37:09.191068  2016 tablet.cc:2406] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:09.421092  2926 raft_consensus.cc:493] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:09.421291  2926 raft_consensus.cc:515] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.422425  2926 leader_election.cc:290] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457), 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:09.427361  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ccabf80cd448c5b4dd6daa500eab29" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" is_pre_election: true
I20260812 06:37:09.427362  2396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ccabf80cd448c5b4dd6daa500eab29" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" is_pre_election: true
I20260812 06:37:09.427630  2396 raft_consensus.cc:2468] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 0.
I20260812 06:37:09.427630  1941 raft_consensus.cc:2468] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 0.
I20260812 06:37:09.428081  2049 leader_election.cc:304] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1dcd5d40ed4ec187b2d1b53e7b8068, 5abf71a349bf4a0f9cc53eb677c76e14; no voters: 
I20260812 06:37:09.428323  2926 raft_consensus.cc:2804] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:09.428402  2926 raft_consensus.cc:493] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:09.428444  2926 raft_consensus.cc:3060] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:09.429425  2926 raft_consensus.cc:515] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.429765  2926 leader_election.cc:290] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 1 election: Requested vote from peers eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457), 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:09.430146  1941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ccabf80cd448c5b4dd6daa500eab29" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeb870ecb7fc4d3a9badf303402e8b26"
I20260812 06:37:09.430184  2396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ccabf80cd448c5b4dd6daa500eab29" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068"
I20260812 06:37:09.430275  1941 raft_consensus.cc:3060] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:09.430328  2396 raft_consensus.cc:3060] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:09.431172  1941 raft_consensus.cc:2468] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 1.
I20260812 06:37:09.431182  2396 raft_consensus.cc:2468] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 1.
I20260812 06:37:09.431461  2049 leader_election.cc:304] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5abf71a349bf4a0f9cc53eb677c76e14, eeb870ecb7fc4d3a9badf303402e8b26; no voters: 
I20260812 06:37:09.431627  2926 raft_consensus.cc:2804] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:09.431918  2926 raft_consensus.cc:697] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 LEADER]: Becoming Leader. State: Replica: 5abf71a349bf4a0f9cc53eb677c76e14, State: Running, Role: LEADER
I20260812 06:37:09.432245  2926 consensus_queue.cc:237] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:09.435379  2766 catalog_manager.cc:5719] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2). New cstate: current_term: 1 leader_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:09.449882 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.4:43241
--local_ip_for_outbound_sockets=127.28.69.4
--tserver_master_addrs=127.28.69.62:45359
--webserver_port=42693
--webserver_interface=127.28.69.4
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
W20260812 06:37:09.559365  2935 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:09.559571  2935 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:09.559636  2935 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 06:37:09.559677  2935 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:09.562898  2935 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:09.562988  2935 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:09.563071  2935 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.4
I20260812 06:37:09.566895  2935 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.4:43241
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.69.4
--webserver_port=42693
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.2935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:09.567910  2935 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:09.569031  2935 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:09.575166  2942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.575273  2949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.575176  2944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:09.575474  2935 server_base.cc:1061] running on GCE node
I20260812 06:37:09.575826  2935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:09.576342  2935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:09.577472  2935 hybrid_clock.cc:648] HybridClock initialized: now 1786516629577456 us; error 27 us; skew 500 ppm
I20260812 06:37:09.579299  2935 webserver.cc:533] Webserver started at http://127.28.69.4:42693/ using document root <none> and password file <none>
I20260812 06:37:09.579855  2935 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:09.579931  2935 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:09.583336  2935 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:09.585255  2959 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.586342  2935 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:09.586467  2935 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
uuid: "840bc222ec4f491aa051a73e4903f520"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:09.586899  2935 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:09.601962  2935 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:09.602597  2935 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:09.602790  2935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:09.603363  2935 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:09.604333  2935 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:09.604380  2935 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.604434  2935 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:09.604465  2935 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.613476  2935 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.4:43241
I20260812 06:37:09.613525  3155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.4:43241 every 8 connection(s)
I20260812 06:37:09.614450  2935 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
I20260812 06:37:09.617267 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 2935
I20260812 06:37:09.622721  3156 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:09.622982  3156 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:09.623479  3156 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:09.624502  2766 ts_manager.cc:194] Registered new tserver with Master: 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241)
I20260812 06:37:09.625311  2766 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.4:47423
I20260812 06:37:09.645032 28948 tablet_copy-itest.cc:1499] Blocks diff: 0
I20260812 06:37:09.670815  1941 raft_consensus.cc:1275] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 1 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:09.670873  2396 raft_consensus.cc:1275] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:09.671535  2926 consensus_queue.cc:1048] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:09.671967  2926 consensus_queue.cc:1048] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:09.680990  3185 mvcc.cc:204] Tried to move back new op lower bound from 7317572115134717952 to 7317572114157264896. Current Snapshot: MvccSnapshot[applied={T|T < 7317572115123671040}]
I20260812 06:37:09.683605  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:09.685516  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:09.686738  3183 mvcc.cc:204] Tried to move back new op lower bound from 7317572115131674624 to 7317572114157264896. Current Snapshot: MvccSnapshot[applied={T|T < 7317572115123671040}]
I20260812 06:37:09.695209  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:09.782830  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.098s	user 0.023s	sys 0.000s Metrics: {"bytes_written":7292,"cfile_init":1,"compiler_manager_pool.queue_time_us":11440,"dirs.queue_time_us":35291,"dirs.run_cpu_time_us":203,"dirs.run_wall_time_us":6137,"drs_written":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4,"lbm_write_time_us":580,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":100,"spinlock_wait_cycles":123776,"thread_start_us":202,"threads_started":2}
I20260812 06:37:09.823220  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 903 bytes on disk
I20260812 06:37:09.823982  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4}
I20260812 06:37:09.832226  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.146s	user 0.014s	sys 0.005s Metrics: {"bytes_written":5984,"cfile_init":1,"compiler_manager_pool.queue_time_us":58252,"dirs.queue_time_us":11161,"dirs.run_cpu_time_us":187,"dirs.run_wall_time_us":22412,"drs_written":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1602,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":50,"spinlock_wait_cycles":156032,"thread_start_us":207,"threads_started":2}
I20260812 06:37:09.833148  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:09.853606  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 450 bytes on disk
I20260812 06:37:09.853555  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.158s	user 0.026s	sys 0.000s Metrics: {"bytes_written":11236,"cfile_init":1,"compiler_manager_pool.queue_time_us":268,"dirs.queue_time_us":82367,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":2251,"drs_written":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4,"lbm_write_time_us":625,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":250,"thread_start_us":298,"threads_started":2}
I20260812 06:37:09.854408  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260812 06:37:09.854610  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 2335 bytes on disk
I20260812 06:37:09.859241  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:09.861613  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260812 06:37:09.865154  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:09.971519  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.138s	user 0.031s	sys 0.004s Metrics: {"bytes_written":38281,"cfile_init":1,"dirs.queue_time_us":1082,"dirs.run_cpu_time_us":194,"dirs.run_wall_time_us":1329,"drs_written":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4,"lbm_write_time_us":979,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1300}
I20260812 06:37:09.972630  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.005899
I20260812 06:37:10.066430  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.207s	user 0.037s	sys 0.004s Metrics: {"bytes_written":42208,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":201,"dirs.run_wall_time_us":4081,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":965,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1450}
I20260812 06:37:10.067523  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.094251  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.121s	user 0.039s	sys 0.000s Metrics: {"bytes_written":40872,"cfile_cache_hit":10,"cfile_cache_hit_bytes":25761,"cfile_cache_miss":26,"cfile_cache_miss_bytes":71651,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":7634,"dirs.run_cpu_time_us":170,"dirs.run_wall_time_us":1179,"drs_written":1,"lbm_read_time_us":801,"lbm_reads_lt_1ms":50,"lbm_write_time_us":12373,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":22,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1400,"thread_start_us":302,"threads_started":5}
I20260812 06:37:10.095346  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 12118 bytes on disk
I20260812 06:37:10.097673  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":316,"lbm_reads_lt_1ms":4}
I20260812 06:37:10.098153  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.099745  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.234s	user 0.033s	sys 0.003s Metrics: {"bytes_written":38311,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":205,"dirs.run_wall_time_us":1338,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":640,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1300}
I20260812 06:37:10.100914  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.013365
I20260812 06:37:10.228693  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.130s	user 0.038s	sys 0.003s Metrics: {"bytes_written":47379,"cfile_init":1,"dirs.queue_time_us":6804,"dirs.run_cpu_time_us":176,"dirs.run_wall_time_us":1166,"drs_written":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4,"lbm_write_time_us":537,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1650}
I20260812 06:37:10.229403  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 14248 bytes on disk
I20260812 06:37:10.229866  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4}
I20260812 06:37:10.230413  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014274
I20260812 06:37:10.335770  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.235s	user 0.039s	sys 0.003s Metrics: {"bytes_written":44665,"cfile_cache_hit":10,"cfile_cache_hit_bytes":28501,"cfile_cache_miss":26,"cfile_cache_miss_bytes":79645,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":5366,"dirs.run_cpu_time_us":187,"dirs.run_wall_time_us":1298,"drs_written":1,"lbm_read_time_us":757,"lbm_reads_lt_1ms":50,"lbm_write_time_us":643,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1550,"thread_start_us":285,"threads_started":5}
I20260812 06:37:10.336540  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.377086  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.309s	user 0.035s	sys 0.000s Metrics: {"bytes_written":38281,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":192,"dirs.run_wall_time_us":1294,"drs_written":1,"lbm_read_time_us":45,"lbm_reads_lt_1ms":4,"lbm_write_time_us":542,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1300,"spinlock_wait_cycles":7177088}
I20260812 06:37:10.377753  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 23751 bytes on disk
I20260812 06:37:10.378365  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":105,"lbm_reads_lt_1ms":8}
I20260812 06:37:10.378897  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=2.000228
I20260812 06:37:10.425164  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.195s	user 0.066s	sys 0.000s Metrics: {"bytes_written":87453,"cfile_cache_hit":10,"cfile_cache_hit_bytes":55877,"cfile_cache_miss":26,"cfile_cache_miss_bytes":155309,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":431,"dirs.run_cpu_time_us":175,"dirs.run_wall_time_us":1158,"drs_written":1,"lbm_read_time_us":733,"lbm_reads_lt_1ms":46,"lbm_write_time_us":830,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":3050}
I20260812 06:37:10.426520  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 26817 bytes on disk
I20260812 06:37:10.426914  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20260812 06:37:10.427287  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.435145  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.098s	user 0.067s	sys 0.000s Metrics: {"bytes_written":88340,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":178,"dirs.run_wall_time_us":1217,"drs_written":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4,"lbm_write_time_us":715,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":3100,"spinlock_wait_cycles":384}
I20260812 06:37:10.435819  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014095
I20260812 06:37:10.489552  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.062s	user 0.045s	sys 0.001s Metrics: {"bytes_written":62987,"cfile_init":1,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":165,"dirs.run_wall_time_us":4009,"drs_written":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4,"lbm_write_time_us":661,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2100}
I20260812 06:37:10.490132  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014824
I20260812 06:37:10.566336  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.187s	user 0.062s	sys 0.003s Metrics: {"bytes_written":80973,"cfile_cache_hit":16,"cfile_cache_hit_bytes":56473,"cfile_cache_miss":38,"cfile_cache_miss_bytes":137819,"cfile_init":7,"delta_iterators_relevant":6,"dirs.queue_time_us":2474,"dirs.run_cpu_time_us":332,"dirs.run_wall_time_us":2025,"drs_written":1,"lbm_read_time_us":24850,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":65,"lbm_write_time_us":762,"lbm_writes_lt_1ms":25,"mutex_wait_us":2226,"num_input_rowsets":3,"peak_mem_usage":98304,"rows_written":2800,"thread_start_us":344,"threads_started":5}
I20260812 06:37:10.568221  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.601063  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.165s	user 0.090s	sys 0.000s Metrics: {"bytes_written":133053,"cfile_cache_hit":11,"cfile_cache_hit_bytes":90457,"cfile_cache_miss":27,"cfile_cache_miss_bytes":231583,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":467,"dirs.run_cpu_time_us":142,"dirs.run_wall_time_us":1145,"drs_written":1,"lbm_read_time_us":858,"lbm_reads_lt_1ms":55,"lbm_write_time_us":997,"lbm_writes_lt_1ms":27,"num_input_rowsets":2,"peak_mem_usage":72966,"rows_written":4650}
I20260812 06:37:10.601861  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.615916  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.126s	user 0.094s	sys 0.002s Metrics: {"bytes_written":150332,"cfile_cache_hit":10,"cfile_cache_hit_bytes":94226,"cfile_cache_miss":28,"cfile_cache_miss_bytes":262536,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":3141,"dirs.run_cpu_time_us":370,"dirs.run_wall_time_us":3417,"drs_written":1,"lbm_read_time_us":836,"lbm_reads_lt_1ms":52,"lbm_write_time_us":995,"lbm_writes_lt_1ms":28,"mutex_wait_us":1394,"num_input_rowsets":2,"peak_mem_usage":80041,"rows_written":5150}
I20260812 06:37:10.616464  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 46984 bytes on disk
I20260812 06:37:10.617000  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4}
I20260812 06:37:10.617365  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.627373  3156 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:10.639002  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.037s	user 0.030s	sys 0.000s Metrics: {"bytes_written":42213,"cfile_init":1,"dirs.queue_time_us":551,"dirs.run_cpu_time_us":140,"dirs.run_wall_time_us":2494,"drs_written":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4,"lbm_write_time_us":583,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1450}
I20260812 06:37:10.641111  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.013968
I20260812 06:37:10.659233  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.042s	user 0.022s	sys 0.004s Metrics: {"bytes_written":33182,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":140,"dirs.run_wall_time_us":1505,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":562,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1100}
I20260812 06:37:10.659844  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.013195
I20260812 06:37:10.660471 28948 tablet_copy-itest.cc:1499] Blocks diff: 10
I20260812 06:37:10.718779  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.150s	user 0.060s	sys 0.000s Metrics: {"bytes_written":87480,"cfile_init":1,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":1135,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":741,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":3050}
I20260812 06:37:10.719511  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 51806 bytes on disk
I20260812 06:37:10.720093  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":109,"lbm_reads_lt_1ms":8}
I20260812 06:37:10.720558  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014840
I20260812 06:37:10.783667  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.142s	user 0.107s	sys 0.004s Metrics: {"bytes_written":175405,"cfile_cache_hit":10,"cfile_cache_hit_bytes":112143,"cfile_cache_miss":30,"cfile_cache_miss_bytes":313271,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":150,"dirs.run_wall_time_us":1164,"drs_written":1,"lbm_read_time_us":945,"lbm_reads_lt_1ms":58,"lbm_write_time_us":982,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":95174,"rows_written":6100}
I20260812 06:37:10.784296  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.792594  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.133s	user 0.109s	sys 0.004s Metrics: {"bytes_written":179608,"cfile_cache_hit":10,"cfile_cache_hit_bytes":115379,"cfile_cache_miss":30,"cfile_cache_miss_bytes":321919,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1289,"dirs.run_cpu_time_us":158,"dirs.run_wall_time_us":2179,"drs_written":1,"lbm_read_time_us":891,"lbm_reads_lt_1ms":54,"lbm_write_time_us":1233,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":97809,"rows_written":6250,"spinlock_wait_cycles":12544}
I20260812 06:37:10.793192  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 57433 bytes on disk
I20260812 06:37:10.793774  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260812 06:37:10.794346  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.807969  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.023s	user 0.021s	sys 0.000s Metrics: {"bytes_written":29316,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":148,"dirs.run_wall_time_us":1003,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":549,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":950}
I20260812 06:37:10.808650  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.013484
I20260812 06:37:10.815307  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.021s	user 0.020s	sys 0.000s Metrics: {"bytes_written":25424,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":913,"drs_written":1,"lbm_read_time_us":141,"lbm_reads_lt_1ms":4,"lbm_write_time_us":553,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":800}
I20260812 06:37:10.815908  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 6988 bytes on disk
I20260812 06:37:10.816329  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260812 06:37:10.816776  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.012972
I20260812 06:37:10.860610  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.140s	user 0.103s	sys 0.004s Metrics: {"bytes_written":168939,"cfile_cache_hit":10,"cfile_cache_hit_bytes":107023,"cfile_cache_miss":30,"cfile_cache_miss_bytes":298973,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1262,"dirs.run_cpu_time_us":334,"dirs.run_wall_time_us":2183,"drs_written":1,"lbm_read_time_us":897,"lbm_reads_lt_1ms":50,"lbm_write_time_us":1070,"lbm_writes_lt_1ms":28,"mutex_wait_us":1049,"num_input_rowsets":2,"peak_mem_usage":90521,"rows_written":5850}
I20260812 06:37:10.864320  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.908162  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.041s	user 0.029s	sys 0.000s Metrics: {"bytes_written":39564,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":159,"dirs.run_wall_time_us":1114,"drs_written":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8275,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":1350}
I20260812 06:37:10.908798  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 65227 bytes on disk
I20260812 06:37:10.909341  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":139,"lbm_reads_lt_1ms":8}
I20260812 06:37:10.909754  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.013568
I20260812 06:37:10.952178  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.135s	user 0.126s	sys 0.000s Metrics: {"bytes_written":204752,"cfile_cache_hit":10,"cfile_cache_hit_bytes":131080,"cfile_cache_miss":30,"cfile_cache_miss_bytes":365064,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":209,"dirs.run_cpu_time_us":135,"dirs.run_wall_time_us":1084,"drs_written":1,"lbm_read_time_us":818,"lbm_reads_lt_1ms":50,"lbm_write_time_us":1042,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":110309,"rows_written":7050}
I20260812 06:37:10.952881  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 65321 bytes on disk
I20260812 06:37:10.956640  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4}
I20260812 06:37:10.957166  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:10.974711  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.166s	user 0.125s	sys 0.004s Metrics: {"bytes_written":204752,"cfile_cache_hit":10,"cfile_cache_hit_bytes":130929,"cfile_cache_miss":30,"cfile_cache_miss_bytes":364109,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":220,"dirs.run_cpu_time_us":137,"dirs.run_wall_time_us":1145,"drs_written":1,"lbm_read_time_us":997,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1126,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":110164,"rows_written":7050}
I20260812 06:37:10.975538  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 65321 bytes on disk
I20260812 06:37:10.976122  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260812 06:37:10.976496  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:11.004765  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.040s	user 0.019s	sys 0.000s Metrics: {"bytes_written":25432,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":138,"dirs.run_wall_time_us":1016,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":547,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":800}
I20260812 06:37:11.005474  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 6992 bytes on disk
I20260812 06:37:11.004945  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.028s	user 0.020s	sys 0.000s Metrics: {"bytes_written":25432,"cfile_init":1,"dirs.queue_time_us":96,"dirs.run_cpu_time_us":138,"dirs.run_wall_time_us":1039,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":546,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":800}
I20260812 06:37:11.008535  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014041
I20260812 06:37:11.009239  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.009829  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014041
I20260812 06:37:11.069165  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.159s	user 0.125s	sys 0.002s Metrics: {"bytes_written":208481,"cfile_cache_hit":10,"cfile_cache_hit_bytes":133419,"cfile_cache_miss":30,"cfile_cache_miss_bytes":371279,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":3244,"dirs.run_cpu_time_us":561,"dirs.run_wall_time_us":6669,"drs_written":1,"lbm_read_time_us":938,"lbm_reads_lt_1ms":50,"lbm_write_time_us":1247,"lbm_writes_lt_1ms":30,"mutex_wait_us":2684,"num_input_rowsets":2,"peak_mem_usage":112049,"rows_written":7200}
I20260812 06:37:11.070806  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 66759 bytes on disk
I20260812 06:37:11.072800  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.073222  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:11.115284  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.042s	user 0.025s	sys 0.001s Metrics: {"bytes_written":35723,"cfile_init":1,"dirs.queue_time_us":48,"dirs.run_cpu_time_us":170,"dirs.run_wall_time_us":1338,"drs_written":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9681,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":1200}
I20260812 06:37:11.115859  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014234
I20260812 06:37:11.161901  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.148s	user 0.138s	sys 0.001s Metrics: {"bytes_written":225811,"cfile_cache_hit":10,"cfile_cache_hit_bytes":146502,"cfile_cache_miss":32,"cfile_cache_miss_bytes":407494,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":40,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":1083,"drs_written":1,"lbm_read_time_us":939,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1125,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":122507,"rows_written":7850}
I20260812 06:37:11.162550  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 72852 bytes on disk
I20260812 06:37:11.162982  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.163383  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:11.179864  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.171s	user 0.140s	sys 0.002s Metrics: {"bytes_written":225811,"cfile_cache_hit":10,"cfile_cache_hit_bytes":146502,"cfile_cache_miss":32,"cfile_cache_miss_bytes":407494,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":199,"dirs.run_cpu_time_us":146,"dirs.run_wall_time_us":1207,"drs_written":1,"lbm_read_time_us":1037,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1189,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":122507,"rows_written":7850}
I20260812 06:37:11.180788  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 72852 bytes on disk
I20260812 06:37:11.181335  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.181706  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:11.193549  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.030s	user 0.018s	sys 0.002s Metrics: {"bytes_written":25396,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":550,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":652,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":800}
I20260812 06:37:11.194165  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014483
I20260812 06:37:11.208153  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.026s	user 0.019s	sys 0.001s Metrics: {"bytes_written":26773,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":602,"drs_written":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4,"lbm_write_time_us":581,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":850}
I20260812 06:37:11.208822  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 7425 bytes on disk
I20260812 06:37:11.219408  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.219972  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014485
I20260812 06:37:11.305398  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.189s	user 0.149s	sys 0.004s Metrics: {"bytes_written":240572,"cfile_cache_hit":10,"cfile_cache_hit_bytes":156687,"cfile_cache_miss":32,"cfile_cache_miss_bytes":435081,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":8727,"dirs.run_cpu_time_us":701,"dirs.run_wall_time_us":4588,"drs_written":1,"lbm_read_time_us":997,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1151,"lbm_writes_lt_1ms":30,"mutex_wait_us":8219,"num_input_rowsets":2,"peak_mem_usage":130492,"rows_written":8400}
I20260812 06:37:11.306048  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 78014 bytes on disk
I20260812 06:37:11.306458  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.306847  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:11.330173  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.023s	user 0.021s	sys 0.000s Metrics: {"bytes_written":29342,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":144,"dirs.run_wall_time_us":825,"drs_written":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4,"lbm_write_time_us":578,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":950}
I20260812 06:37:11.330780  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 8297 bytes on disk
I20260812 06:37:11.333381  1835 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.333822  2016 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014106
I20260812 06:37:11.401926  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.182s	user 0.158s	sys 0.004s Metrics: {"bytes_written":252644,"cfile_cache_hit":10,"cfile_cache_hit_bytes":162817,"cfile_cache_miss":32,"cfile_cache_miss_bytes":451909,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":981,"dirs.run_cpu_time_us":300,"dirs.run_wall_time_us":1882,"drs_written":1,"lbm_read_time_us":950,"lbm_reads_lt_1ms":52,"lbm_write_time_us":2889,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":30,"mutex_wait_us":771,"num_input_rowsets":2,"peak_mem_usage":135422,"rows_written":8700}
I20260812 06:37:11.402588  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:11.442209  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.248s	user 0.151s	sys 0.006s Metrics: {"bytes_written":251323,"cfile_cache_hit":10,"cfile_cache_hit_bytes":161902,"cfile_cache_miss":32,"cfile_cache_miss_bytes":449210,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":160,"dirs.run_wall_time_us":1237,"drs_written":1,"lbm_read_time_us":972,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1237,"lbm_writes_lt_1ms":31,"num_input_rowsets":2,"peak_mem_usage":134707,"rows_written":8650}
I20260812 06:37:11.445355  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 80415 bytes on disk
I20260812 06:37:11.445904  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.446311  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:11.451998 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 1802
I20260812 06:37:11.468933  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.066s	user 0.024s	sys 0.000s Metrics: {"bytes_written":33175,"cfile_init":1,"dirs.queue_time_us":167,"dirs.run_cpu_time_us":141,"dirs.run_wall_time_us":1645,"drs_written":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4,"lbm_write_time_us":531,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1100}
I20260812 06:37:11.470415  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.012157
I20260812 06:37:11.477640 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 2716
I20260812 06:37:11.498414 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:45359
--webserver_interface=127.28.69.62
--webserver_port=35325
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:45359
--tserver_unresponsive_timeout_ms=5000 with env {}
I20260812 06:37:11.499877  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.052s	user 0.034s	sys 0.000s Metrics: {"bytes_written":44719,"cfile_init":1,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":158,"dirs.run_wall_time_us":595,"drs_written":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3347,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":1550}
I20260812 06:37:11.500633  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.012272
I20260812 06:37:11.600828  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.130s	user 0.118s	sys 0.004s Metrics: {"bytes_written":281489,"cfile_cache_hit":10,"cfile_cache_hit_bytes":183738,"cfile_cache_miss":32,"cfile_cache_miss_bytes":509720,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":416,"dirs.run_cpu_time_us":223,"dirs.run_wall_time_us":1296,"drs_written":1,"lbm_read_time_us":964,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1320,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":151942,"rows_written":9800}
I20260812 06:37:11.601419  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:11.610677  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.009s	user 0.008s	sys 0.000s Metrics: {"bytes_written":15084,"cfile_init":1,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":135,"dirs.run_wall_time_us":622,"drs_written":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":473,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":400}
I20260812 06:37:11.611184  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.005137
W20260812 06:37:11.630954  3156 heartbeater.cc:646] Failed to heartbeat to 127.28.69.62:45359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.69.62:45359: connect: Connection refused (error 111)
W20260812 06:37:11.649302  3275 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:11.649581  3275 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:11.649655  3275 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:11.654173  3275 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:11.654258  3275 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:11.654289  3275 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:11.654341  3275 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:11.659502  3275 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:45359
--tserver_unresponsive_timeout_ms=5000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:45359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=35325
--never_fsync=true
--heap_profile_path=/tmp/kudu.3275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:11.660790  3275 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:11.662173  3275 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:11.668339  3289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:11.668330  3284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:11.668933  3287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:11.669221  3275 server_base.cc:1061] running on GCE node
I20260812 06:37:11.669756  3275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:11.670789  3275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:11.671952  3275 hybrid_clock.cc:648] HybridClock initialized: now 1786516631671936 us; error 31 us; skew 500 ppm
I20260812 06:37:11.674103  3275 webserver.cc:533] Webserver started at http://127.28.69.62:35325/ using document root <none> and password file <none>
I20260812 06:37:11.674762  3275 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:11.674837  3275 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:11.679077  3275 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:11.681368  3307 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:11.682687  3275 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 06:37:11.682809  3275 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "33279f4c81234d6e86ca874b7fbaec88"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:11.683300  3275 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 06:37:11.688546  2242 heartbeater.cc:646] Failed to heartbeat to 127.28.69.62:45359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.69.62:45359: connect: Connection refused (error 111)
W20260812 06:37:11.689242  2470 heartbeater.cc:646] Failed to heartbeat to 127.28.69.62:45359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.69.62:45359: connect: Connection refused (error 111)
I20260812 06:37:11.697265  3275 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:11.698062  3275 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:11.698271  3275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:11.707803  3275 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:45359
I20260812 06:37:11.707823  3401 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:45359 every 8 connection(s)
I20260812 06:37:11.709290  3275 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:11.711923 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 3275
I20260812 06:37:11.715191  3403 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:37:11.717671  3403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap starting.
I20260812 06:37:11.722767  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.222s	user 0.221s	sys 0.000s Metrics: {"bytes_written":292303,"cfile_cache_hit":10,"cfile_cache_hit_bytes":190993,"cfile_cache_miss":32,"cfile_cache_miss_bytes":529579,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":346,"dirs.run_cpu_time_us":194,"dirs.run_wall_time_us":1196,"drs_written":1,"lbm_read_time_us":1073,"lbm_reads_lt_1ms":56,"lbm_write_time_us":1710,"lbm_writes_lt_1ms":32,"mutex_wait_us":18,"num_input_rowsets":2,"peak_mem_usage":157597,"rows_written":10200,"spinlock_wait_cycles":1920}
I20260812 06:37:11.723425  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 95593 bytes on disk
I20260812 06:37:11.724272  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.735996  3403 log.cc:826] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:11.745483  3403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:11.745929  3403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap complete.
I20260812 06:37:11.750609  3403 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:11.751070  3403 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33279f4c81234d6e86ca874b7fbaec88, State: Initialized, Role: FOLLOWER
I20260812 06:37:11.751591  3403 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:11.751742  3403 raft_consensus.cc:399] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:11.751807  3403 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:11.751910  3403 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:11.754088  3403 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:11.754451  3403 leader_election.cc:304] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33279f4c81234d6e86ca874b7fbaec88; no voters: 
I20260812 06:37:11.754813  3403 leader_election.cc:290] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [CANDIDATE]: Term 3 election: Requested vote from peers 
I20260812 06:37:11.754951  3411 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:37:11.755184  3411 raft_consensus.cc:697] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 3 LEADER]: Becoming Leader. State: Replica: 33279f4c81234d6e86ca874b7fbaec88, State: Running, Role: LEADER
I20260812 06:37:11.755515  3411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:11.756047  3403 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:11.756165  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.145s	user 0.136s	sys 0.008s Metrics: {"bytes_written":292303,"cfile_cache_hit":10,"cfile_cache_hit_bytes":192160,"cfile_cache_miss":34,"cfile_cache_miss_bytes":532634,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":362,"dirs.run_cpu_time_us":133,"dirs.run_wall_time_us":1043,"drs_written":1,"lbm_read_time_us":983,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1488,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":158740,"rows_written":10200}
I20260812 06:37:11.756717  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 95593 bytes on disk
I20260812 06:37:11.757256  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4}
I20260812 06:37:11.757558  3414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "33279f4c81234d6e86ca874b7fbaec88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } } }
I20260812 06:37:11.757680  3414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:11.758416  3436 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:11.758616  3420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33279f4c81234d6e86ca874b7fbaec88. Latest consensus state: current_term: 3 leader_uuid: "33279f4c81234d6e86ca874b7fbaec88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } } }
I20260812 06:37:11.758934  3420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:11.761677  3436 catalog_manager.cc:679] Loaded metadata for table table_a [id=8dafa06424db448c82a7187443121b5f]
I20260812 06:37:11.762811  3436 tablet_loader.cc:96] loaded metadata for tablet 08ccabf80cd448c5b4dd6daa500eab29 (table table_a [id=8dafa06424db448c82a7187443121b5f])
I20260812 06:37:11.762946  3436 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:11.763465  3436 catalog_manager.cc:1295] Loaded cluster ID: c304629ce447447bb63251930c3831e9
I20260812 06:37:11.763520  3436 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:11.765143  3436 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:11.765774  3436 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Loaded TSK: 0
I20260812 06:37:11.766537  3436 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 06:37:11.824716  2049 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111)
W20260812 06:37:11.825757  2049 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): Couldn't send request to peer eeb870ecb7fc4d3a9badf303402e8b26. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:12.347515  2242 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:12.349293  3343 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" instance_seqno: 1786516627902520) as {username='slave'} at 127.28.69.2:50471; Asking this server to re-register.
I20260812 06:37:12.349841  2242 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:12.350014  2242 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:12.351172  3343 ts_manager.cc:194] Registered new tserver with Master: 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071)
I20260812 06:37:12.635622  3156 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:12.636402  3343 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "840bc222ec4f491aa051a73e4903f520" instance_seqno: 1786516629611090) as {username='slave'} at 127.28.69.4:54345; Asking this server to re-register.
I20260812 06:37:12.636839  3156 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:12.636997  3156 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:12.637670  3343 ts_manager.cc:194] Registered new tserver with Master: 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241)
I20260812 06:37:12.693907  2470 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:12.694857  3343 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" instance_seqno: 1786516628071743) as {username='slave'} at 127.28.69.3:37889; Asking this server to re-register.
I20260812 06:37:12.695313  2470 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:12.695502  2470 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:12.696314  3343 ts_manager.cc:194] Registered new tserver with Master: 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:12.712765  3343 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39576:
name: "table_b"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:12.714684  3343 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table table_b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:12.727823  2121 tablet_service.cc:1511] Processing CreateTablet for tablet 49beb6b453a447d0a20b44ad461f6e60 (DEFAULT_TABLE table=table_b [id=10564aea886d4610b6b763d862c7a261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:12.728159  2121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49beb6b453a447d0a20b44ad461f6e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:12.729568  2364 tablet_service.cc:1511] Processing CreateTablet for tablet 49beb6b453a447d0a20b44ad461f6e60 (DEFAULT_TABLE table=table_b [id=10564aea886d4610b6b763d862c7a261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:12.729882  2364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49beb6b453a447d0a20b44ad461f6e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:12.730322  3495 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Bootstrap starting.
I20260812 06:37:12.731061  3495 tablet_bootstrap.cc:654] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:12.730805  3053 tablet_service.cc:1511] Processing CreateTablet for tablet 49beb6b453a447d0a20b44ad461f6e60 (DEFAULT_TABLE table=table_b [id=10564aea886d4610b6b763d862c7a261]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:12.731842  3053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49beb6b453a447d0a20b44ad461f6e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:12.732087  3495 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: No bootstrap required, opened a new log
I20260812 06:37:12.732177  3495 ts_tablet_manager.cc:1403] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:12.732771  3497 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Bootstrap starting.
I20260812 06:37:12.732903  3495 raft_consensus.cc:359] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:12.733034  3495 raft_consensus.cc:385] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:12.733074  3495 raft_consensus.cc:740] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abf71a349bf4a0f9cc53eb677c76e14, State: Initialized, Role: FOLLOWER
I20260812 06:37:12.733211  3495 consensus_queue.cc:260] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:12.733484  3495 ts_tablet_manager.cc:1434] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:12.733659  3497 tablet_bootstrap.cc:654] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:12.734786  3497 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: No bootstrap required, opened a new log
I20260812 06:37:12.734879  3497 ts_tablet_manager.cc:1403] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:12.735361  3497 raft_consensus.cc:359] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:12.735469  3497 raft_consensus.cc:385] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:12.735508  3497 raft_consensus.cc:740] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1dcd5d40ed4ec187b2d1b53e7b8068, State: Initialized, Role: FOLLOWER
I20260812 06:37:12.735649  3497 consensus_queue.cc:260] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:12.736023  3497 ts_tablet_manager.cc:1434] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:12.738401  3501 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Bootstrap starting.
I20260812 06:37:12.740161  3501 tablet_bootstrap.cc:654] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:12.740821  3501 log.cc:826] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:12.742286  3501 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: No bootstrap required, opened a new log
I20260812 06:37:12.742463  3501 ts_tablet_manager.cc:1403] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 06:37:12.744989  3501 raft_consensus.cc:359] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:12.745218  3501 raft_consensus.cc:385] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:12.745280  3501 raft_consensus.cc:740] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840bc222ec4f491aa051a73e4903f520, State: Initialized, Role: FOLLOWER
I20260812 06:37:12.745685  3501 consensus_queue.cc:260] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:12.746405  3501 ts_tablet_manager.cc:1434] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.004s
W20260812 06:37:12.755271  3158 tablet.cc:2406] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:13.081120  3504 raft_consensus.cc:493] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:13.081364  3504 raft_consensus.cc:515] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:13.082548  3504 leader_election.cc:290] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071), 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:13.086493  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49beb6b453a447d0a20b44ad461f6e60" candidate_uuid: "840bc222ec4f491aa051a73e4903f520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" is_pre_election: true
I20260812 06:37:13.086762  2159 raft_consensus.cc:2468] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 840bc222ec4f491aa051a73e4903f520 in term 0.
I20260812 06:37:13.086771  2396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49beb6b453a447d0a20b44ad461f6e60" candidate_uuid: "840bc222ec4f491aa051a73e4903f520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" is_pre_election: true
I20260812 06:37:13.086913  2396 raft_consensus.cc:2468] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 840bc222ec4f491aa051a73e4903f520 in term 0.
I20260812 06:37:13.087175  2965 leader_election.cc:304] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5abf71a349bf4a0f9cc53eb677c76e14, 840bc222ec4f491aa051a73e4903f520; no voters: 
I20260812 06:37:13.087421  3504 raft_consensus.cc:2804] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:13.087500  3504 raft_consensus.cc:493] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:13.087531  3504 raft_consensus.cc:3060] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:13.088613  3504 raft_consensus.cc:515] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:13.088987  3504 leader_election.cc:290] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [CANDIDATE]: Term 1 election: Requested vote from peers 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071), 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:13.089378  2159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49beb6b453a447d0a20b44ad461f6e60" candidate_uuid: "840bc222ec4f491aa051a73e4903f520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5abf71a349bf4a0f9cc53eb677c76e14"
I20260812 06:37:13.089452  2396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49beb6b453a447d0a20b44ad461f6e60" candidate_uuid: "840bc222ec4f491aa051a73e4903f520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068"
I20260812 06:37:13.089495  2159 raft_consensus.cc:3060] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:13.089581  2396 raft_consensus.cc:3060] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:13.090358  2159 raft_consensus.cc:2468] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 840bc222ec4f491aa051a73e4903f520 in term 1.
I20260812 06:37:13.090521  2396 raft_consensus.cc:2468] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 840bc222ec4f491aa051a73e4903f520 in term 1.
I20260812 06:37:13.090626  2965 leader_election.cc:304] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5abf71a349bf4a0f9cc53eb677c76e14, 840bc222ec4f491aa051a73e4903f520; no voters: 
I20260812 06:37:13.090809  3504 raft_consensus.cc:2804] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:13.091087  3504 raft_consensus.cc:697] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 1 LEADER]: Becoming Leader. State: Replica: 840bc222ec4f491aa051a73e4903f520, State: Running, Role: LEADER
I20260812 06:37:13.091428  3504 consensus_queue.cc:237] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:13.094678  3342 catalog_manager.cc:5719] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 reported cstate change: term changed from 0 to 1, leader changed from <none> to 840bc222ec4f491aa051a73e4903f520 (127.28.69.4). New cstate: current_term: 1 leader_uuid: "840bc222ec4f491aa051a73e4903f520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:13.173862 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.1:40457
--local_ip_for_outbound_sockets=127.28.69.1
--tserver_master_addrs=127.28.69.62:45359
--webserver_port=46389
--webserver_interface=127.28.69.1
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0 with env {}
W20260812 06:37:13.281920  3510 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:13.282135  3510 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:13.282198  3510 flags.cc:432] Enabled unsafe flag: --tablet_copy_early_session_timeout_prob=1
W20260812 06:37:13.282238  3510 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:13.285539  3510 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:13.285627  3510 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:13.285704  3510 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.1
I20260812 06:37:13.289556  3510 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.1:40457
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.69.1
--webserver_port=46389
--flush_threshold_mb=0
--tablet_copy_early_session_timeout_prob=1
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.3510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:13.290733  3510 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:13.292009  3510 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:13.298645  3527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:13.298635  3520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:13.298666  3524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:13.298985  3510 server_base.cc:1061] running on GCE node
I20260812 06:37:13.299335  3510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:13.299863  3510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:13.301043  3510 hybrid_clock.cc:648] HybridClock initialized: now 1786516633301024 us; error 28 us; skew 500 ppm
I20260812 06:37:13.302902  3510 webserver.cc:533] Webserver started at http://127.28.69.1:46389/ using document root <none> and password file <none>
I20260812 06:37:13.303460  3510 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:13.303530  3510 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:13.307085  3510 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:13.312449  3544 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:13.313448  3510 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.000s
I20260812 06:37:13.313565  3510 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
uuid: "eeb870ecb7fc4d3a9badf303402e8b26"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:13.313973  3510 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/data
Total live blocks: 10
Total live bytes: 356225
Total live bytes (after alignment): 380928
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:13.334372  3510 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:13.335091  3510 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:13.335289  3510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:13.335948  3510 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:13.337316  3559 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:13.341446  3510 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:13.341511  3510 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:37:13.341590  3510 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:13.343067  3510 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:13.343112  3510 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:37:13.343478  3559 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Bootstrap starting.
I20260812 06:37:13.353062  3510 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.1:40457
I20260812 06:37:13.353137  3737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.1:40457 every 8 connection(s)
I20260812 06:37:13.354043  3510 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:13.361588 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 3510
I20260812 06:37:13.362970  3738 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:13.363224  3738 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:13.363812  3738 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:13.365603  3342 ts_manager.cc:194] Registered new tserver with Master: eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457)
I20260812 06:37:13.366854  3342 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.1:37343
I20260812 06:37:13.381716 28948 tablet_copy-itest.cc:1499] Blocks diff: 0
I20260812 06:37:13.383970  3559 log.cc:826] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:13.410579  2396 raft_consensus.cc:1275] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Refusing update from remote peer 840bc222ec4f491aa051a73e4903f520: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:13.411571  2159 raft_consensus.cc:1275] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Refusing update from remote peer 840bc222ec4f491aa051a73e4903f520: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:13.412479  3504 consensus_queue.cc:1048] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:13.413071  3504 consensus_queue.cc:1048] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:13.422482  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.435657  3766 mvcc.cc:204] Tried to move back new op lower bound from 7317572130456948736 to 7317572129144967168. Current Snapshot: MvccSnapshot[applied={T|T < 7317572130444070912}]
I20260812 06:37:13.467720  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.499791  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.032s	user 0.010s	sys 0.000s Metrics: {"bytes_written":8586,"cfile_init":1,"drs_written":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4,"lbm_write_time_us":592,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":150,"spinlock_wait_cycles":134912,"thread_start_us":152,"threads_started":1}
I20260812 06:37:13.500468  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 1379 bytes on disk
I20260812 06:37:13.505103  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20260812 06:37:13.505573  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.527609  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.537124  3559 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=204 ignored=187} inserts{seen=800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:37:13.537700  3559 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Bootstrap complete.
I20260812 06:37:13.539117  3559 ts_tablet_manager.cc:1403] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Time spent bootstrapping tablet: real 0.196s	user 0.155s	sys 0.024s
I20260812 06:37:13.541724  3559 raft_consensus.cc:359] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:13.543466  3559 raft_consensus.cc:740] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb870ecb7fc4d3a9badf303402e8b26, State: Initialized, Role: FOLLOWER
I20260812 06:37:13.544031  3559 consensus_queue.cc:260] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 204, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:13.544927  3559 ts_tablet_manager.cc:1434] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260812 06:37:13.545334  3738 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:13.553787  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 86311 bytes on disk
I20260812 06:37:13.554899  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":129,"lbm_reads_lt_1ms":8}
I20260812 06:37:13.555982  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.014106
I20260812 06:37:13.608628  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.103s	user 0.008s	sys 0.000s Metrics: {"bytes_written":8587,"cfile_init":1,"dirs.queue_time_us":61849,"dirs.run_cpu_time_us":168,"dirs.run_wall_time_us":1049,"drs_written":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4,"lbm_write_time_us":635,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":150}
I20260812 06:37:13.609362  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 1379 bytes on disk
I20260812 06:37:13.618979  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.194s	user 0.022s	sys 0.006s Metrics: {"bytes_written":9876,"cfile_init":1,"compiler_manager_pool.queue_time_us":24632,"dirs.queue_time_us":7024,"dirs.run_cpu_time_us":222,"dirs.run_wall_time_us":2155,"drs_written":1,"lbm_read_time_us":797,"lbm_reads_lt_1ms":4,"lbm_write_time_us":713,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":200,"spinlock_wait_cycles":131968,"thread_start_us":284,"threads_started":2}
I20260812 06:37:13.619958  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4}
I20260812 06:37:13.620112  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 1844 bytes on disk
I20260812 06:37:13.620524  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.013168
I20260812 06:37:13.620764  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
I20260812 06:37:13.621177  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.639492  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.112s	user 0.008s	sys 0.000s Metrics: {"bytes_written":9876,"cfile_init":1,"dirs.queue_time_us":24852,"dirs.run_cpu_time_us":222,"dirs.run_wall_time_us":820,"drs_written":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4,"lbm_write_time_us":626,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":200,"spinlock_wait_cycles":308864,"thread_start_us":131,"threads_started":1}
I20260812 06:37:13.640153  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.654476  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.034s	user 0.015s	sys 0.000s Metrics: {"bytes_written":12526,"cfile_cache_hit":10,"cfile_cache_hit_bytes":5690,"cfile_cache_miss":26,"cfile_cache_miss_bytes":16132,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":12433,"dirs.run_cpu_time_us":302,"dirs.run_wall_time_us":1769,"drs_written":1,"lbm_read_time_us":570,"lbm_reads_lt_1ms":46,"lbm_write_time_us":486,"lbm_writes_lt_1ms":23,"mutex_wait_us":113,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":300,"thread_start_us":357,"threads_started":5}
I20260812 06:37:13.655364  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 2732 bytes on disk
I20260812 06:37:13.655927  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20260812 06:37:13.656399  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.686911  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.066s	user 0.035s	sys 0.000s Metrics: {"bytes_written":39540,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":204,"dirs.run_wall_time_us":1215,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":635,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1350}
I20260812 06:37:13.687880  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 11701 bytes on disk
I20260812 06:37:13.688303  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260812 06:37:13.688755  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.008490
I20260812 06:37:13.700278  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.044s	user 0.021s	sys 0.000s Metrics: {"bytes_written":29361,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":1170,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":683,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":950}
I20260812 06:37:13.707410  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.010202
I20260812 06:37:13.764215  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.124s	user 0.029s	sys 0.000s Metrics: {"bytes_written":39540,"cfile_init":1,"dirs.queue_time_us":49,"dirs.run_cpu_time_us":190,"dirs.run_wall_time_us":1257,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":682,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1350}
I20260812 06:37:13.764876  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 13545 bytes on disk
I20260812 06:37:13.765445  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":113,"lbm_reads_lt_1ms":8}
I20260812 06:37:13.768980  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.008490
I20260812 06:37:13.777815  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.089s	user 0.040s	sys 0.000s Metrics: {"bytes_written":44681,"cfile_cache_hit":10,"cfile_cache_hit_bytes":28501,"cfile_cache_miss":26,"cfile_cache_miss_bytes":79377,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":78,"dirs.run_cpu_time_us":149,"dirs.run_wall_time_us":992,"drs_written":1,"lbm_read_time_us":715,"lbm_reads_lt_1ms":46,"lbm_write_time_us":5165,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1550,"thread_start_us":395,"threads_started":5}
I20260812 06:37:13.778355  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.778681  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.071s	user 0.032s	sys 0.000s Metrics: {"bytes_written":37121,"cfile_cache_hit":10,"cfile_cache_hit_bytes":23027,"cfile_cache_miss":26,"cfile_cache_miss_bytes":64657,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":2064,"dirs.run_cpu_time_us":660,"dirs.run_wall_time_us":5516,"drs_written":1,"lbm_read_time_us":680,"lbm_reads_lt_1ms":50,"lbm_write_time_us":637,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1250}
I20260812 06:37:13.779342  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.798288  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.019s	user 0.010s	sys 0.000s Metrics: {"bytes_written":12543,"cfile_init":1,"dirs.queue_time_us":1994,"dirs.run_cpu_time_us":150,"dirs.run_wall_time_us":1102,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":508,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":300}
I20260812 06:37:13.800038  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 13574 bytes on disk
I20260812 06:37:13.800588  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":102,"lbm_reads_lt_1ms":8}
I20260812 06:37:13.801162  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.004236
I20260812 06:37:13.818682  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.040s	user 0.027s	sys 0.000s Metrics: {"bytes_written":29344,"cfile_init":1,"dirs.queue_time_us":211,"dirs.run_cpu_time_us":162,"dirs.run_wall_time_us":1056,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4289,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":950}
I20260812 06:37:13.819289  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.013165
I20260812 06:37:13.838748  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.070s	user 0.033s	sys 0.002s Metrics: {"bytes_written":44681,"cfile_cache_hit":10,"cfile_cache_hit_bytes":28501,"cfile_cache_miss":26,"cfile_cache_miss_bytes":79377,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":96,"dirs.run_cpu_time_us":147,"dirs.run_wall_time_us":919,"drs_written":1,"lbm_read_time_us":612,"lbm_reads_lt_1ms":46,"lbm_write_time_us":676,"lbm_writes_lt_1ms":23,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1550,"thread_start_us":284,"threads_started":5}
I20260812 06:37:13.840345  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.889391  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.080s	user 0.035s	sys 0.002s Metrics: {"bytes_written":44681,"cfile_cache_hit":10,"cfile_cache_hit_bytes":28502,"cfile_cache_miss":26,"cfile_cache_miss_bytes":79928,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":11202,"dirs.run_cpu_time_us":429,"dirs.run_wall_time_us":2802,"drs_written":1,"lbm_read_time_us":831,"lbm_reads_lt_1ms":46,"lbm_write_time_us":634,"lbm_writes_lt_1ms":23,"mutex_wait_us":103,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":1550}
I20260812 06:37:13.890265  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 13410 bytes on disk
I20260812 06:37:13.891912  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20260812 06:37:13.892416  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.893234  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.053s	user 0.025s	sys 0.001s Metrics: {"bytes_written":34540,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":162,"dirs.run_wall_time_us":1015,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":560,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1150}
I20260812 06:37:13.893836  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.012923
I20260812 06:37:13.914009  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.358s	user 0.183s	sys 0.004s Metrics: {"bytes_written":269843,"cfile_cache_hit":10,"cfile_cache_hit_bytes":175228,"cfile_cache_miss":32,"cfile_cache_miss_bytes":486224,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":15149,"dirs.run_cpu_time_us":200,"dirs.run_wall_time_us":1480,"drs_written":1,"lbm_read_time_us":11670,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":51,"lbm_write_time_us":1509,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":145232,"rows_written":9350,"thread_start_us":466,"threads_started":7,"wal-append.queue_time_us":6892}
I20260812 06:37:13.916318  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:13.921075  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.102s	user 0.053s	sys 0.000s Metrics: {"bytes_written":73141,"cfile_cache_hit":10,"cfile_cache_hit_bytes":45842,"cfile_cache_miss":26,"cfile_cache_miss_bytes":127522,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":142,"dirs.run_wall_time_us":889,"drs_written":1,"lbm_read_time_us":785,"lbm_reads_lt_1ms":54,"lbm_write_time_us":817,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2500}
I20260812 06:37:13.921581  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 21925 bytes on disk
I20260812 06:37:13.921939  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260812 06:37:13.922300  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:13.930956  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.038s	user 0.014s	sys 0.000s Metrics: {"bytes_written":17720,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":913,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":578,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":500}
I20260812 06:37:13.933382  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.010972
I20260812 06:37:13.955152  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.033s	user 0.017s	sys 0.000s Metrics: {"bytes_written":19000,"cfile_init":1,"dirs.queue_time_us":8640,"dirs.run_cpu_time_us":159,"dirs.run_wall_time_us":936,"drs_written":1,"lbm_read_time_us":44,"lbm_reads_lt_1ms":4,"lbm_write_time_us":509,"lbm_writes_lt_1ms":23,"mutex_wait_us":8593,"peak_mem_usage":0,"rows_written":550}
I20260812 06:37:13.955718  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 4863 bytes on disk
I20260812 06:37:13.962013  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.005s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20260812 06:37:13.962558  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.012058
I20260812 06:37:13.998924  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.082s	user 0.024s	sys 0.000s Metrics: {"bytes_written":25390,"cfile_init":1,"compiler_manager_pool.queue_time_us":7496,"dirs.queue_time_us":12328,"dirs.run_cpu_time_us":161,"dirs.run_wall_time_us":715,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":573,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":800,"thread_start_us":326,"threads_started":1}
I20260812 06:37:14.005187  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.111s	user 0.054s	sys 0.000s Metrics: {"bytes_written":78263,"cfile_cache_hit":10,"cfile_cache_hit_bytes":49492,"cfile_cache_miss":26,"cfile_cache_miss_bytes":137664,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":10453,"dirs.run_cpu_time_us":152,"dirs.run_wall_time_us":1499,"drs_written":1,"lbm_read_time_us":762,"lbm_reads_lt_1ms":54,"lbm_write_time_us":676,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2700}
I20260812 06:37:14.005609  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.009936
I20260812 06:37:14.005821  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 23757 bytes on disk
I20260812 06:37:14.006182  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.006587  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.038247  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.032s	user 0.014s	sys 0.000s Metrics: {"bytes_written":19007,"cfile_init":1,"dirs.queue_time_us":33,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":1584,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":510,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":550}
I20260812 06:37:14.038893  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 4853 bytes on disk
I20260812 06:37:14.039286  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.041450  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.009701
I20260812 06:37:14.050727  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.088s	user 0.061s	sys 0.000s Metrics: {"bytes_written":87498,"cfile_cache_hit":10,"cfile_cache_hit_bytes":55900,"cfile_cache_miss":28,"cfile_cache_miss_bytes":155676,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":265,"dirs.run_cpu_time_us":174,"dirs.run_wall_time_us":1156,"drs_written":1,"lbm_read_time_us":741,"lbm_reads_lt_1ms":48,"lbm_write_time_us":748,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":3050}
I20260812 06:37:14.051301  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 26846 bytes on disk
I20260812 06:37:14.051803  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.052203  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.072551  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.020s	user 0.012s	sys 0.000s Metrics: {"bytes_written":12541,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":914,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":505,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":300}
I20260812 06:37:14.073199  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.005379
I20260812 06:37:14.095418  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.162s	user 0.047s	sys 0.000s Metrics: {"bytes_written":61608,"cfile_cache_hit":10,"cfile_cache_hit_bytes":37627,"cfile_cache_miss":26,"cfile_cache_miss_bytes":104889,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":12028,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":753,"drs_written":1,"lbm_read_time_us":15897,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":48,"lbm_write_time_us":700,"lbm_writes_lt_1ms":24,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2050}
I20260812 06:37:14.098570  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 17748 bytes on disk
I20260812 06:37:14.099215  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.099664  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.158807  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.051s	user 0.018s	sys 0.001s Metrics: {"bytes_written":24197,"cfile_init":1,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":141,"dirs.run_wall_time_us":918,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":554,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":750}
I20260812 06:37:14.159448  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.012625
I20260812 06:37:14.169325  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.096s	user 0.065s	sys 0.000s Metrics: {"bytes_written":94859,"cfile_cache_hit":10,"cfile_cache_hit_bytes":61375,"cfile_cache_miss":28,"cfile_cache_miss_bytes":171575,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":165,"dirs.run_wall_time_us":1126,"drs_written":1,"lbm_read_time_us":746,"lbm_reads_lt_1ms":52,"lbm_write_time_us":715,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":3350}
I20260812 06:37:14.170138  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 29478 bytes on disk
I20260812 06:37:14.170552  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.170969  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.172109  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.131s	user 0.062s	sys 0.000s Metrics: {"bytes_written":92453,"cfile_cache_hit":10,"cfile_cache_hit_bytes":59550,"cfile_cache_miss":28,"cfile_cache_miss_bytes":165928,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":506,"dirs.run_cpu_time_us":164,"dirs.run_wall_time_us":1120,"drs_written":1,"lbm_read_time_us":727,"lbm_reads_lt_1ms":48,"lbm_write_time_us":710,"lbm_writes_lt_1ms":25,"mutex_wait_us":205,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":3250}
I20260812 06:37:14.172632  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 28607 bytes on disk
I20260812 06:37:14.173036  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.173436  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.189132  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.018s	user 0.012s	sys 0.000s Metrics: {"bytes_written":12535,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":144,"dirs.run_wall_time_us":958,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":530,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":300}
I20260812 06:37:14.189724  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.012268
I20260812 06:37:14.205278  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.032s	user 0.012s	sys 0.000s Metrics: {"bytes_written":15068,"cfile_init":1,"dirs.queue_time_us":9167,"dirs.run_cpu_time_us":137,"dirs.run_wall_time_us":907,"drs_written":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4,"lbm_write_time_us":485,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":400,"spinlock_wait_cycles":158976}
I20260812 06:37:14.208338  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 3584 bytes on disk
I20260812 06:37:14.210505  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.211073  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.012346
I20260812 06:37:14.280611  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.091s	user 0.066s	sys 0.000s Metrics: {"bytes_written":106556,"cfile_cache_hit":10,"cfile_cache_hit_bytes":66850,"cfile_cache_miss":28,"cfile_cache_miss_bytes":186088,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":6203,"dirs.run_cpu_time_us":318,"dirs.run_wall_time_us":1763,"drs_written":1,"lbm_read_time_us":704,"lbm_reads_lt_1ms":52,"lbm_write_time_us":884,"lbm_writes_lt_1ms":26,"mutex_wait_us":5914,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":3650}
I20260812 06:37:14.282027  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 32172 bytes on disk
I20260812 06:37:14.283936  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.284382  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.302832  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.018s	user 0.011s	sys 0.000s Metrics: {"bytes_written":15090,"cfile_init":1,"dirs.queue_time_us":601,"dirs.run_cpu_time_us":148,"dirs.run_wall_time_us":3720,"drs_written":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4,"lbm_write_time_us":513,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":400,"spinlock_wait_cycles":3328}
I20260812 06:37:14.307649  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.005116
I20260812 06:37:14.307997  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.146s	user 0.055s	sys 0.002s Metrics: {"bytes_written":80993,"cfile_cache_hit":11,"cfile_cache_hit_bytes":58292,"cfile_cache_miss":25,"cfile_cache_miss_bytes":135594,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":202,"dirs.run_cpu_time_us":389,"dirs.run_wall_time_us":2562,"drs_written":1,"lbm_read_time_us":694,"lbm_reads_lt_1ms":49,"lbm_write_time_us":905,"lbm_writes_lt_1ms":25,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":2800}
I20260812 06:37:14.308911  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 24639 bytes on disk
I20260812 06:37:14.326522  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.327092  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.382520  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.171s	user 0.070s	sys 0.000s Metrics: {"bytes_written":106556,"cfile_cache_hit":10,"cfile_cache_hit_bytes":66850,"cfile_cache_miss":28,"cfile_cache_miss_bytes":186292,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":216,"dirs.run_cpu_time_us":652,"dirs.run_wall_time_us":4501,"drs_written":1,"lbm_read_time_us":722,"lbm_reads_lt_1ms":48,"lbm_write_time_us":787,"lbm_writes_lt_1ms":26,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":3650}
I20260812 06:37:14.383529  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.393966 28948 tablet_copy-itest.cc:1499] Blocks diff: 5
I20260812 06:37:14.494737  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.187s	user 0.076s	sys 0.002s Metrics: {"bytes_written":116787,"cfile_cache_hit":10,"cfile_cache_hit_bytes":74150,"cfile_cache_miss":28,"cfile_cache_miss_bytes":206108,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":244,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":1271,"drs_written":1,"lbm_read_time_us":834,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1510,"lbm_writes_lt_1ms":26,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":4050}
I20260812 06:37:14.495527  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 35667 bytes on disk
I20260812 06:37:14.495999  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.496433  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.523528  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.137s	user 0.023s	sys 0.000s Metrics: {"bytes_written":30625,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":155,"dirs.run_wall_time_us":1179,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":585,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1000}
I20260812 06:37:14.524264  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014859
I20260812 06:37:14.524647  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.519s	user 0.190s	sys 0.000s Metrics: {"bytes_written":290915,"cfile_cache_hit":10,"cfile_cache_hit_bytes":190800,"cfile_cache_miss":34,"cfile_cache_miss_bytes":529548,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":3593,"dirs.run_cpu_time_us":314,"dirs.run_wall_time_us":2504,"drs_written":1,"lbm_read_time_us":1396,"lbm_reads_lt_1ms":62,"lbm_write_time_us":9102,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"num_input_rowsets":2,"peak_mem_usage":157575,"rows_written":10150,"thread_start_us":261,"threads_started":5}
I20260812 06:37:14.525199  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 95134 bytes on disk
I20260812 06:37:14.529037  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":126,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.529505  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=1.000000
I20260812 06:37:14.540550  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: FlushMRSOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.011s	user 0.001s	sys 0.004s Metrics: {"bytes_written":5984,"cfile_init":1,"dirs.queue_time_us":1510,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":574,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":441,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":50}
I20260812 06:37:14.541455  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 450 bytes on disk
I20260812 06:37:14.541919  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.544904  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29): perf score=0.997812
I20260812 06:37:14.555083  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.058s	user 0.025s	sys 0.001s Metrics: {"bytes_written":34505,"cfile_init":1,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":144,"dirs.run_wall_time_us":999,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":546,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1150}
I20260812 06:37:14.555739  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014852
I20260812 06:37:14.590549  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.263s	user 0.029s	sys 0.004s Metrics: {"bytes_written":43336,"cfile_init":1,"dirs.queue_time_us":74,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":992,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":640,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1500}
I20260812 06:37:14.591219  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014471
I20260812 06:37:14.661761  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.106s	user 0.098s	sys 0.000s Metrics: {"bytes_written":151783,"cfile_cache_hit":10,"cfile_cache_hit_bytes":95140,"cfile_cache_miss":28,"cfile_cache_miss_bytes":264416,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1550,"dirs.run_cpu_time_us":164,"dirs.run_wall_time_us":1357,"drs_written":1,"lbm_read_time_us":775,"lbm_reads_lt_1ms":52,"lbm_write_time_us":936,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":81756,"rows_written":5200}
I20260812 06:37:14.662591  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 47019 bytes on disk
I20260812 06:37:14.664428  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.665093  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.686722  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.021s	user 0.020s	sys 0.000s Metrics: {"bytes_written":28006,"cfile_init":1,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":146,"dirs.run_wall_time_us":1142,"drs_written":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4,"lbm_write_time_us":543,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":900}
I20260812 06:37:14.687408  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014343
I20260812 06:37:14.752328  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.134s	user 0.082s	sys 0.002s Metrics: {"bytes_written":123757,"cfile_cache_hit":10,"cfile_cache_hit_bytes":78710,"cfile_cache_miss":28,"cfile_cache_miss_bytes":218858,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":222,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":2491,"drs_written":1,"lbm_read_time_us":758,"lbm_reads_lt_1ms":52,"lbm_write_time_us":872,"lbm_writes_lt_1ms":26,"num_input_rowsets":2,"peak_mem_usage":68747,"rows_written":4300}
I20260812 06:37:14.752969  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 37984 bytes on disk
I20260812 06:37:14.758395  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.758924  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.816820  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: CompactRowSetsOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.272s	user 0.177s	sys 0.004s Metrics: {"bytes_written":292303,"cfile_cache_hit":10,"cfile_cache_hit_bytes":192514,"cfile_cache_miss":34,"cfile_cache_miss_bytes":533232,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":212,"dirs.run_cpu_time_us":336,"dirs.run_wall_time_us":1740,"drs_written":1,"lbm_read_time_us":1069,"lbm_reads_lt_1ms":54,"lbm_write_time_us":5233,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"num_input_rowsets":2,"peak_mem_usage":157681,"rows_written":10200}
I20260812 06:37:14.817442  3741 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 95593 bytes on disk
I20260812 06:37:14.817898  3552 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.830328  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.143s	user 0.110s	sys 0.001s Metrics: {"bytes_written":175429,"cfile_cache_hit":10,"cfile_cache_hit_bytes":112689,"cfile_cache_miss":30,"cfile_cache_miss_bytes":313803,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":197,"dirs.run_cpu_time_us":158,"dirs.run_wall_time_us":1274,"drs_written":1,"lbm_read_time_us":921,"lbm_reads_lt_1ms":54,"lbm_write_time_us":990,"lbm_writes_lt_1ms":28,"num_input_rowsets":2,"peak_mem_usage":95724,"rows_written":6100}
I20260812 06:37:14.831146  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 55606 bytes on disk
I20260812 06:37:14.831736  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.832120  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.855252  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.311s	user 0.084s	sys 0.004s Metrics: {"bytes_written":133097,"cfile_cache_hit":10,"cfile_cache_hit_bytes":85100,"cfile_cache_miss":28,"cfile_cache_miss_bytes":236534,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":155,"dirs.run_wall_time_us":981,"drs_written":1,"lbm_read_time_us":878,"lbm_reads_lt_1ms":56,"lbm_write_time_us":920,"lbm_writes_lt_1ms":27,"num_input_rowsets":2,"peak_mem_usage":73516,"rows_written":4650}
I20260812 06:37:14.855861  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 41658 bytes on disk
I20260812 06:37:14.856503  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.856921  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:14.861965  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.030s	user 0.017s	sys 0.002s Metrics: {"bytes_written":24186,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":1862,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":562,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":750}
I20260812 06:37:14.862579  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.008305
I20260812 06:37:14.865509  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.106s	user 0.047s	sys 0.000s Metrics: {"bytes_written":64338,"cfile_init":1,"dirs.queue_time_us":40,"dirs.run_cpu_time_us":157,"dirs.run_wall_time_us":1128,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":710,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2150}
I20260812 06:37:14.868954  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014770
I20260812 06:37:14.917073  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.060s	user 0.045s	sys 0.004s Metrics: {"bytes_written":68198,"cfile_init":1,"dirs.queue_time_us":40,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":1244,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1068,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2300}
I20260812 06:37:14.917899  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 19889 bytes on disk
I20260812 06:37:14.934942  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4}
I20260812 06:37:14.940208  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014462
I20260812 06:37:15.074622  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.212s	user 0.126s	sys 0.000s Metrics: {"bytes_written":199498,"cfile_cache_hit":10,"cfile_cache_hit_bytes":127279,"cfile_cache_miss":30,"cfile_cache_miss_bytes":353519,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1555,"dirs.run_cpu_time_us":185,"dirs.run_wall_time_us":3367,"drs_written":1,"lbm_read_time_us":1284,"lbm_reads_lt_1ms":54,"lbm_write_time_us":1255,"lbm_writes_lt_1ms":30,"num_input_rowsets":2,"peak_mem_usage":107314,"rows_written":6850}
I20260812 06:37:15.075147  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:15.161530  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.085s	user 0.029s	sys 0.001s Metrics: {"bytes_written":39581,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":148,"dirs.run_wall_time_us":1075,"drs_written":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2932,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":1350}
I20260812 06:37:15.162213  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 74903 bytes on disk
I20260812 06:37:15.162776  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":108,"lbm_reads_lt_1ms":8}
I20260812 06:37:15.164227  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014885
I20260812 06:37:15.180143  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.240s	user 0.119s	sys 0.008s Metrics: {"bytes_written":202211,"cfile_cache_hit":10,"cfile_cache_hit_bytes":127654,"cfile_cache_miss":30,"cfile_cache_miss_bytes":355274,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":2725,"dirs.run_cpu_time_us":700,"dirs.run_wall_time_us":7094,"drs_written":1,"lbm_read_time_us":963,"lbm_reads_lt_1ms":50,"lbm_write_time_us":1405,"lbm_writes_lt_1ms":30,"mutex_wait_us":2282,"num_input_rowsets":2,"peak_mem_usage":107296,"rows_written":6950}
I20260812 06:37:15.180725  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:15.232612  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.049s	user 0.037s	sys 0.000s Metrics: {"bytes_written":56602,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":160,"dirs.run_wall_time_us":1016,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":787,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":1850}
I20260812 06:37:15.233245  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014869
I20260812 06:37:15.242592  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.372s	user 0.118s	sys 0.003s Metrics: {"bytes_written":184848,"cfile_cache_hit":10,"cfile_cache_hit_bytes":118157,"cfile_cache_miss":28,"cfile_cache_miss_bytes":328529,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":12202,"dirs.run_cpu_time_us":501,"dirs.run_wall_time_us":6884,"drs_written":1,"lbm_read_time_us":4584,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":51,"lbm_write_time_us":5155,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":27,"mutex_wait_us":11333,"num_input_rowsets":2,"peak_mem_usage":99816,"rows_written":6450}
I20260812 06:37:15.244108  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 58967 bytes on disk
I20260812 06:37:15.246774  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260812 06:37:15.247285  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:15.388458  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.134s	user 0.066s	sys 0.000s Metrics: {"bytes_written":78204,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":185,"dirs.run_wall_time_us":1143,"drs_written":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4,"lbm_write_time_us":896,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":2700}
I20260812 06:37:15.389132  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 23757 bytes on disk
I20260812 06:37:15.391175  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4}
I20260812 06:37:15.391719  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014852
I20260812 06:37:15.407356 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 3510
I20260812 06:37:15.417223  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.253s	user 0.150s	sys 0.005s Metrics: {"bytes_written":235206,"cfile_cache_hit":10,"cfile_cache_hit_bytes":152692,"cfile_cache_miss":32,"cfile_cache_miss_bytes":424274,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":2757,"dirs.run_cpu_time_us":551,"dirs.run_wall_time_us":3093,"drs_written":1,"lbm_read_time_us":940,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1262,"lbm_writes_lt_1ms":30,"mutex_wait_us":809,"num_input_rowsets":2,"peak_mem_usage":127297,"rows_written":8200}
I20260812 06:37:15.417922  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:15.456382  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.220s	user 0.146s	sys 0.004s Metrics: {"bytes_written":255201,"cfile_cache_hit":10,"cfile_cache_hit_bytes":163742,"cfile_cache_miss":32,"cfile_cache_miss_bytes":455286,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":440,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":1039,"drs_written":1,"lbm_read_time_us":13754,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":59,"lbm_write_time_us":1240,"lbm_writes_lt_1ms":32,"mutex_wait_us":126,"num_input_rowsets":2,"peak_mem_usage":135947,"rows_written":8800,"spinlock_wait_cycles":896}
I20260812 06:37:15.457062  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 81963 bytes on disk
I20260812 06:37:15.457490  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4}
I20260812 06:37:15.458014  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:15.471354  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.053s	user 0.051s	sys 0.000s Metrics: {"bytes_written":61670,"cfile_init":1,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":522,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":727,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"rows_written":2050}
I20260812 06:37:15.472114  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014734
I20260812 06:37:15.484519  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.026s	user 0.023s	sys 0.000s Metrics: {"bytes_written":42256,"cfile_init":1,"dirs.queue_time_us":59,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":707,"drs_written":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":400,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1450}
I20260812 06:37:15.485284  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014694
I20260812 06:37:15.590020  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.198s	user 0.185s	sys 0.004s Metrics: {"bytes_written":264526,"cfile_cache_hit":10,"cfile_cache_hit_bytes":169628,"cfile_cache_miss":32,"cfile_cache_miss_bytes":470926,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":373,"dirs.run_cpu_time_us":158,"dirs.run_wall_time_us":1139,"drs_written":1,"lbm_read_time_us":1147,"lbm_reads_lt_1ms":52,"lbm_write_time_us":1545,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":140839,"rows_written":9150,"thread_start_us":166,"threads_started":3}
I20260812 06:37:15.590695  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.000000
I20260812 06:37:15.617295  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: FlushMRSOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.026s	user 0.026s	sys 0.000s Metrics: {"bytes_written":33161,"cfile_init":1,"dirs.queue_time_us":62,"dirs.run_cpu_time_us":140,"dirs.run_wall_time_us":761,"drs_written":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4,"lbm_write_time_us":557,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1100}
I20260812 06:37:15.617961  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60): perf score=1.014686
I20260812 06:37:15.618463  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.133s	user 0.132s	sys 0.000s Metrics: {"bytes_written":293471,"cfile_cache_hit":10,"cfile_cache_hit_bytes":192075,"cfile_cache_miss":34,"cfile_cache_miss_bytes":532667,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":252,"dirs.run_cpu_time_us":216,"dirs.run_wall_time_us":1223,"drs_written":1,"lbm_read_time_us":970,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1237,"lbm_writes_lt_1ms":32,"num_input_rowsets":2,"peak_mem_usage":157941,"rows_written":10250}
I20260812 06:37:15.618968  2245 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 96076 bytes on disk
I20260812 06:37:15.619423  2053 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20260812 06:37:15.645640  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.173s	user 0.169s	sys 0.004s Metrics: {"bytes_written":293471,"cfile_cache_hit":10,"cfile_cache_hit_bytes":191453,"cfile_cache_miss":32,"cfile_cache_miss_bytes":530857,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":539,"dirs.run_cpu_time_us":148,"dirs.run_wall_time_us":942,"drs_written":1,"lbm_read_time_us":978,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1509,"lbm_writes_lt_1ms":32,"mutex_wait_us":37,"num_input_rowsets":2,"peak_mem_usage":157857,"rows_written":10250,"thread_start_us":104,"threads_started":1}
I20260812 06:37:15.646224  3158 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 96076 bytes on disk
I20260812 06:37:15.646590  2970 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4}
I20260812 06:37:15.741901  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: CompactRowSetsOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.124s	user 0.119s	sys 0.004s Metrics: {"bytes_written":293471,"cfile_cache_hit":10,"cfile_cache_hit_bytes":192425,"cfile_cache_miss":34,"cfile_cache_miss_bytes":534183,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":543,"dirs.run_cpu_time_us":194,"dirs.run_wall_time_us":1137,"drs_written":1,"lbm_read_time_us":943,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1482,"lbm_writes_lt_1ms":32,"mutex_wait_us":42,"num_input_rowsets":2,"peak_mem_usage":158800,"rows_written":10250,"spinlock_wait_cycles":29312}
I20260812 06:37:15.742537  2471 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 96076 bytes on disk
I20260812 06:37:15.742936  2287 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4}
W20260812 06:37:15.823226  2049 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): Couldn't send request to peer eeb870ecb7fc4d3a9badf303402e8b26. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:17.194644  2049 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260812 06:37:18.115059  2049 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): Couldn't send request to peer eeb870ecb7fc4d3a9badf303402e8b26. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 06:37:20.613600  2049 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): Couldn't send request to peer eeb870ecb7fc4d3a9badf303402e8b26. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 06:37:22.520424  2049 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20260812 06:37:22.907248  2049 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): Couldn't send request to peer eeb870ecb7fc4d3a9badf303402e8b26. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 06:37:25.454406  3909 consensus_queue.cc:579] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Leader has been unable to successfully communicate with peer eeb870ecb7fc4d3a9badf303402e8b26 for more than 10 seconds (10.076s)
W20260812 06:37:25.456194  2049 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): Couldn't send request to peer eeb870ecb7fc4d3a9badf303402e8b26. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260812 06:37:25.458231  2159 consensus_queue.cc:237] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 205, Committed index: 205, Last appended: 1.205, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:25.460103  2395 raft_consensus.cc:1275] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 1 index: 206. (index mismatch)
I20260812 06:37:25.460667  3937 consensus_queue.cc:1048] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
W20260812 06:37:25.461184  2049 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): Couldn't send request to peer eeb870ecb7fc4d3a9badf303402e8b26. Status: Network error: Client connection negotiation failed: client connection to 127.28.69.1:40457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:25.462726  3935 raft_consensus.cc:2955] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 LEADER]: Committing config change with OpId 1.206: config changed from index -1 to 206, NON_VOTER 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } } }
I20260812 06:37:25.463209  2395 raft_consensus.cc:2955] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Committing config change with OpId 1.206: config changed from index -1 to 206, NON_VOTER 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } } }
W20260812 06:37:25.464103  2044 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): Couldn't send request to peer 840bc222ec4f491aa051a73e4903f520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08ccabf80cd448c5b4dd6daa500eab29. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:25.464819  3317 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 08ccabf80cd448c5b4dd6daa500eab29 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260812 06:37:25.465948  3340 catalog_manager.cc:5719] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 reported cstate change: config changed from index -1 to 206, NON_VOTER 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) added. New cstate: current_term: 1 leader_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" committed_config { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } } }
I20260812 06:37:26.083671  3963 ts_tablet_manager.cc:933] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Initiating tablet copy from peer 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071)
I20260812 06:37:26.084117  3963 tablet_copy_client.cc:323] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.2:34071
I20260812 06:37:26.084954  2196 tablet_copy_service.cc:140] P 5abf71a349bf4a0f9cc53eb677c76e14: Received BeginTabletCopySession request for tablet 08ccabf80cd448c5b4dd6daa500eab29 from peer 840bc222ec4f491aa051a73e4903f520 ({username='slave'} at 127.28.69.4:45023)
I20260812 06:37:26.085134  2196 tablet_copy_service.cc:161] P 5abf71a349bf4a0f9cc53eb677c76e14: Beginning new tablet copy session on tablet 08ccabf80cd448c5b4dd6daa500eab29 from peer 840bc222ec4f491aa051a73e4903f520 at {username='slave'} at 127.28.69.4:45023: session id = 840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29
I20260812 06:37:26.086826  2196 tablet_copy_source_session.cc:215] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Tablet Copy: opened 5 blocks and 1 log segments
W20260812 06:37:26.087294  2196 tablet_copy_service.cc:227] P 5abf71a349bf4a0f9cc53eb677c76e14: Timing out tablet copy session due to flag --tablet_copy_early_session_timeout_prob being set to 1
I20260812 06:37:26.087416  2196 tablet_copy_service.cc:434] P 5abf71a349bf4a0f9cc53eb677c76e14: ending tablet copy session 840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29 on tablet 08ccabf80cd448c5b4dd6daa500eab29 with peer 840bc222ec4f491aa051a73e4903f520
I20260812 06:37:26.088945  3963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ccabf80cd448c5b4dd6daa500eab29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:26.091104  3963 tablet_copy_client.cc:806] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet copy: Starting download of 5 data blocks...
W20260812 06:37:26.092247  2196 tablet_copy_service.cc:479] P 5abf71a349bf4a0f9cc53eb677c76e14: Error handling TabletCopyService RPC request from {username='slave'} at 127.28.69.4:45023: No such session: Not found: Tablet Copy session with Session ID "840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29" not found
W20260812 06:37:26.094372  3963 ts_tablet_manager.cc:1011] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Tablet Copy: Unable to fetch data from remote peer 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): Remote error: Unable to download block with id 12740282859802967860: Unable to download block 12740282859802967860: unable to fetch data from remote: No such session: NO_SESSION: received error code Not found: Tablet Copy session with Session ID "840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29" not found from remote service
I20260812 06:37:26.094470  3963 tablet_replica.cc:333] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: stopping tablet replica
I20260812 06:37:26.094547  3963 raft_consensus.cc:2243] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [term 1 LEARNER]: Raft consensus shutting down.
I20260812 06:37:26.094609  3963 raft_consensus.cc:2272] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [term 1 LEARNER]: Raft consensus is shut down!
I20260812 06:37:26.095214  2196 tablet_copy_service.cc:342] P 5abf71a349bf4a0f9cc53eb677c76e14: Request end of tablet copy session 840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29 received from {username='slave'} at 127.28.69.4:45023
W20260812 06:37:26.095306  2196 tablet_copy_service.cc:479] P 5abf71a349bf4a0f9cc53eb677c76e14: Error handling TabletCopyService RPC request from {username='slave'} at 127.28.69.4:45023: No such session: Not found: Tablet Copy session with Session ID "840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29" not found
W20260812 06:37:26.095683  3963 tablet_copy_client.cc:1130] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet copy: Unable to close tablet copy session: Remote error: failure ending tablet copy session: No such session: NO_SESSION: received error code Not found: Tablet Copy session with Session ID "840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29" not found from remote service
W20260812 06:37:26.096287  3963 tablet_metadata.cc:474] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 08ccabf80cd448c5b4dd6daa500eab29 but one is already registered
I20260812 06:37:26.096407  3963 ts_tablet_manager.cc:1916] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:26.098601  3963 ts_tablet_manager.cc:1929] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20260812 06:37:26.481663 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 2019
I20260812 06:37:26.499842 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 2250
I20260812 06:37:26.511772 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 2935
I20260812 06:37:26.525569 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 3275
I20260812 06:37:26.539911 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:45359
--webserver_interface=127.28.69.62
--webserver_port=35325
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.69.62:45359
--tserver_unresponsive_timeout_ms=5000 with env {}
W20260812 06:37:26.644236  3970 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:26.644464  3970 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:26.644521  3970 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:26.647871  3970 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:26.647933  3970 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:26.647956  3970 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:26.647981  3970 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:26.651767  3970 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.69.62:45359
--tserver_unresponsive_timeout_ms=5000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.69.62:45359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.69.62
--webserver_port=35325
--never_fsync=true
--heap_profile_path=/tmp/kudu.3970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:26.652895  3970 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:26.654028  3970 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:26.659350  3979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:26.659358  3978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:26.659572  3983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:26.660087  3970 server_base.cc:1061] running on GCE node
I20260812 06:37:26.660548  3970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:26.661464  3970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:26.662611  3970 hybrid_clock.cc:648] HybridClock initialized: now 1786516646662585 us; error 40 us; skew 500 ppm
I20260812 06:37:26.664247  3970 webserver.cc:533] Webserver started at http://127.28.69.62:35325/ using document root <none> and password file <none>
I20260812 06:37:26.664776  3970 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:26.664839  3970 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:26.668033  3970 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:26.669838  4001 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:26.670758  3970 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:26.670873  3970 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
uuid: "33279f4c81234d6e86ca874b7fbaec88"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:26.671236  3970 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:26.692054  3970 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:26.692778  3970 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:26.692970  3970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:26.700603  3970 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.62:45359
I20260812 06:37:26.700613  4081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.62:45359 every 8 connection(s)
I20260812 06:37:26.701753  3970 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:26.705729  4083 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:37:26.706490 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 3970
I20260812 06:37:26.706934 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.1:40457
--local_ip_for_outbound_sockets=127.28.69.1
--tserver_master_addrs=127.28.69.62:45359
--webserver_port=46389
--webserver_interface=127.28.69.1
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0
--tablet_copy_early_session_timeout_prob=0.0 with env {}
I20260812 06:37:26.707396  4083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap starting.
I20260812 06:37:26.726154  4083 log.cc:826] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:26.738176  4083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=7 ignored=0} mutations{seen=5 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:26.738610  4083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Bootstrap complete.
I20260812 06:37:26.743233  4083 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:26.743628  4083 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33279f4c81234d6e86ca874b7fbaec88, State: Initialized, Role: FOLLOWER
I20260812 06:37:26.744189  4083 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 3.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:26.744329  4083 raft_consensus.cc:399] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:26.744413  4083 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:26.744520  4083 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:26.746376  4083 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:26.746726  4083 leader_election.cc:304] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33279f4c81234d6e86ca874b7fbaec88; no voters: 
I20260812 06:37:26.747040  4083 leader_election.cc:290] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [CANDIDATE]: Term 4 election: Requested vote from peers 
I20260812 06:37:26.747175  4091 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 06:37:26.747416  4091 raft_consensus.cc:697] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [term 4 LEADER]: Becoming Leader. State: Replica: 33279f4c81234d6e86ca874b7fbaec88, State: Running, Role: LEADER
I20260812 06:37:26.747757  4091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 3.13, Last appended by leader: 13, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } }
I20260812 06:37:26.748147  4083 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:26.749125  4094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 leader_uuid: "33279f4c81234d6e86ca874b7fbaec88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } } }
I20260812 06:37:26.749125  4095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33279f4c81234d6e86ca874b7fbaec88. Latest consensus state: current_term: 4 leader_uuid: "33279f4c81234d6e86ca874b7fbaec88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33279f4c81234d6e86ca874b7fbaec88" member_type: VOTER last_known_addr { host: "127.28.69.62" port: 45359 } } }
I20260812 06:37:26.749270  4095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:26.749270  4094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:26.749737  4114 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:26.753456  4114 catalog_manager.cc:679] Loaded metadata for table table_b [id=10564aea886d4610b6b763d862c7a261]
I20260812 06:37:26.753811  4114 catalog_manager.cc:679] Loaded metadata for table table_a [id=8dafa06424db448c82a7187443121b5f]
I20260812 06:37:26.755189  4114 tablet_loader.cc:96] loaded metadata for tablet 08ccabf80cd448c5b4dd6daa500eab29 (table table_a [id=8dafa06424db448c82a7187443121b5f])
I20260812 06:37:26.755522  4114 tablet_loader.cc:96] loaded metadata for tablet 49beb6b453a447d0a20b44ad461f6e60 (table table_b [id=10564aea886d4610b6b763d862c7a261])
I20260812 06:37:26.755661  4114 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:26.756392  4114 catalog_manager.cc:1295] Loaded cluster ID: c304629ce447447bb63251930c3831e9
I20260812 06:37:26.756459  4114 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:26.758867  4114 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:26.759625  4114 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 33279f4c81234d6e86ca874b7fbaec88: Loaded TSK: 0
I20260812 06:37:26.760555  4114 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 06:37:26.825980  4087 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:26.826201  4087 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:26.826265  4087 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:26.829682  4087 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:26.829773  4087 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:26.829849  4087 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.1
I20260812 06:37:26.833724  4087 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.1:40457
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.69.1
--webserver_port=46389
--flush_threshold_mb=0
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.4087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:26.834790  4087 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:26.835894  4087 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:26.842020  4137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:26.842065  4130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:26.842010  4134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:26.842439  4087 server_base.cc:1061] running on GCE node
I20260812 06:37:26.842754  4087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:26.843231  4087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:26.844406  4087 hybrid_clock.cc:648] HybridClock initialized: now 1786516646844388 us; error 34 us; skew 500 ppm
I20260812 06:37:26.846130  4087 webserver.cc:533] Webserver started at http://127.28.69.1:46389/ using document root <none> and password file <none>
I20260812 06:37:26.846679  4087 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:26.846750  4087 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:26.850198  4087 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:26.856357  4160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:26.857306  4087 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.000s
I20260812 06:37:26.857400  4087 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
uuid: "eeb870ecb7fc4d3a9badf303402e8b26"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:26.857787  4087 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/data
Total live blocks: 5
Total live bytes: 387896
Total live bytes (after alignment): 401408
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:26.873952  4087 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:26.874601  4087 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:26.874773  4087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:26.875377  4087 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:26.876681  4174 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:26.880566  4087 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:26.880623  4087 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:37:26.880669  4087 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:26.882105  4087 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:26.882164  4087 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:37:26.882488  4174 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Bootstrap starting.
I20260812 06:37:26.893230  4087 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.1:40457
I20260812 06:37:26.893442  4349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.1:40457 every 8 connection(s)
I20260812 06:37:26.894492  4087 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:26.895233 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 4087
I20260812 06:37:26.895736 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.2:34071
--local_ip_for_outbound_sockets=127.28.69.2
--tserver_master_addrs=127.28.69.62:45359
--webserver_port=38329
--webserver_interface=127.28.69.2
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0
--tablet_copy_early_session_timeout_prob=0.0 with env {}
I20260812 06:37:26.910794  4350 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:26.911064  4350 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:26.911749  4350 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:26.914669  4024 ts_manager.cc:194] Registered new tserver with Master: eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457)
I20260812 06:37:26.917371  4024 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.1:45255
I20260812 06:37:26.926342  4174 log.cc:826] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:27.008446  4174 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Bootstrap replayed 1/1 log segments. Stats: ops{read=205 overwritten=0 applied=205 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:27.008836  4174 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Bootstrap complete.
I20260812 06:37:27.009861  4174 ts_tablet_manager.cc:1403] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Time spent bootstrapping tablet: real 0.128s	user 0.114s	sys 0.012s
I20260812 06:37:27.012041  4174 raft_consensus.cc:359] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:27.012383  4174 raft_consensus.cc:740] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeb870ecb7fc4d3a9badf303402e8b26, State: Initialized, Role: FOLLOWER
I20260812 06:37:27.012840  4174 consensus_queue.cc:260] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 205, Last appended: 1.205, Last appended by leader: 205, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:27.013597  4350 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:27.013777  4174 ts_tablet_manager.cc:1434] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
W20260812 06:37:27.015173  4359 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:27.015419  4359 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:27.015558  4359 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260812 06:37:27.017706  4355 maintenance_manager.cc:419] P eeb870ecb7fc4d3a9badf303402e8b26: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 95593 bytes on disk
I20260812 06:37:27.018723  4171 maintenance_manager.cc:643] P eeb870ecb7fc4d3a9badf303402e8b26: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":89,"lbm_reads_lt_1ms":4}
W20260812 06:37:27.019555  4359 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:27.019634  4359 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:27.019713  4359 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.2
I20260812 06:37:27.023633  4359 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.2:34071
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.69.2
--webserver_port=38329
--flush_threshold_mb=0
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.4359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:27.024652  4359 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:27.025794  4359 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:27.032243  4373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:27.032253  4374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:27.032313  4381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:27.032424  4359 server_base.cc:1061] running on GCE node
I20260812 06:37:27.032868  4359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:27.033458  4359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:27.034611  4359 hybrid_clock.cc:648] HybridClock initialized: now 1786516647034598 us; error 30 us; skew 500 ppm
I20260812 06:37:27.036248  4359 webserver.cc:533] Webserver started at http://127.28.69.2:38329/ using document root <none> and password file <none>
I20260812 06:37:27.036806  4359 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:27.036888  4359 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:27.040215  4359 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:37:27.045871  4400 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:27.046707  4359 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.000s
I20260812 06:37:27.046823  4359 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
uuid: "5abf71a349bf4a0f9cc53eb677c76e14"
format_stamp: "Formatted at 2026-08-12 06:37:07 on dist-test-slave-k5rr"
I20260812 06:37:27.047183  4359 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/data
Total live blocks: 10
Total live bytes: 777443
Total live bytes (after alignment): 802816
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:27.065382  4359 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:27.066025  4359 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:27.066190  4359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:27.066776  4359 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:27.067958  4413 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20260812 06:37:27.072824  4359 ts_tablet_manager.cc:585] Loaded tablet metadata (2 total tablets, 2 live tablets)
I20260812 06:37:27.072890  4359 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s	user 0.000s	sys 0.000s
I20260812 06:37:27.072953  4359 ts_tablet_manager.cc:600] Registering tablets (0/2 complete)
I20260812 06:37:27.075160  4413 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Bootstrap starting.
I20260812 06:37:27.075335  4359 ts_tablet_manager.cc:616] Registered 2 tablets
I20260812 06:37:27.075380  4359 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:37:27.085454  4359 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.2:34071
I20260812 06:37:27.085517  4592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.2:34071 every 8 connection(s)
I20260812 06:37:27.086438  4359 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:27.094143 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 4359
I20260812 06:37:27.094616  4593 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:27.094657 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.3:37315
--local_ip_for_outbound_sockets=127.28.69.3
--tserver_master_addrs=127.28.69.62:45359
--webserver_port=42603
--webserver_interface=127.28.69.3
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0
--tablet_copy_early_session_timeout_prob=0.0 with env {}
I20260812 06:37:27.094887  4593 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:27.095368  4593 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:27.097136  4024 ts_manager.cc:194] Registered new tserver with Master: 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071)
I20260812 06:37:27.098171  4024 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.2:37177
I20260812 06:37:27.111076  4413 log.cc:826] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:27.225181  4413 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Bootstrap replayed 1/1 log segments. Stats: ops{read=206 overwritten=0 applied=206 ignored=205} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:27.225687  4413 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Bootstrap complete.
I20260812 06:37:27.227083  4413 ts_tablet_manager.cc:1403] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Time spent bootstrapping tablet: real 0.152s	user 0.138s	sys 0.012s
I20260812 06:37:27.229722  4413 raft_consensus.cc:359] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:27.230134  4413 raft_consensus.cc:740] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abf71a349bf4a0f9cc53eb677c76e14, State: Initialized, Role: FOLLOWER
I20260812 06:37:27.230643  4413 consensus_queue.cc:260] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:27.231369  4593 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:27.231639  4413 ts_tablet_manager.cc:1434] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 06:37:27.231906  4413 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Bootstrap starting.
I20260812 06:37:27.239934  4595 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 96076 bytes on disk
I20260812 06:37:27.240804  4411 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4}
W20260812 06:37:27.247507  4601 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:27.247804  4601 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:27.247884  4601 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:27.252777  4601 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:27.252910  4601 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:27.252990  4601 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.3
I20260812 06:37:27.258587  4601 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.3:37315
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.69.3
--webserver_port=42603
--flush_threshold_mb=0
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.4601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:27.260226  4601 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:27.261931  4601 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:27.270346  4618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:27.270368  4617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:27.270365  4623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:27.270851  4601 server_base.cc:1061] running on GCE node
I20260812 06:37:27.271265  4601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:27.271950  4601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:27.273082  4601 hybrid_clock.cc:648] HybridClock initialized: now 1786516647273051 us; error 45 us; skew 500 ppm
I20260812 06:37:27.275261  4601 webserver.cc:533] Webserver started at http://127.28.69.3:42603/ using document root <none> and password file <none>
I20260812 06:37:27.276005  4601 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:27.276101  4601 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:27.280612  4601 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:27.288663  4646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:27.289729  4601 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.002s	sys 0.000s
I20260812 06:37:27.289849  4601 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:27.290238  4601 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/data
Total live blocks: 10
Total live bytes: 777443
Total live bytes (after alignment): 802816
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:27.299787  4601 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:27.300377  4601 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:27.300537  4601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:27.301081  4601 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:27.302299  4656 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20260812 06:37:27.308317  4601 ts_tablet_manager.cc:585] Loaded tablet metadata (2 total tablets, 2 live tablets)
I20260812 06:37:27.308382  4601 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.006s	user 0.000s	sys 0.000s
I20260812 06:37:27.308444  4601 ts_tablet_manager.cc:600] Registering tablets (0/2 complete)
I20260812 06:37:27.310271  4656 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Bootstrap starting.
I20260812 06:37:27.310334  4601 ts_tablet_manager.cc:616] Registered 2 tablets
I20260812 06:37:27.310379  4601 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:27.320609  4601 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.3:37315
I20260812 06:37:27.320843  4845 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.3:37315 every 8 connection(s)
I20260812 06:37:27.321625  4601 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:27.327421 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 4601
I20260812 06:37:27.327914 28948 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
/tmp/dist-test-taskqQFhrh/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.69.4:43241
--local_ip_for_outbound_sockets=127.28.69.4
--tserver_master_addrs=127.28.69.62:45359
--webserver_port=42693
--webserver_interface=127.28.69.4
--builtin_ntp_servers=127.28.69.20:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=0
--maintenance_manager_polling_interval_ms=10
--follower_unavailable_considered_failed_sec=10
--tablet_copy_early_session_timeout_prob=1.0
--tablet_copy_early_session_timeout_prob=0.0 with env {}
I20260812 06:37:27.332512  4847 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:27.332819  4847 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:27.333483  4847 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:27.335690  4024 ts_manager.cc:194] Registered new tserver with Master: 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:27.336778  4024 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.3:32969
I20260812 06:37:27.349462  4656 log.cc:826] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:27.374476  4413 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Bootstrap replayed 1/1 log segments. Stats: ops{read=206 overwritten=0 applied=206 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:27.374871  4413 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Bootstrap complete.
I20260812 06:37:27.376071  4413 ts_tablet_manager.cc:1403] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Time spent bootstrapping tablet: real 0.144s	user 0.113s	sys 0.028s
I20260812 06:37:27.376792  4413 raft_consensus.cc:359] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:27.376950  4413 raft_consensus.cc:740] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5abf71a349bf4a0f9cc53eb677c76e14, State: Initialized, Role: FOLLOWER
I20260812 06:37:27.377144  4413 consensus_queue.cc:260] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:27.377431  4413 ts_tablet_manager.cc:1434] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 06:37:27.385648  4595 maintenance_manager.cc:419] P 5abf71a349bf4a0f9cc53eb677c76e14: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 95593 bytes on disk
I20260812 06:37:27.386159  4411 maintenance_manager.cc:643] P 5abf71a349bf4a0f9cc53eb677c76e14: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4}
I20260812 06:37:27.433840  4656 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Bootstrap replayed 1/1 log segments. Stats: ops{read=206 overwritten=0 applied=206 ignored=205} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:27.434352  4656 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Bootstrap complete.
I20260812 06:37:27.435549  4656 ts_tablet_manager.cc:1403] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Time spent bootstrapping tablet: real 0.126s	user 0.118s	sys 0.004s
I20260812 06:37:27.437551  4656 raft_consensus.cc:359] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:27.437853  4656 raft_consensus.cc:740] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1dcd5d40ed4ec187b2d1b53e7b8068, State: Initialized, Role: FOLLOWER
I20260812 06:37:27.438299  4656 consensus_queue.cc:260] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:27.438987  4847 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:27.439131  4656 ts_tablet_manager.cc:1434] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 06:37:27.439437  4656 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Bootstrap starting.
I20260812 06:37:27.445060  4848 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 96076 bytes on disk
I20260812 06:37:27.445837  4654 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4}
W20260812 06:37:27.452310  4850 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:27.452486  4850 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:27.452539  4850 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:27.455847  4850 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:27.455922  4850 flags.cc:432] Enabled experimental flag: --flush_threshold_mb=0
W20260812 06:37:27.455981  4850 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.69.4
I20260812 06:37:27.459776  4850 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.69.20:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=10
--fs_data_dirs=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.69.4:43241
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.28.69.4
--webserver_port=42693
--flush_threshold_mb=0
--tserver_master_addrs=127.28.69.62:45359
--never_fsync=true
--heap_profile_path=/tmp/kudu.4850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--maintenance_manager_polling_interval_ms=10
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.69.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:27.460814  4850 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:27.462028  4850 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:27.468694  4870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:27.468694  4871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:27.469045  4850 server_base.cc:1061] running on GCE node
W20260812 06:37:27.468770  4873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:27.470022  4850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:27.470695  4850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:27.471884  4850 hybrid_clock.cc:648] HybridClock initialized: now 1786516647471871 us; error 31 us; skew 500 ppm
I20260812 06:37:27.474131  4850 webserver.cc:533] Webserver started at http://127.28.69.4:42693/ using document root <none> and password file <none>
I20260812 06:37:27.474886  4850 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:27.474972  4850 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:27.480079  4850 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260812 06:37:27.488327  4893 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:27.489465  4850 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.001s	sys 0.000s
I20260812 06:37:27.489586  4850 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data,/tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
uuid: "840bc222ec4f491aa051a73e4903f520"
format_stamp: "Formatted at 2026-08-12 06:37:08 on dist-test-slave-k5rr"
I20260812 06:37:27.489990  4850 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/data
Total live blocks: 5
Total live bytes: 389547
Total live bytes (after alignment): 401408
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:27.504426  4850 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:27.505097  4850 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:27.505263  4850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:27.505882  4850 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:27.507128  4902 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20260812 06:37:27.515259  4850 ts_tablet_manager.cc:585] Loaded tablet metadata (2 total tablets, 1 live tablets)
I20260812 06:37:27.515331  4850 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.008s	user 0.000s	sys 0.000s
I20260812 06:37:27.515388  4850 ts_tablet_manager.cc:600] Registering tablets (0/2 complete)
I20260812 06:37:27.516013  4850 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:27.516062  4850 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:27.516458  4902 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Bootstrap starting.
I20260812 06:37:27.526587  4850 rpc_server.cc:307] RPC server started. Bound to: 127.28.69.4:43241
I20260812 06:37:27.526775  5083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.69.4:43241 every 8 connection(s)
I20260812 06:37:27.527666  4850 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb
I20260812 06:37:27.536070  5084 heartbeater.cc:344] Connected to a master server at 127.28.69.62:45359
I20260812 06:37:27.536307  5084 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:27.536823  5084 heartbeater.cc:507] Master 127.28.69.62:45359 requested a full tablet report, sending...
I20260812 06:37:27.536940 28948 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu as pid 4850
I20260812 06:37:27.540464  4024 ts_manager.cc:194] Registered new tserver with Master: 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241)
I20260812 06:37:27.541709  4024 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.69.4:56999
I20260812 06:37:27.544340 28948 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 06:37:27.544428 28948 tablet_copy-itest.cc:1615] Running ksck...
I20260812 06:37:27.567135  4902 log.cc:826] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:27.578018  4656 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Bootstrap replayed 1/1 log segments. Stats: ops{read=206 overwritten=0 applied=206 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:27.578449  4656 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Bootstrap complete.
I20260812 06:37:27.579653  4656 ts_tablet_manager.cc:1403] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Time spent bootstrapping tablet: real 0.140s	user 0.117s	sys 0.020s
I20260812 06:37:27.580358  4656 raft_consensus.cc:359] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:27.580504  4656 raft_consensus.cc:740] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1dcd5d40ed4ec187b2d1b53e7b8068, State: Initialized, Role: FOLLOWER
I20260812 06:37:27.580727  4656 consensus_queue.cc:260] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:27.581107  4656 ts_tablet_manager.cc:1434] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 06:37:27.590158  4848 maintenance_manager.cc:419] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: Scheduling UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29): 95593 bytes on disk
I20260812 06:37:27.590735  4654 maintenance_manager.cc:643] P 4f1dcd5d40ed4ec187b2d1b53e7b8068: UndoDeltaBlockGCOp(08ccabf80cd448c5b4dd6daa500eab29) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4}
I20260812 06:37:27.606575  4974 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:27.606678  4730 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:27.607728  4479 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:27.629375  4241 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 33279f4c81234d6e86ca874b7fbaec88 | 127.28.69.62:45359 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                                |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                               | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                  | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                               | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                               | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                 | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4f1dcd5d40ed4ec187b2d1b53e7b8068 | 127.28.69.3:37315 | HEALTHY | <none>   |       0        |       0
 5abf71a349bf4a0f9cc53eb677c76e14 | 127.28.69.2:34071 | HEALTHY | <none>   |       0        |       0
 840bc222ec4f491aa051a73e4903f520 | 127.28.69.4:43241 | HEALTHY | <none>   |       0        |       0
 eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                              |         Tags         |      Tablet Server
-----------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                              | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                            | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.28.69.1                                                                                                                                                    | experimental         | 127.28.69.1:40457
 local_ip_for_outbound_sockets           | 127.28.69.2                                                                                                                                                    | experimental         | 127.28.69.2:34071
 local_ip_for_outbound_sockets           | 127.28.69.3                                                                                                                                                    | experimental         | 127.28.69.3:37315
 local_ip_for_outbound_sockets           | 127.28.69.4                                                                                                                                                    | experimental         | 127.28.69.4:43241
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                             | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                           | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                              | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                           | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                             | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.28.69.1:40457
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.28.69.2:34071
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.28.69.3:37315
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.28.69.4:43241
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                              | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 08ccabf80cd448c5b4dd6daa500eab29 of table 'table_a' is conflicted: 4 replicas' active configs disagree with the leader master's
  eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): RUNNING
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING [LEADER]
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = eeb870ecb7fc4d3a9badf303402e8b26
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
  D = 840bc222ec4f491aa051a73e4903f520
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B*  C   D~   |              |              | Yes
 A             | A   B   C        | 1            | -1           | Yes
 B             | A   B   C   D~   | 1            | 206          | Yes
 C             | A   B   C   D~   | 1            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

Tablet 49beb6b453a447d0a20b44ad461f6e60 of table 'table_b' is under-replicated: 1 replica(s) not RUNNING
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): not running [LEADER]
    State:       BOOTSTRAPPING
    Data state:  TABLET_DATA_READY
    Last status: Bootstrap starting.
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
All reported replicas are:
  A = 840bc222ec4f491aa051a73e4903f520
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | UNDER_REPLICATED   | 1             | 0       | 0          | 1                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 06:37:27.650179 28948 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:37:27.688484  4902 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Bootstrap replayed 1/1 log segments. Stats: ops{read=206 overwritten=0 applied=206 ignored=205} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:27.688954  4902 tablet_bootstrap.cc:492] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Bootstrap complete.
I20260812 06:37:27.690053  4902 ts_tablet_manager.cc:1403] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Time spent bootstrapping tablet: real 0.174s	user 0.145s	sys 0.016s
I20260812 06:37:27.692164  4902 raft_consensus.cc:359] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:27.692508  4902 raft_consensus.cc:740] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840bc222ec4f491aa051a73e4903f520, State: Initialized, Role: FOLLOWER
I20260812 06:37:27.692910  4902 consensus_queue.cc:260] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:27.693675  5084 heartbeater.cc:499] Master 127.28.69.62:45359 was elected leader, sending a full tablet report...
I20260812 06:37:27.693853  4902 ts_tablet_manager.cc:1434] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:27.703318  5085 maintenance_manager.cc:419] P 840bc222ec4f491aa051a73e4903f520: Scheduling UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60): 96076 bytes on disk
I20260812 06:37:27.704291  4899 maintenance_manager.cc:643] P 840bc222ec4f491aa051a73e4903f520: UndoDeltaBlockGCOp(49beb6b453a447d0a20b44ad461f6e60) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
I20260812 06:37:27.850726  4730 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:27.851629  4974 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:27.851886  4479 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:27.851943  4241 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 33279f4c81234d6e86ca874b7fbaec88 | 127.28.69.62:45359 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                                |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                               | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                  | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                               | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                               | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                 | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4f1dcd5d40ed4ec187b2d1b53e7b8068 | 127.28.69.3:37315 | HEALTHY | <none>   |       0        |       0
 5abf71a349bf4a0f9cc53eb677c76e14 | 127.28.69.2:34071 | HEALTHY | <none>   |       0        |       0
 840bc222ec4f491aa051a73e4903f520 | 127.28.69.4:43241 | HEALTHY | <none>   |       0        |       0
 eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                              |         Tags         |      Tablet Server
-----------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                              | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                            | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.28.69.1                                                                                                                                                    | experimental         | 127.28.69.1:40457
 local_ip_for_outbound_sockets           | 127.28.69.2                                                                                                                                                    | experimental         | 127.28.69.2:34071
 local_ip_for_outbound_sockets           | 127.28.69.3                                                                                                                                                    | experimental         | 127.28.69.3:37315
 local_ip_for_outbound_sockets           | 127.28.69.4                                                                                                                                                    | experimental         | 127.28.69.4:43241
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                             | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                           | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                              | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                           | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                             | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.28.69.1:40457
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.28.69.2:34071
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.28.69.3:37315
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.28.69.4:43241
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                              | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 08ccabf80cd448c5b4dd6daa500eab29 of table 'table_a' is conflicted: 4 replicas' active configs disagree with the leader master's
  eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): RUNNING
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING [LEADER]
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = eeb870ecb7fc4d3a9badf303402e8b26
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
  D = 840bc222ec4f491aa051a73e4903f520
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B*  C   D~   |              |              | Yes
 A             | A   B   C        | 1            | -1           | Yes
 B             | A   B   C   D~   | 1            | 206          | Yes
 C             | A   B   C   D~   | 1            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

Tablet 49beb6b453a447d0a20b44ad461f6e60 of table 'table_b' is conflicted: 3 replicas' active configs disagree with the leader master's
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): RUNNING [LEADER]
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
All reported replicas are:
  A = 840bc222ec4f491aa051a73e4903f520
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 06:37:27.882797 28948 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:37:28.155328  4974 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:28.157390  4730 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:28.158336  4479 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:28.158710  4241 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 33279f4c81234d6e86ca874b7fbaec88 | 127.28.69.62:45359 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                                |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                               | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                  | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                               | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                               | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                 | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4f1dcd5d40ed4ec187b2d1b53e7b8068 | 127.28.69.3:37315 | HEALTHY | <none>   |       0        |       0
 5abf71a349bf4a0f9cc53eb677c76e14 | 127.28.69.2:34071 | HEALTHY | <none>   |       0        |       0
 840bc222ec4f491aa051a73e4903f520 | 127.28.69.4:43241 | HEALTHY | <none>   |       0        |       0
 eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                              |         Tags         |      Tablet Server
-----------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                              | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                            | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.28.69.1                                                                                                                                                    | experimental         | 127.28.69.1:40457
 local_ip_for_outbound_sockets           | 127.28.69.2                                                                                                                                                    | experimental         | 127.28.69.2:34071
 local_ip_for_outbound_sockets           | 127.28.69.3                                                                                                                                                    | experimental         | 127.28.69.3:37315
 local_ip_for_outbound_sockets           | 127.28.69.4                                                                                                                                                    | experimental         | 127.28.69.4:43241
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                             | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                           | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                              | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                           | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                             | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.28.69.1:40457
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.28.69.2:34071
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.28.69.3:37315
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.28.69.4:43241
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                              | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 49beb6b453a447d0a20b44ad461f6e60 of table 'table_b' is conflicted: 3 replicas' active configs disagree with the leader master's
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): RUNNING [LEADER]
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
All reported replicas are:
  A = 840bc222ec4f491aa051a73e4903f520
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

Tablet 08ccabf80cd448c5b4dd6daa500eab29 of table 'table_a' is conflicted: 4 replicas' active configs disagree with the leader master's
  eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): RUNNING
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING [LEADER]
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = eeb870ecb7fc4d3a9badf303402e8b26
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
  D = 840bc222ec4f491aa051a73e4903f520
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B*  C   D~   |              |              | Yes
 A             | A   B   C        | 1            | -1           | Yes
 B             | A   B   C   D~   | 1            | 206          | Yes
 C             | A   B   C   D~   | 1            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 06:37:28.186618 28948 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:37:28.575837  4479 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:28.576098  4730 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:28.576500  4974 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:28.577989  4241 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:28.597064  5280 raft_consensus.cc:493] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:28.597298  5280 raft_consensus.cc:515] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:28.598395  5280 leader_election.cc:290] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457), 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:28.603560  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ccabf80cd448c5b4dd6daa500eab29" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" is_pre_election: true
I20260812 06:37:28.603909  4274 raft_consensus.cc:2468] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 1.
I20260812 06:37:28.604206  4768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ccabf80cd448c5b4dd6daa500eab29" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" is_pre_election: true
I20260812 06:37:28.604370  4403 leader_election.cc:304] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5abf71a349bf4a0f9cc53eb677c76e14, eeb870ecb7fc4d3a9badf303402e8b26; no voters: 
I20260812 06:37:28.604497  4768 raft_consensus.cc:2468] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 1.
I20260812 06:37:28.604641  5280 raft_consensus.cc:2804] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:37:28.604719  5280 raft_consensus.cc:493] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:28.604772  5280 raft_consensus.cc:3060] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:28.606566  5280 raft_consensus.cc:515] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:28.606899  5280 leader_election.cc:290] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 2 election: Requested vote from peers eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457), 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:28.607219  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ccabf80cd448c5b4dd6daa500eab29" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "eeb870ecb7fc4d3a9badf303402e8b26"
I20260812 06:37:28.607328  4768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08ccabf80cd448c5b4dd6daa500eab29" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068"
I20260812 06:37:28.607350  4274 raft_consensus.cc:3060] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:28.607468  4768 raft_consensus.cc:3060] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:28.609346  4274 raft_consensus.cc:2468] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 2.
I20260812 06:37:28.609346  4768 raft_consensus.cc:2468] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 2.
I20260812 06:37:28.609687  4403 leader_election.cc:304] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5abf71a349bf4a0f9cc53eb677c76e14, eeb870ecb7fc4d3a9badf303402e8b26; no voters: 
I20260812 06:37:28.609855  5280 raft_consensus.cc:2804] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:28.610051  5280 raft_consensus.cc:697] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 2 LEADER]: Becoming Leader. State: Replica: 5abf71a349bf4a0f9cc53eb677c76e14, State: Running, Role: LEADER
I20260812 06:37:28.610345  5280 consensus_queue.cc:237] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 206, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:28.613709  4022 catalog_manager.cc:5719] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" committed_config { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 33279f4c81234d6e86ca874b7fbaec88 | 127.28.69.62:45359 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                                |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                               | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                  | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                               | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                               | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                 | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4f1dcd5d40ed4ec187b2d1b53e7b8068 | 127.28.69.3:37315 | HEALTHY | <none>   |       0        |       0
 5abf71a349bf4a0f9cc53eb677c76e14 | 127.28.69.2:34071 | HEALTHY | <none>   |       0        |       0
 840bc222ec4f491aa051a73e4903f520 | 127.28.69.4:43241 | HEALTHY | <none>   |       0        |       0
 eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                              |         Tags         |      Tablet Server
-----------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                              | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                            | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.28.69.1                                                                                                                                                    | experimental         | 127.28.69.1:40457
 local_ip_for_outbound_sockets           | 127.28.69.2                                                                                                                                                    | experimental         | 127.28.69.2:34071
 local_ip_for_outbound_sockets           | 127.28.69.3                                                                                                                                                    | experimental         | 127.28.69.3:37315
 local_ip_for_outbound_sockets           | 127.28.69.4                                                                                                                                                    | experimental         | 127.28.69.4:43241
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                             | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                           | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                              | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                           | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                             | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.28.69.1:40457
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.28.69.2:34071
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.28.69.3:37315
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.28.69.4:43241
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                              | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 49beb6b453a447d0a20b44ad461f6e60 of table 'table_b' is conflicted: 3 replicas' active configs disagree with the leader master's
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): RUNNING [LEADER]
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
All reported replicas are:
  A = 840bc222ec4f491aa051a73e4903f520
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A*  B   C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B   C    | 1            | -1           | Yes
 C             | A   B   C    | 1            | -1           | Yes

Tablet 08ccabf80cd448c5b4dd6daa500eab29 of table 'table_a' is conflicted: 4 replicas' active configs disagree with the leader master's
  eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): RUNNING
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING [LEADER]
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = eeb870ecb7fc4d3a9badf303402e8b26
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
  D = 840bc222ec4f491aa051a73e4903f520
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B*  C   D~   |              |              | Yes
 A             | A   B   C        | 1            | -1           | Yes
 B             | A   B   C   D~   | 1            | 206          | Yes
 C             | A   B   C   D~   | 1            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 06:37:28.620432 28948 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:37:28.838171  5280 raft_consensus.cc:493] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:28.838351  5280 raft_consensus.cc:515] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:28.838912  5280 leader_election.cc:290] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241), 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:28.839512  4768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49beb6b453a447d0a20b44ad461f6e60" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" is_pre_election: true
I20260812 06:37:28.839694  4768 raft_consensus.cc:2468] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 1.
I20260812 06:37:28.840045  4403 leader_election.cc:304] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1dcd5d40ed4ec187b2d1b53e7b8068, 5abf71a349bf4a0f9cc53eb677c76e14; no voters: 
I20260812 06:37:28.840281  5280 raft_consensus.cc:2804] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:37:28.840349  5280 raft_consensus.cc:493] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:28.840399  5280 raft_consensus.cc:3060] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:28.841303  5280 raft_consensus.cc:515] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:28.841718  5280 leader_election.cc:290] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 2 election: Requested vote from peers 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241), 4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315)
I20260812 06:37:28.842129  4768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49beb6b453a447d0a20b44ad461f6e60" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068"
I20260812 06:37:28.842265  4768 raft_consensus.cc:3060] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:28.843044  4768 raft_consensus.cc:2468] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 2.
I20260812 06:37:28.843343  4403 leader_election.cc:304] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1dcd5d40ed4ec187b2d1b53e7b8068, 5abf71a349bf4a0f9cc53eb677c76e14; no voters: 
I20260812 06:37:28.843380  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49beb6b453a447d0a20b44ad461f6e60" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "840bc222ec4f491aa051a73e4903f520"
I20260812 06:37:28.843561  5280 raft_consensus.cc:2804] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:28.843339  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49beb6b453a447d0a20b44ad461f6e60" candidate_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" candidate_term: 2 candidate_status { last_received { term: 1 index: 206 } } ignore_live_leader: false dest_uuid: "840bc222ec4f491aa051a73e4903f520" is_pre_election: true
I20260812 06:37:28.843605  5006 raft_consensus.cc:3060] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:28.843649  5280 raft_consensus.cc:697] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 2 LEADER]: Becoming Leader. State: Replica: 5abf71a349bf4a0f9cc53eb677c76e14, State: Running, Role: LEADER
I20260812 06:37:28.843798  5280 consensus_queue.cc:237] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 206, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:28.845739  5006 raft_consensus.cc:2468] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5abf71a349bf4a0f9cc53eb677c76e14 in term 2.
I20260812 06:37:28.845647  4022 catalog_manager.cc:5719] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 reported cstate change: term changed from 1 to 2, leader changed from 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) to 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2). New cstate: current_term: 2 leader_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:29.093773  4402 consensus_peers.cc:597] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 -> Peer 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): Couldn't send request to peer 840bc222ec4f491aa051a73e4903f520. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:29.122967  4768 raft_consensus.cc:1275] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 2 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 2 index: 207. (index mismatch)
I20260812 06:37:29.123728  5280 consensus_queue.cc:1048] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20260812 06:37:29.128976  4274 raft_consensus.cc:1275] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 2 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 2 index: 207. (index mismatch)
I20260812 06:37:29.129876  5280 consensus_queue.cc:1048] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 205, Time since last communication: 0.000s
I20260812 06:37:29.132198  4274 raft_consensus.cc:2955] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 2 FOLLOWER]: Committing config change with OpId 1.206: config changed from index -1 to 206, NON_VOTER 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } } }
I20260812 06:37:29.177271  4974 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:29.177691  4479 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260812 06:37:29.178109  4730 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:29.185561  4241 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 33279f4c81234d6e86ca874b7fbaec88 | 127.28.69.62:45359 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                                |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                               | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                  | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                               | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                               | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                 | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4f1dcd5d40ed4ec187b2d1b53e7b8068 | 127.28.69.3:37315 | HEALTHY | <none>   |       0        |       0
 5abf71a349bf4a0f9cc53eb677c76e14 | 127.28.69.2:34071 | HEALTHY | <none>   |       2        |       0
 840bc222ec4f491aa051a73e4903f520 | 127.28.69.4:43241 | HEALTHY | <none>   |       0        |       0
 eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                              |         Tags         |      Tablet Server
-----------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                              | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                            | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.28.69.1                                                                                                                                                    | experimental         | 127.28.69.1:40457
 local_ip_for_outbound_sockets           | 127.28.69.2                                                                                                                                                    | experimental         | 127.28.69.2:34071
 local_ip_for_outbound_sockets           | 127.28.69.3                                                                                                                                                    | experimental         | 127.28.69.3:37315
 local_ip_for_outbound_sockets           | 127.28.69.4                                                                                                                                                    | experimental         | 127.28.69.4:43241
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                             | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                           | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                              | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                           | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                             | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.28.69.1:40457
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.28.69.2:34071
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.28.69.3:37315
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.28.69.4:43241
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                              | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
Tablet 49beb6b453a447d0a20b44ad461f6e60 of table 'table_b' is conflicted: 2 replicas' active configs disagree with the leader master's
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): RUNNING
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING [LEADER]
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
All reported replicas are:
  A = 840bc222ec4f491aa051a73e4903f520
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C    |              |              | Yes
 A             | A   B   C    | 2            | -1           | Yes
 B             | A   B*  C    | 2            | -1           | Yes
 C             | A   B   C    | 2            | -1           | Yes

Tablet 08ccabf80cd448c5b4dd6daa500eab29 of table 'table_a' is conflicted: 1 replicas' active configs disagree with the leader master's
  eeb870ecb7fc4d3a9badf303402e8b26 (127.28.69.1:40457): RUNNING
  5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071): RUNNING [LEADER]
  4f1dcd5d40ed4ec187b2d1b53e7b8068 (127.28.69.3:37315): RUNNING
  840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): not running [NONVOTER]
    State:       INITIALIZED
    Data state:  TABLET_DATA_TOMBSTONED
    Last status: Tombstoned
All reported replicas are:
  A = eeb870ecb7fc4d3a9badf303402e8b26
  B = 5abf71a349bf4a0f9cc53eb677c76e14
  C = 4f1dcd5d40ed4ec187b2d1b53e7b8068
  D = 840bc222ec4f491aa051a73e4903f520
The consensus matrix is:
 Config source |     Replicas     | Current term | Config index | Committed?
---------------+------------------+--------------+--------------+------------
 master        | A   B*  C   D~   |              |              | Yes
 A             | A   B*  C   D~   | 2            | 206          | Yes
 B             | A   B*  C   D~   | 2            | 206          | Yes
 C             | A   B*  C   D~   | 2            | 206          | Yes
 D             | A   B   C   D~   | 1            | 206          | Yes

The cluster doesn't have any matching system tables
Summary by table
  Name   | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+--------------------+---------------+---------+------------+------------------+-------------
 table_a | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1
 table_b | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 2
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Tablet Replica Count Outliers
 Type  |               UUID               |       Host        | Replica Count
-------+----------------------------------+-------------------+---------------
 Small | eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 7

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 2 out of 2 table(s) are not healthy

FAILED
I20260812 06:37:29.208505 28948 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 06:37:29.332432  4768 raft_consensus.cc:1275] T 49beb6b453a447d0a20b44ad461f6e60 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 2 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 2 index: 207. (index mismatch)
I20260812 06:37:29.332970  5280 consensus_queue.cc:1048] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20260812 06:37:29.336229  5006 raft_consensus.cc:1275] T 49beb6b453a447d0a20b44ad461f6e60 P 840bc222ec4f491aa051a73e4903f520 [term 2 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 2 index: 207. (index mismatch)
I20260812 06:37:29.337045  5304 consensus_queue.cc:1048] T 49beb6b453a447d0a20b44ad461f6e60 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: VOTER last_known_addr { host: "127.28.69.4" port: 43241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20260812 06:37:29.563618  5372 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:29.563757  5372 raft_consensus.cc:2243] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [term 1 LEARNER]: Raft consensus shutting down.
I20260812 06:37:29.563843  5372 raft_consensus.cc:2272] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [term 1 LEARNER]: Raft consensus is shut down!
I20260812 06:37:29.563994  5372 ts_tablet_manager.cc:933] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Initiating tablet copy from peer 5abf71a349bf4a0f9cc53eb677c76e14 (127.28.69.2:34071)
I20260812 06:37:29.564560  5372 tablet_copy_client.cc:323] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet copy: Beginning tablet copy session from remote peer at address 127.28.69.2:34071
I20260812 06:37:29.569224  4550 tablet_copy_service.cc:140] P 5abf71a349bf4a0f9cc53eb677c76e14: Received BeginTabletCopySession request for tablet 08ccabf80cd448c5b4dd6daa500eab29 from peer 840bc222ec4f491aa051a73e4903f520 ({username='slave'} at 127.28.69.4:40771)
I20260812 06:37:29.569414  4550 tablet_copy_service.cc:161] P 5abf71a349bf4a0f9cc53eb677c76e14: Beginning new tablet copy session on tablet 08ccabf80cd448c5b4dd6daa500eab29 from peer 840bc222ec4f491aa051a73e4903f520 at {username='slave'} at 127.28.69.4:40771: session id = 840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29
I20260812 06:37:29.571219  4550 tablet_copy_source_session.cc:215] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14: Tablet Copy: opened 5 blocks and 1 log segments
I20260812 06:37:29.573186  5372 ts_tablet_manager.cc:1916] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:37:29.575330  5372 ts_tablet_manager.cc:1929] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20260812 06:37:29.575693  5372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ccabf80cd448c5b4dd6daa500eab29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:29.576738  5372 tablet_copy_client.cc:806] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet copy: Starting download of 5 data blocks...
I20260812 06:37:29.584654  5372 tablet_copy_client.cc:670] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet copy: Starting download of 1 WAL segments...
I20260812 06:37:29.589498  5372 tablet_copy_client.cc:538] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:37:29.591030  5372 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Bootstrap starting.
I20260812 06:37:29.596397  4514 consensus_queue.cc:237] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 207, Committed index: 207, Last appended: 2.207, Last appended by leader: 206, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } }
I20260812 06:37:29.598340  4768 raft_consensus.cc:1275] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 2 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 2 index: 207. Preceding OpId from leader: term: 2 index: 208. (index mismatch)
I20260812 06:37:29.598764  4274 raft_consensus.cc:1275] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 2 FOLLOWER]: Refusing update from remote peer 5abf71a349bf4a0f9cc53eb677c76e14: Log matching property violated. Preceding OpId in replica: term: 2 index: 207. Preceding OpId from leader: term: 2 index: 208. (index mismatch)
I20260812 06:37:29.599016  5286 consensus_queue.cc:1048] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20260812 06:37:29.599570  5286 consensus_queue.cc:1048] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20260812 06:37:29.602074  5286 raft_consensus.cc:2955] T 08ccabf80cd448c5b4dd6daa500eab29 P 5abf71a349bf4a0f9cc53eb677c76e14 [term 2 LEADER]: Committing config change with OpId 2.208: config changed from index 206 to 208, NON_VOTER 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } }
I20260812 06:37:29.604857  4274 raft_consensus.cc:2955] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 [term 2 FOLLOWER]: Committing config change with OpId 2.208: config changed from index 206 to 208, NON_VOTER 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } }
I20260812 06:37:29.605257  4768 raft_consensus.cc:2955] T 08ccabf80cd448c5b4dd6daa500eab29 P 4f1dcd5d40ed4ec187b2d1b53e7b8068 [term 2 FOLLOWER]: Committing config change with OpId 2.208: config changed from index 206 to 208, NON_VOTER 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } }
I20260812 06:37:29.607477  4003 catalog_manager.cc:5232] ChangeConfig:REMOVE_PEER RPC for tablet 08ccabf80cd448c5b4dd6daa500eab29 with cas_config_opid_index 206: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 06:37:29.607704  4024 catalog_manager.cc:5719] T 08ccabf80cd448c5b4dd6daa500eab29 P eeb870ecb7fc4d3a9badf303402e8b26 reported cstate change: config changed from index 206 to 208, NON_VOTER 840bc222ec4f491aa051a73e4903f520 (127.28.69.4) evicted. New cstate: current_term: 2 leader_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" committed_config { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } }
I20260812 06:37:29.616226  4974 tablet_service.cc:1558] Processing DeleteTablet for tablet 08ccabf80cd448c5b4dd6daa500eab29 with delete_type TABLET_DATA_TOMBSTONED (TS 840bc222ec4f491aa051a73e4903f520 not found in new config with opid_index 208) from {username='slave'} at 127.0.0.1:48306
W20260812 06:37:29.617269  4002 catalog_manager.cc:5030] TS 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): delete failed for tablet 08ccabf80cd448c5b4dd6daa500eab29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08ccabf80cd448c5b4dd6daa500eab29 already in progress: copying tablet
I20260812 06:37:29.700022  5372 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Bootstrap replayed 1/1 log segments. Stats: ops{read=207 overwritten=0 applied=207 ignored=204} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:29.700331  5372 tablet_bootstrap.cc:492] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Bootstrap complete.
I20260812 06:37:29.700596  5372 ts_tablet_manager.cc:1403] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Time spent bootstrapping tablet: real 0.110s	user 0.098s	sys 0.008s
I20260812 06:37:29.701190  5372 raft_consensus.cc:359] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:29.701299  5372 raft_consensus.cc:740] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 840bc222ec4f491aa051a73e4903f520, State: Initialized, Role: LEARNER
I20260812 06:37:29.701432  5372 consensus_queue.cc:260] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 207, Last appended: 2.207, Last appended by leader: 207, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "eeb870ecb7fc4d3a9badf303402e8b26" member_type: VOTER last_known_addr { host: "127.28.69.1" port: 40457 } } peers { permanent_uuid: "5abf71a349bf4a0f9cc53eb677c76e14" member_type: VOTER last_known_addr { host: "127.28.69.2" port: 34071 } } peers { permanent_uuid: "4f1dcd5d40ed4ec187b2d1b53e7b8068" member_type: VOTER last_known_addr { host: "127.28.69.3" port: 37315 } } peers { permanent_uuid: "840bc222ec4f491aa051a73e4903f520" member_type: NON_VOTER last_known_addr { host: "127.28.69.4" port: 43241 } attrs { promote: true } }
I20260812 06:37:29.701694  5372 ts_tablet_manager.cc:1434] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260812 06:37:29.702617  4550 tablet_copy_service.cc:342] P 5abf71a349bf4a0f9cc53eb677c76e14: Request end of tablet copy session 840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29 received from {username='slave'} at 127.28.69.4:40771
I20260812 06:37:29.702736  4550 tablet_copy_service.cc:434] P 5abf71a349bf4a0f9cc53eb677c76e14: ending tablet copy session 840bc222ec4f491aa051a73e4903f520-08ccabf80cd448c5b4dd6daa500eab29 on tablet 08ccabf80cd448c5b4dd6daa500eab29 with peer 840bc222ec4f491aa051a73e4903f520
I20260812 06:37:29.703526  4974 tablet_service.cc:1558] Processing DeleteTablet for tablet 08ccabf80cd448c5b4dd6daa500eab29 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 206 (current committed config index is 208)) from {username='slave'} at 127.0.0.1:48306
I20260812 06:37:29.703886  5387 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:29.704161  5387 raft_consensus.cc:2243] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [term 2 LEARNER]: Raft consensus shutting down.
I20260812 06:37:29.704461  5387 raft_consensus.cc:2272] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520 [term 2 LEARNER]: Raft consensus is shut down!
I20260812 06:37:29.705705  5387 ts_tablet_manager.cc:1916] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:29.708630  5387 ts_tablet_manager.cc:1929] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.207
I20260812 06:37:29.708709  5387 log.cc:1199] T 08ccabf80cd448c5b4dd6daa500eab29 P 840bc222ec4f491aa051a73e4903f520: Deleting WAL directory at /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/wal/wals/08ccabf80cd448c5b4dd6daa500eab29
I20260812 06:37:29.709316  4002 catalog_manager.cc:5050] TS 840bc222ec4f491aa051a73e4903f520 (127.28.69.4:43241): tablet 08ccabf80cd448c5b4dd6daa500eab29 (table table_a [id=8dafa06424db448c82a7187443121b5f]) successfully deleted
I20260812 06:37:30.019833  4974 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:30.019833  4730 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:30.020020  4479 tablet_service.cc:1467] Tablet server has 2 leaders and 0 scanners
I20260812 06:37:30.020659  4241 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 33279f4c81234d6e86ca874b7fbaec88 | 127.28.69.62:45359 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                               Value                                                                                |      Tags       |         Master
----------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                               | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                  | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                               | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                               | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                 | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 4f1dcd5d40ed4ec187b2d1b53e7b8068 | 127.28.69.3:37315 | HEALTHY | <none>   |       0        |       0
 5abf71a349bf4a0f9cc53eb677c76e14 | 127.28.69.2:34071 | HEALTHY | <none>   |       2        |       0
 840bc222ec4f491aa051a73e4903f520 | 127.28.69.4:43241 | HEALTHY | <none>   |       0        |       0
 eeb870ecb7fc4d3a9badf303402e8b26 | 127.28.69.1:40457 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       4

Unusual flags for Tablet Server:
                  Flag                   |                                                                             Value                                                                              |         Tags         |      Tablet Server
-----------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
 flush_threshold_mb                      | 0                                                                                                                                                              | runtime,experimental | all 4 server(s) checked
 ipki_server_key_size                    | 768                                                                                                                                                            | experimental         | all 4 server(s) checked
 local_ip_for_outbound_sockets           | 127.28.69.1                                                                                                                                                    | experimental         | 127.28.69.1:40457
 local_ip_for_outbound_sockets           | 127.28.69.2                                                                                                                                                    | experimental         | 127.28.69.2:34071
 local_ip_for_outbound_sockets           | 127.28.69.3                                                                                                                                                    | experimental         | 127.28.69.3:37315
 local_ip_for_outbound_sockets           | 127.28.69.4                                                                                                                                                    | experimental         | 127.28.69.4:43241
 maintenance_manager_polling_interval_ms | 10                                                                                                                                                             | hidden               | all 4 server(s) checked
 never_fsync                             | true                                                                                                                                                           | unsafe,advanced      | all 4 server(s) checked
 openssl_security_level_override         | 0                                                                                                                                                              | unsafe,hidden        | all 4 server(s) checked
 rpc_server_allow_ephemeral_ports        | true                                                                                                                                                           | unsafe               | all 4 server(s) checked
 server_dump_info_format                 | pb                                                                                                                                                             | hidden               | all 4 server(s) checked
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-0/data/info.pb | hidden               | 127.28.69.1:40457
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-1/data/info.pb | hidden               | 127.28.69.2:34071
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-2/data/info.pb | hidden               | 127.28.69.3:37315
 server_dump_info_path                   | /tmp/dist-test-taskqQFhrh/test-tmp/tablet_copy-itest.0.FaultFlags_BadTabletCopyITest.TestBadCopy_1.1786516573877167-28948-0/minicluster-data/ts-3/data/info.pb | hidden               | 127.28.69.4:43241
 tablet_copy_early_session_timeout_prob  | 0                                                                                                                                                              | unsafe,runtime       | all 4 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.28.69.20:46013 | all 4 server(s) checked
 time_source         | builtin            | all 4 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 5 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
  Name   | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------+----+---------+---------------+---------+------------+------------------+-------------
 table_a | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0
 table_b | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 2
 Third Quartile | 2
 Maximum        | 2

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 4
 Tables         | 2
 Tablets        | 2
 Replicas       | 6

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 06:37:30.049073 28948 log_verifier.cc:126] Checking tablet 08ccabf80cd448c5b4dd6daa500eab29
I20260812 06:37:30.144758 28948 log_verifier.cc:177] Verified matching terms for 208 ops in tablet 08ccabf80cd448c5b4dd6daa500eab29
I20260812 06:37:30.144893 28948 log_verifier.cc:126] Checking tablet 49beb6b453a447d0a20b44ad461f6e60
I20260812 06:37:30.244372 28948 log_verifier.cc:177] Verified matching terms for 207 ops in tablet 49beb6b453a447d0a20b44ad461f6e60
I20260812 06:37:30.244547 28948 tablet_copy-itest.cc:1620] Checking row count...
I20260812 06:37:30.292133 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 4087
I20260812 06:37:30.311254 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 4359
I20260812 06:37:30.329432 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 4601
I20260812 06:37:30.349679 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 4850
I20260812 06:37:30.365166 28948 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskqQFhrh/build/debug/bin/kudu with pid 3970
2026-08-12T06:37:30Z chronyd exiting
[       OK ] FaultFlags/BadTabletCopyITest.TestBadCopy/1 (23078 ms)
[----------] 1 test from FaultFlags/BadTabletCopyITest (23078 ms total)

[----------] Global test environment tear-down
[==========] 5 tests from 2 test suites ran. (76509 ms total)
[  PASSED  ] 5 tests.
I20260812 06:37:30.400002 28948 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/integration-tests/tablet_copy-itest.cc:1499: suppressed but not reported on 68 messages since previous log ~16 seconds ago
I20260812 06:37:30.400101 28948 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/client/batcher.cc:441: suppressed but not reported on 3 messages since previous log ~69 seconds ago
I20260812 06:37:30.400138 28948 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 3 messages since previous log ~69 seconds ago
