Note: This is test shard 3 of 6.
[==========] Running 4 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from TabletCopyITest
[ RUN      ] TabletCopyITest.TestCopyAfterFailedCopy
2026-08-12T06:37:08Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:08Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 06:37:08.892158  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-1
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-0/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:36947
--webserver_interface=127.1.223.62
--webserver_port=0
--builtin_ntp_servers=127.1.223.20:42961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.223.62:36947
--master_tombstone_evicted_tablet_replicas=false with env {}
W20260812 06:37:09.005208  1930 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:09.005467  1930 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:09.005508  1930 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:09.009164  1930 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:09.009240  1930 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:09.009261  1930 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:09.009280  1930 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:09.013680  1930 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:42961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-1
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.1.223.62:36947
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:36947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-0/info.pb
--webserver_interface=127.1.223.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:09.014977  1930 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:09.016199  1930 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:09.022472  1937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.022521  1939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.022549  1935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:09.022661  1930 server_base.cc:1061] running on GCE node
I20260812 06:37:09.023214  1930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:09.024230  1930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:09.025414  1930 hybrid_clock.cc:648] HybridClock initialized: now 1786516629025397 us; error 32 us; skew 500 ppm
I20260812 06:37:09.027565  1930 webserver.cc:533] Webserver started at http://127.1.223.62:37459/ using document root <none> and password file <none>
I20260812 06:37:09.028229  1930 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:09.028298  1930 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:09.028576  1930 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:09.030191  1930 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-0/instance:
uuid: "6950cc7ab7054b999a170eb672e7bc32"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.030714  1930 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-1/instance:
uuid: "6950cc7ab7054b999a170eb672e7bc32"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.031021  1930 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/wal/instance:
uuid: "6950cc7ab7054b999a170eb672e7bc32"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.035657  1930 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.003s
I20260812 06:37:09.038262  1954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.038264  1953 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.039921  1930 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:09.040069  1930 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-1,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
uuid: "6950cc7ab7054b999a170eb672e7bc32"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.040184  1930 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
2 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-0/data, /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-1/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:09.057420  1930 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:09.058208  1930 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:09.058450  1930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:09.067071  1930 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.62:36947
I20260812 06:37:09.067087  2031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.62:36947 every 8 connection(s)
I20260812 06:37:09.068204  1930 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/data-0/info.pb
I20260812 06:37:09.069150  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 1930
I20260812 06:37:09.069324  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/master-0/wal/instance
I20260812 06:37:09.071669  2032 data_dirs.cc:400] Could only allocate 2 dirs of requested 3 for tablet 00000000000000000000000000000000. 2 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:09.077713  2032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32: Bootstrap starting.
I20260812 06:37:09.080498  2032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:09.081363  2032 log.cc:826] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:09.083331  2032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32: No bootstrap required, opened a new log
I20260812 06:37:09.086277  2032 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6950cc7ab7054b999a170eb672e7bc32" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 36947 } }
I20260812 06:37:09.086462  2032 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:09.086534  2032 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6950cc7ab7054b999a170eb672e7bc32, State: Initialized, Role: FOLLOWER
I20260812 06:37:09.086961  2032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6950cc7ab7054b999a170eb672e7bc32" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 36947 } }
I20260812 06:37:09.087086  2032 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:09.087149  2032 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:09.087282  2032 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:09.088130  2032 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6950cc7ab7054b999a170eb672e7bc32" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 36947 } }
I20260812 06:37:09.088474  2032 leader_election.cc:304] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6950cc7ab7054b999a170eb672e7bc32; no voters: 
I20260812 06:37:09.088792  2032 leader_election.cc:290] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:09.089044  2040 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:09.089236  2040 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [term 1 LEADER]: Becoming Leader. State: Replica: 6950cc7ab7054b999a170eb672e7bc32, State: Running, Role: LEADER
I20260812 06:37:09.089537  2040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6950cc7ab7054b999a170eb672e7bc32" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 36947 } }
I20260812 06:37:09.089937  2032 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:09.091092  2041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6950cc7ab7054b999a170eb672e7bc32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6950cc7ab7054b999a170eb672e7bc32" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 36947 } } }
I20260812 06:37:09.091240  2041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:09.091979  2043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6950cc7ab7054b999a170eb672e7bc32. Latest consensus state: current_term: 1 leader_uuid: "6950cc7ab7054b999a170eb672e7bc32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6950cc7ab7054b999a170eb672e7bc32" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 36947 } } }
I20260812 06:37:09.092124  2043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:09.092770  2052 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:09.095580  2052 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:09.100800  2052 catalog_manager.cc:1383] Generated new cluster ID: bbf219a0714b4c5f828bacd077ec9ab3
I20260812 06:37:09.100886  2052 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:09.124336  2052 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:09.125159  2052 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:09.139071  2052 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 6950cc7ab7054b999a170eb672e7bc32: Generated new TSK 0
I20260812 06:37:09.139807  2052 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:09.147382  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-1
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-0/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.1:0
--local_ip_for_outbound_sockets=127.1.223.1
--webserver_interface=127.1.223.1
--webserver_port=0
--tserver_master_addrs=127.1.223.62:36947
--builtin_ntp_servers=127.1.223.20:42961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20260812 06:37:09.256961  2066 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:09.257207  2066 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:09.257252  2066 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:09.260895  2066 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:09.261019  2066 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.1
I20260812 06:37:09.265189  2066 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:42961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-1
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-0/info.pb
--webserver_interface=127.1.223.1
--webserver_port=0
--tserver_master_addrs=127.1.223.62:36947
--never_fsync=true
--heap_profile_path=/tmp/kudu.2066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:09.266356  2066 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:09.267609  2066 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:09.274240  2075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.274389  2074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.274528  2077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:09.274618  2066 server_base.cc:1061] running on GCE node
I20260812 06:37:09.274978  2066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:09.275617  2066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:09.276778  2066 hybrid_clock.cc:648] HybridClock initialized: now 1786516629276761 us; error 31 us; skew 500 ppm
I20260812 06:37:09.278591  2066 webserver.cc:533] Webserver started at http://127.1.223.1:33525/ using document root <none> and password file <none>
I20260812 06:37:09.279292  2066 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:09.279353  2066 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:09.279665  2066 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:09.281322  2066 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-0/instance:
uuid: "f8a0776366984cc9a2d04a506c408257"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.281843  2066 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-1/instance:
uuid: "f8a0776366984cc9a2d04a506c408257"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.282162  2066 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal/instance:
uuid: "f8a0776366984cc9a2d04a506c408257"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.286842  2066 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260812 06:37:09.289389  2092 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.289383  2093 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.290695  2066 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:09.290844  2066 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-1,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
uuid: "f8a0776366984cc9a2d04a506c408257"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.290966  2066 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
2 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-0/data, /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-1/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:09.317294  2066 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:09.318055  2066 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:09.318279  2066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:09.318907  2066 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:09.320039  2066 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:09.320120  2066 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.320192  2066 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:09.320238  2066 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.329948  2066 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.1:33153
I20260812 06:37:09.330015  2262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.1:33153 every 8 connection(s)
I20260812 06:37:09.330977  2066 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/data-0/info.pb
I20260812 06:37:09.334920  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 2066
I20260812 06:37:09.335057  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:09.337457  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-1
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-0/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.2:0
--local_ip_for_outbound_sockets=127.1.223.2
--webserver_interface=127.1.223.2
--webserver_port=0
--tserver_master_addrs=127.1.223.62:36947
--builtin_ntp_servers=127.1.223.20:42961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 06:37:09.340540  2264 heartbeater.cc:344] Connected to a master server at 127.1.223.62:36947
I20260812 06:37:09.340804  2264 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:09.341334  2264 heartbeater.cc:507] Master 127.1.223.62:36947 requested a full tablet report, sending...
I20260812 06:37:09.342878  1978 ts_manager.cc:194] Registered new tserver with Master: f8a0776366984cc9a2d04a506c408257 (127.1.223.1:33153)
I20260812 06:37:09.344084  1978 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.1:36445
W20260812 06:37:09.450906  2267 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:09.451171  2267 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:09.451251  2267 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:09.454698  2267 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:09.454877  2267 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.2
I20260812 06:37:09.458763  2267 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:42961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-1
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-0/info.pb
--webserver_interface=127.1.223.2
--webserver_port=0
--tserver_master_addrs=127.1.223.62:36947
--never_fsync=true
--heap_profile_path=/tmp/kudu.2267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:09.459942  2267 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:09.461079  2267 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:09.467505  2281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.467518  2279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.467499  2277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:09.467895  2267 server_base.cc:1061] running on GCE node
I20260812 06:37:09.468295  2267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:09.468861  2267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:09.470083  2267 hybrid_clock.cc:648] HybridClock initialized: now 1786516629470071 us; error 35 us; skew 500 ppm
I20260812 06:37:09.472139  2267 webserver.cc:533] Webserver started at http://127.1.223.2:37469/ using document root <none> and password file <none>
I20260812 06:37:09.472772  2267 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:09.472869  2267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:09.473096  2267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:09.474758  2267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-0/instance:
uuid: "7e964de7af224497ade2d040a1576b32"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.475274  2267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-1/instance:
uuid: "7e964de7af224497ade2d040a1576b32"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.475625  2267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal/instance:
uuid: "7e964de7af224497ade2d040a1576b32"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.479935  2267 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:09.482300  2296 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.482321  2294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.483727  2267 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:09.483839  2267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-1,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
uuid: "7e964de7af224497ade2d040a1576b32"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.483940  2267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
2 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-0/data, /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-1/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:09.513844  2267 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:09.514539  2267 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:09.514762  2267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:09.515362  2267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:09.516506  2267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:09.516585  2267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.516659  2267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:09.516709  2267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.527868  2267 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.2:34847
I20260812 06:37:09.527909  2474 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.2:34847 every 8 connection(s)
I20260812 06:37:09.528889  2267 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/data-0/info.pb
I20260812 06:37:09.535373  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 2267
I20260812 06:37:09.535526  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:09.537957  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-1
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-0/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.3:0
--local_ip_for_outbound_sockets=127.1.223.3
--webserver_interface=127.1.223.3
--webserver_port=0
--tserver_master_addrs=127.1.223.62:36947
--builtin_ntp_servers=127.1.223.20:42961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 06:37:09.541082  2475 heartbeater.cc:344] Connected to a master server at 127.1.223.62:36947
I20260812 06:37:09.541350  2475 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:09.541906  2475 heartbeater.cc:507] Master 127.1.223.62:36947 requested a full tablet report, sending...
I20260812 06:37:09.543169  1978 ts_manager.cc:194] Registered new tserver with Master: 7e964de7af224497ade2d040a1576b32 (127.1.223.2:34847)
I20260812 06:37:09.544042  1978 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.2:49527
W20260812 06:37:09.652349  2478 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:09.652575  2478 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:09.652617  2478 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:09.655977  2478 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:09.656087  2478 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.3
I20260812 06:37:09.659960  2478 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:42961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-1
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-0/info.pb
--webserver_interface=127.1.223.3
--webserver_port=0
--tserver_master_addrs=127.1.223.62:36947
--never_fsync=true
--heap_profile_path=/tmp/kudu.2478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:09.661055  2478 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:09.662405  2478 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:09.669127  2497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.669170  2490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:09.669124  2488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:09.669360  2478 server_base.cc:1061] running on GCE node
I20260812 06:37:09.669967  2478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:09.670564  2478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:09.671773  2478 hybrid_clock.cc:648] HybridClock initialized: now 1786516629671714 us; error 71 us; skew 500 ppm
I20260812 06:37:09.677728  2478 webserver.cc:533] Webserver started at http://127.1.223.3:44091/ using document root <none> and password file <none>
I20260812 06:37:09.678505  2478 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:09.678576  2478 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:09.678823  2478 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:09.680955  2478 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-0/instance:
uuid: "c5ac63db600f4ad7a83531576ca8541f"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.681506  2478 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-1/instance:
uuid: "c5ac63db600f4ad7a83531576ca8541f"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.681809  2478 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal/instance:
uuid: "c5ac63db600f4ad7a83531576ca8541f"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.686213  2478 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 06:37:09.688838  2510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.688848  2509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.690112  2478 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:37:09.690209  2478 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-0,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-1,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
uuid: "c5ac63db600f4ad7a83531576ca8541f"
format_stamp: "Formatted at 2026-08-12 06:37:09 on dist-test-slave-gw5c"
I20260812 06:37:09.690303  2478 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
2 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-0/data, /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-1/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:09.701869  2478 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:09.702498  2478 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:09.702658  2478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:09.703197  2478 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:09.704322  2478 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:09.704383  2478 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.704424  2478 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:09.704439  2478 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:09.714573  2478 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.3:38391
I20260812 06:37:09.714620  2684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.3:38391 every 8 connection(s)
I20260812 06:37:09.715900  2478 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/data-0/info.pb
I20260812 06:37:09.725498  2685 heartbeater.cc:344] Connected to a master server at 127.1.223.62:36947
I20260812 06:37:09.725895  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 2478
I20260812 06:37:09.725904  2685 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:09.725986  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:09.726517  2685 heartbeater.cc:507] Master 127.1.223.62:36947 requested a full tablet report, sending...
I20260812 06:37:09.727669  1978 ts_manager.cc:194] Registered new tserver with Master: c5ac63db600f4ad7a83531576ca8541f (127.1.223.3:38391)
I20260812 06:37:09.728274  1978 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.3:43059
I20260812 06:37:09.728858  1916 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:37:09.749137  1978 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50320:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:09.750263  1978 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:09.766727  2359 tablet_service.cc:1511] Processing CreateTablet for tablet c160c4682a1b4fe1b8cb17d5e6d85599 (DEFAULT_TABLE table=test-workload [id=a363f0caaa534f70bfbc90dd6d1e670e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:09.766754  2588 tablet_service.cc:1511] Processing CreateTablet for tablet c160c4682a1b4fe1b8cb17d5e6d85599 (DEFAULT_TABLE table=test-workload [id=a363f0caaa534f70bfbc90dd6d1e670e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:09.766755  2162 tablet_service.cc:1511] Processing CreateTablet for tablet c160c4682a1b4fe1b8cb17d5e6d85599 (DEFAULT_TABLE table=test-workload [id=a363f0caaa534f70bfbc90dd6d1e670e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:09.767793  2359 data_dirs.cc:400] Could only allocate 2 dirs of requested 3 for tablet c160c4682a1b4fe1b8cb17d5e6d85599. 2 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:09.767810  2162 data_dirs.cc:400] Could only allocate 2 dirs of requested 3 for tablet c160c4682a1b4fe1b8cb17d5e6d85599. 2 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:09.767810  2588 data_dirs.cc:400] Could only allocate 2 dirs of requested 3 for tablet c160c4682a1b4fe1b8cb17d5e6d85599. 2 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:09.773099  2730 tablet_bootstrap.cc:492] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Bootstrap starting.
I20260812 06:37:09.774014  2732 tablet_bootstrap.cc:492] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Bootstrap starting.
I20260812 06:37:09.774375  2733 tablet_bootstrap.cc:492] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f: Bootstrap starting.
I20260812 06:37:09.775600  2730 tablet_bootstrap.cc:654] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:09.776324  2733 tablet_bootstrap.cc:654] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:09.776324  2732 tablet_bootstrap.cc:654] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:09.776340  2730 log.cc:826] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:09.777105  2732 log.cc:826] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:09.777104  2733 log.cc:826] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:09.778204  2730 tablet_bootstrap.cc:492] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: No bootstrap required, opened a new log
I20260812 06:37:09.778438  2730 ts_tablet_manager.cc:1403] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Time spent bootstrapping tablet: real 0.006s	user 0.000s	sys 0.004s
I20260812 06:37:09.778765  2732 tablet_bootstrap.cc:492] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: No bootstrap required, opened a new log
I20260812 06:37:09.778765  2733 tablet_bootstrap.cc:492] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f: No bootstrap required, opened a new log
I20260812 06:37:09.778944  2733 ts_tablet_manager.cc:1403] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:37:09.778944  2732 ts_tablet_manager.cc:1403] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:09.781561  2730 raft_consensus.cc:359] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.781785  2730 raft_consensus.cc:385] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:09.781858  2730 raft_consensus.cc:740] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e964de7af224497ade2d040a1576b32, State: Initialized, Role: FOLLOWER
I20260812 06:37:09.782053  2733 raft_consensus.cc:359] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.782053  2732 raft_consensus.cc:359] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.782263  2732 raft_consensus.cc:385] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:09.782263  2733 raft_consensus.cc:385] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:09.782323  2733 raft_consensus.cc:740] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ac63db600f4ad7a83531576ca8541f, State: Initialized, Role: FOLLOWER
I20260812 06:37:09.782423  2732 raft_consensus.cc:740] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a0776366984cc9a2d04a506c408257, State: Initialized, Role: FOLLOWER
I20260812 06:37:09.782361  2730 consensus_queue.cc:260] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.782806  2733 consensus_queue.cc:260] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.782806  2732 consensus_queue.cc:260] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.783186  2475 heartbeater.cc:499] Master 127.1.223.62:36947 was elected leader, sending a full tablet report...
I20260812 06:37:09.783727  2730 ts_tablet_manager.cc:1434] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260812 06:37:09.783883  2733 ts_tablet_manager.cc:1434] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 06:37:09.783880  2732 ts_tablet_manager.cc:1434] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 06:37:09.784211  2264 heartbeater.cc:499] Master 127.1.223.62:36947 was elected leader, sending a full tablet report...
I20260812 06:37:09.784215  2685 heartbeater.cc:499] Master 127.1.223.62:36947 was elected leader, sending a full tablet report...
W20260812 06:37:09.832209  2265 tablet.cc:2406] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:09.897387  2742 raft_consensus.cc:493] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:09.897645  2742 raft_consensus.cc:515] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.898833  2742 leader_election.cc:290] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ac63db600f4ad7a83531576ca8541f (127.1.223.3:38391), 7e964de7af224497ade2d040a1576b32 (127.1.223.2:34847)
I20260812 06:37:09.903538  2390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c160c4682a1b4fe1b8cb17d5e6d85599" candidate_uuid: "f8a0776366984cc9a2d04a506c408257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e964de7af224497ade2d040a1576b32" is_pre_election: true
I20260812 06:37:09.903731  2616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c160c4682a1b4fe1b8cb17d5e6d85599" candidate_uuid: "f8a0776366984cc9a2d04a506c408257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ac63db600f4ad7a83531576ca8541f" is_pre_election: true
I20260812 06:37:09.903891  2390 raft_consensus.cc:2468] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a0776366984cc9a2d04a506c408257 in term 0.
I20260812 06:37:09.903949  2616 raft_consensus.cc:2468] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a0776366984cc9a2d04a506c408257 in term 0.
I20260812 06:37:09.904462  2095 leader_election.cc:304] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7e964de7af224497ade2d040a1576b32, c5ac63db600f4ad7a83531576ca8541f, f8a0776366984cc9a2d04a506c408257; no voters: 
I20260812 06:37:09.904762  2742 raft_consensus.cc:2804] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:09.904855  2742 raft_consensus.cc:493] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:09.904917  2742 raft_consensus.cc:3060] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:09.905821  2742 raft_consensus.cc:515] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.906224  2742 leader_election.cc:290] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [CANDIDATE]: Term 1 election: Requested vote from peers c5ac63db600f4ad7a83531576ca8541f (127.1.223.3:38391), 7e964de7af224497ade2d040a1576b32 (127.1.223.2:34847)
I20260812 06:37:09.906623  2390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c160c4682a1b4fe1b8cb17d5e6d85599" candidate_uuid: "f8a0776366984cc9a2d04a506c408257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e964de7af224497ade2d040a1576b32"
I20260812 06:37:09.906623  2616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c160c4682a1b4fe1b8cb17d5e6d85599" candidate_uuid: "f8a0776366984cc9a2d04a506c408257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ac63db600f4ad7a83531576ca8541f"
I20260812 06:37:09.906754  2390 raft_consensus.cc:3060] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:09.906754  2616 raft_consensus.cc:3060] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:09.907907  2390 raft_consensus.cc:2468] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a0776366984cc9a2d04a506c408257 in term 1.
I20260812 06:37:09.907912  2616 raft_consensus.cc:2468] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a0776366984cc9a2d04a506c408257 in term 1.
I20260812 06:37:09.908239  2095 leader_election.cc:304] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e964de7af224497ade2d040a1576b32, f8a0776366984cc9a2d04a506c408257; no voters: 
I20260812 06:37:09.908458  2742 raft_consensus.cc:2804] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:09.908664  2742 raft_consensus.cc:697] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [term 1 LEADER]: Becoming Leader. State: Replica: f8a0776366984cc9a2d04a506c408257, State: Running, Role: LEADER
I20260812 06:37:09.908980  2742 consensus_queue.cc:237] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } }
I20260812 06:37:09.912123  1977 catalog_manager.cc:5719] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a0776366984cc9a2d04a506c408257 (127.1.223.1). New cstate: current_term: 1 leader_uuid: "f8a0776366984cc9a2d04a506c408257" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a0776366984cc9a2d04a506c408257" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 33153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:09.966949  2686 tablet.cc:2406] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:09.987437  2616 raft_consensus.cc:1275] T c160c4682a1b4fe1b8cb17d5e6d85599 P c5ac63db600f4ad7a83531576ca8541f [term 1 FOLLOWER]: Refusing update from remote peer f8a0776366984cc9a2d04a506c408257: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:09.988305  2742 consensus_queue.cc:1048] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ac63db600f4ad7a83531576ca8541f" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 38391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:09.993059  2390 raft_consensus.cc:1275] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 1 FOLLOWER]: Refusing update from remote peer f8a0776366984cc9a2d04a506c408257: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:09.993808  2742 consensus_queue.cc:1048] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e964de7af224497ade2d040a1576b32" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:09.999678  2758 mvcc.cc:204] Tried to move back new op lower bound from 7317572116428623872 to 7317572116109905920. Current Snapshot: MvccSnapshot[applied={T|T < 7317572116417560576}]
I20260812 06:37:10.001480  2759 mvcc.cc:204] Tried to move back new op lower bound from 7317572116428623872 to 7317572116109905920. Current Snapshot: MvccSnapshot[applied={T|T < 7317572116417560576}]
I20260812 06:37:10.007567  2761 mvcc.cc:204] Tried to move back new op lower bound from 7317572116432666624 to 7317572116109905920. Current Snapshot: MvccSnapshot[applied={T|T < 7317572116417560576}]
I20260812 06:37:10.162489  2359 tablet_service.cc:1558] Processing DeleteTablet for tablet c160c4682a1b4fe1b8cb17d5e6d85599 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:42110
I20260812 06:37:10.163285  2783 tablet_replica.cc:333] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: stopping tablet replica
I20260812 06:37:10.163640  2783 raft_consensus.cc:2243] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:10.163929  2783 raft_consensus.cc:2272] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:10.165513  2783 ts_tablet_manager.cc:1916] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:10.167651  2783 ts_tablet_manager.cc:1929] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.32
I20260812 06:37:10.167788  2783 log.cc:1199] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Deleting WAL directory at /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal/wals/c160c4682a1b4fe1b8cb17d5e6d85599
W20260812 06:37:10.169698  2464 generic_service.cc:139] {username='slave'} at 127.0.0.1:42110 forcing change of non-runtime-safe flag env_inject_eio_globs
I20260812 06:37:10.169803  2464 generic_service.cc:175] {username='slave'} at 127.0.0.1:42110 changed flags via RPC: env_inject_eio_globs from '*' to '/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestCopyAfterFailedCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal/tablet-meta/**'
W20260812 06:37:10.171000  2464 generic_service.cc:139] {username='slave'} at 127.0.0.1:42110 forcing change of non-runtime-safe flag env_inject_eio
I20260812 06:37:10.171092  2464 generic_service.cc:175] {username='slave'} at 127.0.0.1:42110 changed flags via RPC: env_inject_eio from '0' to '0.10'
I20260812 06:37:10.172602  2784 ts_tablet_manager.cc:933] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Initiating tablet copy from peer f8a0776366984cc9a2d04a506c408257 (127.1.223.1:33153)
I20260812 06:37:10.173179  2784 tablet_copy_client.cc:323] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet copy: Beginning tablet copy session from remote peer at address 127.1.223.1:33153
I20260812 06:37:10.177241  2224 tablet_copy_service.cc:140] P f8a0776366984cc9a2d04a506c408257: Received BeginTabletCopySession request for tablet c160c4682a1b4fe1b8cb17d5e6d85599 from peer 7e964de7af224497ade2d040a1576b32 ({username='slave'} at 127.1.223.2:33029)
I20260812 06:37:10.177445  2224 tablet_copy_service.cc:161] P f8a0776366984cc9a2d04a506c408257: Beginning new tablet copy session on tablet c160c4682a1b4fe1b8cb17d5e6d85599 from peer 7e964de7af224497ade2d040a1576b32 at {username='slave'} at 127.1.223.2:33029: session id = 7e964de7af224497ade2d040a1576b32-c160c4682a1b4fe1b8cb17d5e6d85599
I20260812 06:37:10.178696  2224 tablet_copy_source_session.cc:215] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:10.180136  2784 ts_tablet_manager.cc:1916] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Deleting tablet data with delete state TABLET_DATA_COPYING
W20260812 06:37:10.180397  2784 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 06:37:10.180455  2784 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20260812 06:37:10.180521  2784 env_posix.cc:431] I/O error, context: INJECTED FAILURE
I20260812 06:37:10.181524  2224 tablet_copy_service.cc:342] P f8a0776366984cc9a2d04a506c408257: Request end of tablet copy session 7e964de7af224497ade2d040a1576b32-c160c4682a1b4fe1b8cb17d5e6d85599 received from {username='slave'} at 127.1.223.2:33029
I20260812 06:37:10.181646  2224 tablet_copy_service.cc:434] P f8a0776366984cc9a2d04a506c408257: ending tablet copy session 7e964de7af224497ade2d040a1576b32-c160c4682a1b4fe1b8cb17d5e6d85599 on tablet c160c4682a1b4fe1b8cb17d5e6d85599 with peer 7e964de7af224497ade2d040a1576b32
I20260812 06:37:10.182718  2784 ts_tablet_manager.cc:1916] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:10.184674  2784 ts_tablet_manager.cc:1929] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.32
I20260812 06:37:10.188119  2784 ts_tablet_manager.cc:933] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Initiating tablet copy from peer f8a0776366984cc9a2d04a506c408257 (127.1.223.1:33153)
I20260812 06:37:10.188508  2784 tablet_copy_client.cc:323] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet copy: Beginning tablet copy session from remote peer at address 127.1.223.1:33153
I20260812 06:37:10.189095  2224 tablet_copy_service.cc:140] P f8a0776366984cc9a2d04a506c408257: Received BeginTabletCopySession request for tablet c160c4682a1b4fe1b8cb17d5e6d85599 from peer 7e964de7af224497ade2d040a1576b32 ({username='slave'} at 127.1.223.2:33029)
I20260812 06:37:10.189220  2224 tablet_copy_service.cc:161] P f8a0776366984cc9a2d04a506c408257: Beginning new tablet copy session on tablet c160c4682a1b4fe1b8cb17d5e6d85599 from peer 7e964de7af224497ade2d040a1576b32 at {username='slave'} at 127.1.223.2:33029: session id = 7e964de7af224497ade2d040a1576b32-c160c4682a1b4fe1b8cb17d5e6d85599
I20260812 06:37:10.189950  2224 tablet_copy_source_session.cc:215] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:10.190668  2784 ts_tablet_manager.cc:1916] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Deleting tablet data with delete state TABLET_DATA_COPYING
E20260812 06:37:10.192451  2784 env_posix.cc:431] I/O error, context: INJECTED FAILURE
I20260812 06:37:10.193122  2224 tablet_copy_service.cc:342] P f8a0776366984cc9a2d04a506c408257: Request end of tablet copy session 7e964de7af224497ade2d040a1576b32-c160c4682a1b4fe1b8cb17d5e6d85599 received from {username='slave'} at 127.1.223.2:33029
I20260812 06:37:10.193199  2224 tablet_copy_service.cc:434] P f8a0776366984cc9a2d04a506c408257: ending tablet copy session 7e964de7af224497ade2d040a1576b32-c160c4682a1b4fe1b8cb17d5e6d85599 on tablet c160c4682a1b4fe1b8cb17d5e6d85599 with peer 7e964de7af224497ade2d040a1576b32
W20260812 06:37:10.193711  2464 generic_service.cc:139] {username='slave'} at 127.0.0.1:42110 forcing change of non-runtime-safe flag env_inject_eio
I20260812 06:37:10.193771  2464 generic_service.cc:175] {username='slave'} at 127.0.0.1:42110 changed flags via RPC: env_inject_eio from '0.10000000000000001' to '0.0'
I20260812 06:37:10.193804  2784 ts_tablet_manager.cc:1916] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:10.195727  2784 ts_tablet_manager.cc:1929] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.32
I20260812 06:37:10.196849  2784 ts_tablet_manager.cc:933] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Initiating tablet copy from peer f8a0776366984cc9a2d04a506c408257 (127.1.223.1:33153)
I20260812 06:37:10.197166  2784 tablet_copy_client.cc:323] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet copy: Beginning tablet copy session from remote peer at address 127.1.223.1:33153
I20260812 06:37:10.197745  2224 tablet_copy_service.cc:140] P f8a0776366984cc9a2d04a506c408257: Received BeginTabletCopySession request for tablet c160c4682a1b4fe1b8cb17d5e6d85599 from peer 7e964de7af224497ade2d040a1576b32 ({username='slave'} at 127.1.223.2:33029)
I20260812 06:37:10.197867  2224 tablet_copy_service.cc:161] P f8a0776366984cc9a2d04a506c408257: Beginning new tablet copy session on tablet c160c4682a1b4fe1b8cb17d5e6d85599 from peer 7e964de7af224497ade2d040a1576b32 at {username='slave'} at 127.1.223.2:33029: session id = 7e964de7af224497ade2d040a1576b32-c160c4682a1b4fe1b8cb17d5e6d85599
I20260812 06:37:10.198551  2224 tablet_copy_source_session.cc:215] T c160c4682a1b4fe1b8cb17d5e6d85599 P f8a0776366984cc9a2d04a506c408257: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:10.199241  2784 ts_tablet_manager.cc:1916] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:37:10.200867  2784 ts_tablet_manager.cc:1929] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.32
I20260812 06:37:10.201099  2784 data_dirs.cc:400] Could only allocate 2 dirs of requested 3 for tablet c160c4682a1b4fe1b8cb17d5e6d85599. 2 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:10.202119  2784 tablet_copy_client.cc:806] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet copy: Starting download of 0 data blocks...
I20260812 06:37:10.202322  2784 tablet_copy_client.cc:670] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet copy: Starting download of 1 WAL segments...
I20260812 06:37:10.203920  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 2066
I20260812 06:37:10.207743  2784 tablet_copy_client.cc:538] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:37:10.209576  2784 tablet_bootstrap.cc:492] T c160c4682a1b4fe1b8cb17d5e6d85599 P 7e964de7af224497ade2d040a1576b32: Bootstrap starting.
I20260812 06:37:10.218372  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 2267
I20260812 06:37:10.237061  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 2478
I20260812 06:37:10.259519  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 1930
2026-08-12T06:37:10Z chronyd exiting
[       OK ] TabletCopyITest.TestCopyAfterFailedCopy (1417 ms)
[ RUN      ] TabletCopyITest.TestSlowCopyDoesntFail
2026-08-12T06:37:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:10Z Disabled control of system clock
I20260812 06:37:10.301699  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:32901
--webserver_interface=127.1.223.62
--webserver_port=0
--builtin_ntp_servers=127.1.223.20:35869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.223.62:32901
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 06:37:10.417496  2799 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:10.417752  2799 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:10.417795  2799 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:10.424410  2799 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:10.424508  2799 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:10.424531  2799 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:10.424551  2799 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:10.429445  2799 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:35869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.1.223.62:32901
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:32901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.223.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:10.431103  2799 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:10.432526  2799 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:10.439602  2806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:10.439602  2810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:10.439857  2799 server_base.cc:1061] running on GCE node
W20260812 06:37:10.439689  2808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:10.440646  2799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:10.441656  2799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:10.442853  2799 hybrid_clock.cc:648] HybridClock initialized: now 1786516630442835 us; error 44 us; skew 500 ppm
I20260812 06:37:10.445219  2799 webserver.cc:533] Webserver started at http://127.1.223.62:42439/ using document root <none> and password file <none>
I20260812 06:37:10.445906  2799 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:10.445976  2799 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:10.446206  2799 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:10.448071  2799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data/instance:
uuid: "ebab51a682ce4d4284bc630fb6e1bbff"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.448630  2799 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/wal/instance:
uuid: "ebab51a682ce4d4284bc630fb6e1bbff"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.452491  2799 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:10.455361  2819 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:10.456763  2799 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:37:10.456962  2799 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/wal
uuid: "ebab51a682ce4d4284bc630fb6e1bbff"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.457101  2799 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:10.469321  2799 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:10.470135  2799 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:10.470463  2799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:10.478943  2799 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.62:32901
I20260812 06:37:10.479163  2909 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.62:32901 every 8 connection(s)
I20260812 06:37:10.480268  2799 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:10.484058  2910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:10.489173  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 2799
I20260812 06:37:10.489305  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/wal/instance
I20260812 06:37:10.490128  2910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff: Bootstrap starting.
I20260812 06:37:10.492951  2910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:10.493960  2910 log.cc:826] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:10.496060  2910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff: No bootstrap required, opened a new log
I20260812 06:37:10.499486  2910 raft_consensus.cc:359] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebab51a682ce4d4284bc630fb6e1bbff" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 32901 } }
I20260812 06:37:10.499759  2910 raft_consensus.cc:385] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:10.499831  2910 raft_consensus.cc:740] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebab51a682ce4d4284bc630fb6e1bbff, State: Initialized, Role: FOLLOWER
I20260812 06:37:10.500342  2910 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebab51a682ce4d4284bc630fb6e1bbff" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 32901 } }
I20260812 06:37:10.500527  2910 raft_consensus.cc:399] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:10.500595  2910 raft_consensus.cc:493] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:10.500715  2910 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:10.501622  2910 raft_consensus.cc:515] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebab51a682ce4d4284bc630fb6e1bbff" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 32901 } }
I20260812 06:37:10.502000  2910 leader_election.cc:304] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebab51a682ce4d4284bc630fb6e1bbff; no voters: 
I20260812 06:37:10.502347  2910 leader_election.cc:290] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:10.502477  2918 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:10.502740  2918 raft_consensus.cc:697] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [term 1 LEADER]: Becoming Leader. State: Replica: ebab51a682ce4d4284bc630fb6e1bbff, State: Running, Role: LEADER
I20260812 06:37:10.503082  2918 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebab51a682ce4d4284bc630fb6e1bbff" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 32901 } }
I20260812 06:37:10.503715  2910 sys_catalog.cc:565] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:10.504967  2919 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebab51a682ce4d4284bc630fb6e1bbff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebab51a682ce4d4284bc630fb6e1bbff" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 32901 } } }
I20260812 06:37:10.505152  2919 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:10.504963  2920 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebab51a682ce4d4284bc630fb6e1bbff. Latest consensus state: current_term: 1 leader_uuid: "ebab51a682ce4d4284bc630fb6e1bbff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebab51a682ce4d4284bc630fb6e1bbff" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 32901 } } }
I20260812 06:37:10.505414  2920 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:10.507019  2929 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:10.510144  2929 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:10.516513  2929 catalog_manager.cc:1383] Generated new cluster ID: 4059c92333b3438e9e3599879732aeef
I20260812 06:37:10.516645  2929 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:10.532217  2929 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:10.533468  2929 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:10.544090  2929 catalog_manager.cc:6092] T 00000000000000000000000000000000 P ebab51a682ce4d4284bc630fb6e1bbff: Generated new TSK 0
I20260812 06:37:10.544749  2929 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:10.551213  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.1:0
--local_ip_for_outbound_sockets=127.1.223.1
--webserver_interface=127.1.223.1
--webserver_port=0
--tserver_master_addrs=127.1.223.62:32901
--builtin_ntp_servers=127.1.223.20:35869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--tablet_copy_download_file_inject_latency_ms=5000
--follower_unavailable_considered_failed_sec=2 with env {}
W20260812 06:37:10.668083  2941 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:10.668349  2941 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:10.668371  2941 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:10.668479  2941 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:10.672114  2941 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:10.672257  2941 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.1
I20260812 06:37:10.676527  2941 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:35869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.223.1
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=5000
--tserver_master_addrs=127.1.223.62:32901
--never_fsync=true
--heap_profile_path=/tmp/kudu.2941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:10.677778  2941 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:10.679028  2941 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:10.686297  2951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:10.686372  2949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:10.686638  2948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:10.686969  2941 server_base.cc:1061] running on GCE node
I20260812 06:37:10.687381  2941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:10.688059  2941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:10.689271  2941 hybrid_clock.cc:648] HybridClock initialized: now 1786516630689257 us; error 34 us; skew 500 ppm
I20260812 06:37:10.691640  2941 webserver.cc:533] Webserver started at http://127.1.223.1:34985/ using document root <none> and password file <none>
I20260812 06:37:10.692258  2941 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:10.692342  2941 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:10.692577  2941 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:10.694402  2941 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data/instance:
uuid: "655dc77c27a94d4982bded34637ea861"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.694985  2941 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/wal/instance:
uuid: "655dc77c27a94d4982bded34637ea861"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.699005  2941 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 06:37:10.701776  2959 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:10.702963  2941 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:10.703136  2941 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/wal
uuid: "655dc77c27a94d4982bded34637ea861"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.703263  2941 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:10.713192  2941 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:10.713918  2941 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:10.714120  2941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:10.714728  2941 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:10.715891  2941 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:10.715965  2941 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:10.716032  2941 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:10.716079  2941 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:10.725838  2941 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.1:39781
I20260812 06:37:10.725929  3130 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.1:39781 every 8 connection(s)
I20260812 06:37:10.726902  2941 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:10.729104  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 2941
I20260812 06:37:10.729228  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:10.731689  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.2:0
--local_ip_for_outbound_sockets=127.1.223.2
--webserver_interface=127.1.223.2
--webserver_port=0
--tserver_master_addrs=127.1.223.62:32901
--builtin_ntp_servers=127.1.223.20:35869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--tablet_copy_download_file_inject_latency_ms=5000
--follower_unavailable_considered_failed_sec=2 with env {}
I20260812 06:37:10.735910  3131 heartbeater.cc:344] Connected to a master server at 127.1.223.62:32901
I20260812 06:37:10.736168  3131 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:10.736739  3131 heartbeater.cc:507] Master 127.1.223.62:32901 requested a full tablet report, sending...
I20260812 06:37:10.738252  2848 ts_manager.cc:194] Registered new tserver with Master: 655dc77c27a94d4982bded34637ea861 (127.1.223.1:39781)
I20260812 06:37:10.739519  2848 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.1:54751
W20260812 06:37:10.845127  3136 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:10.845379  3136 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:10.845403  3136 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:10.845503  3136 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:10.848999  3136 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:10.849124  3136 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.2
I20260812 06:37:10.853174  3136 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:35869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.223.2
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=5000
--tserver_master_addrs=127.1.223.62:32901
--never_fsync=true
--heap_profile_path=/tmp/kudu.3136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:10.854372  3136 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:10.855556  3136 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:10.862298  3151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:10.862301  3144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:10.862471  3147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:10.862705  3136 server_base.cc:1061] running on GCE node
I20260812 06:37:10.863121  3136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:10.863817  3136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:10.864979  3136 hybrid_clock.cc:648] HybridClock initialized: now 1786516630864935 us; error 60 us; skew 500 ppm
I20260812 06:37:10.867574  3136 webserver.cc:533] Webserver started at http://127.1.223.2:37169/ using document root <none> and password file <none>
I20260812 06:37:10.868249  3136 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:10.868316  3136 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:10.868553  3136 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:10.870308  3136 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data/instance:
uuid: "84373a2458d44cf89e224d7a86f56a77"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.870851  3136 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/wal/instance:
uuid: "84373a2458d44cf89e224d7a86f56a77"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.874571  3136 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.002s
I20260812 06:37:10.877218  3160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:10.878388  3136 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:10.878641  3136 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/wal
uuid: "84373a2458d44cf89e224d7a86f56a77"
format_stamp: "Formatted at 2026-08-12 06:37:10 on dist-test-slave-gw5c"
I20260812 06:37:10.878767  3136 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:10.907289  3136 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:10.908214  3136 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:10.908445  3136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:10.909090  3136 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:10.910171  3136 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:10.910251  3136 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:10.910348  3136 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:10.910395  3136 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:10.920348  3136 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.2:39001
I20260812 06:37:10.920368  3340 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.2:39001 every 8 connection(s)
I20260812 06:37:10.921427  3136 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:10.929929  3341 heartbeater.cc:344] Connected to a master server at 127.1.223.62:32901
I20260812 06:37:10.930246  3341 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:10.930390  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 3136
I20260812 06:37:10.930513  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:10.930933  3341 heartbeater.cc:507] Master 127.1.223.62:32901 requested a full tablet report, sending...
I20260812 06:37:10.932179  2847 ts_manager.cc:194] Registered new tserver with Master: 84373a2458d44cf89e224d7a86f56a77 (127.1.223.2:39001)
I20260812 06:37:10.932806  2847 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.2:50407
I20260812 06:37:10.933349  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.3:0
--local_ip_for_outbound_sockets=127.1.223.3
--webserver_interface=127.1.223.3
--webserver_port=0
--tserver_master_addrs=127.1.223.62:32901
--builtin_ntp_servers=127.1.223.20:35869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--tablet_copy_download_file_inject_latency_ms=5000
--follower_unavailable_considered_failed_sec=2 with env {}
W20260812 06:37:11.044427  3347 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:37:11.044662  3347 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:11.044684  3347 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:11.044785  3347 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:11.048243  3347 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:11.048403  3347 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.3
I20260812 06:37:11.052345  3347 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:35869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=2
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.223.3
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=5000
--tserver_master_addrs=127.1.223.62:32901
--never_fsync=true
--heap_profile_path=/tmp/kudu.3347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:11.053493  3347 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:11.054615  3347 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:11.061118  3358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:11.061121  3362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:11.061118  3359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:11.061725  3347 server_base.cc:1061] running on GCE node
I20260812 06:37:11.062160  3347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:11.062796  3347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:11.064000  3347 hybrid_clock.cc:648] HybridClock initialized: now 1786516631063978 us; error 51 us; skew 500 ppm
I20260812 06:37:11.065932  3347 webserver.cc:533] Webserver started at http://127.1.223.3:37289/ using document root <none> and password file <none>
I20260812 06:37:11.066516  3347 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:11.066605  3347 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:11.066843  3347 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:11.068554  3347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data/instance:
uuid: "478d32f4375a489fb99cf8171f34bd3c"
format_stamp: "Formatted at 2026-08-12 06:37:11 on dist-test-slave-gw5c"
I20260812 06:37:11.069064  3347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/wal/instance:
uuid: "478d32f4375a489fb99cf8171f34bd3c"
format_stamp: "Formatted at 2026-08-12 06:37:11 on dist-test-slave-gw5c"
I20260812 06:37:11.072629  3347 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:11.074836  3372 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:11.075925  3347 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:11.076064  3347 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/wal
uuid: "478d32f4375a489fb99cf8171f34bd3c"
format_stamp: "Formatted at 2026-08-12 06:37:11 on dist-test-slave-gw5c"
I20260812 06:37:11.076175  3347 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:11.121551  3347 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:11.122254  3347 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:11.122468  3347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:11.123090  3347 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:11.124127  3347 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:11.124202  3347 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:11.124274  3347 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:11.124317  3347 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:11.134166  3347 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.3:39837
I20260812 06:37:11.134191  3548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.3:39837 every 8 connection(s)
I20260812 06:37:11.135167  3347 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:11.140977  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 3347
I20260812 06:37:11.141083  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:11.143962  3550 heartbeater.cc:344] Connected to a master server at 127.1.223.62:32901
I20260812 06:37:11.144261  3550 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:11.144822  3550 heartbeater.cc:507] Master 127.1.223.62:32901 requested a full tablet report, sending...
I20260812 06:37:11.145856  2847 ts_manager.cc:194] Registered new tserver with Master: 478d32f4375a489fb99cf8171f34bd3c (127.1.223.3:39837)
I20260812 06:37:11.146376  2847 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.3:55881
I20260812 06:37:11.155757  1916 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:37:11.175266  2847 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33480:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:11.176491  2847 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:11.194788  3438 tablet_service.cc:1511] Processing CreateTablet for tablet 25bf124edf474ce0bc2597f0bdede2ea (DEFAULT_TABLE table=test-workload [id=9ef27ab987c945bf8b75b01e061f87c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:11.194962  3033 tablet_service.cc:1511] Processing CreateTablet for tablet 25bf124edf474ce0bc2597f0bdede2ea (DEFAULT_TABLE table=test-workload [id=9ef27ab987c945bf8b75b01e061f87c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:11.194965  3238 tablet_service.cc:1511] Processing CreateTablet for tablet 25bf124edf474ce0bc2597f0bdede2ea (DEFAULT_TABLE table=test-workload [id=9ef27ab987c945bf8b75b01e061f87c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:11.195861  3438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bf124edf474ce0bc2597f0bdede2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:11.195976  3238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bf124edf474ce0bc2597f0bdede2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:11.195976  3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bf124edf474ce0bc2597f0bdede2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:11.202486  3586 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861: Bootstrap starting.
I20260812 06:37:11.202703  3585 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c: Bootstrap starting.
I20260812 06:37:11.203775  3589 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Bootstrap starting.
I20260812 06:37:11.204862  3585 tablet_bootstrap.cc:654] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:11.204933  3586 tablet_bootstrap.cc:654] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:11.205668  3585 log.cc:826] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:11.205726  3586 log.cc:826] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:11.205840  3589 tablet_bootstrap.cc:654] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:11.206610  3589 log.cc:826] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:11.207679  3586 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861: No bootstrap required, opened a new log
I20260812 06:37:11.207693  3585 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c: No bootstrap required, opened a new log
I20260812 06:37:11.207906  3585 ts_tablet_manager.cc:1403] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c: Time spent bootstrapping tablet: real 0.007s	user 0.001s	sys 0.004s
I20260812 06:37:11.207903  3586 ts_tablet_manager.cc:1403] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861: Time spent bootstrapping tablet: real 0.006s	user 0.001s	sys 0.004s
I20260812 06:37:11.208572  3589 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: No bootstrap required, opened a new log
I20260812 06:37:11.208765  3589 ts_tablet_manager.cc:1403] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.001s
I20260812 06:37:11.210774  3586 raft_consensus.cc:359] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:11.211019  3586 raft_consensus.cc:740] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 655dc77c27a94d4982bded34637ea861, State: Initialized, Role: FOLLOWER
I20260812 06:37:11.211160  3585 raft_consensus.cc:359] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:11.211530  3585 raft_consensus.cc:740] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 478d32f4375a489fb99cf8171f34bd3c, State: Initialized, Role: FOLLOWER
I20260812 06:37:11.211341  3586 consensus_queue.cc:260] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:11.211843  3585 consensus_queue.cc:260] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:11.211798  3589 raft_consensus.cc:359] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:11.211992  3589 raft_consensus.cc:740] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84373a2458d44cf89e224d7a86f56a77, State: Initialized, Role: FOLLOWER
I20260812 06:37:11.212266  3589 consensus_queue.cc:260] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:11.212371  3131 heartbeater.cc:499] Master 127.1.223.62:32901 was elected leader, sending a full tablet report...
I20260812 06:37:11.212747  3585 ts_tablet_manager.cc:1434] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260812 06:37:11.212977  3341 heartbeater.cc:499] Master 127.1.223.62:32901 was elected leader, sending a full tablet report...
I20260812 06:37:11.213063  3589 ts_tablet_manager.cc:1434] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.004s
I20260812 06:37:11.213691  3586 ts_tablet_manager.cc:1434] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:37:11.214128  3550 heartbeater.cc:499] Master 127.1.223.62:32901 was elected leader, sending a full tablet report...
W20260812 06:37:11.228246  3134 tablet.cc:2406] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:11.244482  3061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bf124edf474ce0bc2597f0bdede2ea"
dest_uuid: "655dc77c27a94d4982bded34637ea861"
 from {username='slave'} at 127.0.0.1:53284
I20260812 06:37:11.244732  3061 raft_consensus.cc:493] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:37:11.244833  3061 raft_consensus.cc:3060] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:11.246137  3061 raft_consensus.cc:515] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:11.247210  3061 leader_election.cc:290] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [CANDIDATE]: Term 1 election: Requested vote from peers 84373a2458d44cf89e224d7a86f56a77 (127.1.223.2:39001), 478d32f4375a489fb99cf8171f34bd3c (127.1.223.3:39837)
I20260812 06:37:11.252651  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf124edf474ce0bc2597f0bdede2ea" candidate_uuid: "655dc77c27a94d4982bded34637ea861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "84373a2458d44cf89e224d7a86f56a77"
I20260812 06:37:11.252835  3472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bf124edf474ce0bc2597f0bdede2ea" candidate_uuid: "655dc77c27a94d4982bded34637ea861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "478d32f4375a489fb99cf8171f34bd3c"
I20260812 06:37:11.252912  3272 raft_consensus.cc:3060] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:11.253042  3472 raft_consensus.cc:3060] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:11.254184  3272 raft_consensus.cc:2468] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 655dc77c27a94d4982bded34637ea861 in term 1.
I20260812 06:37:11.254252  3472 raft_consensus.cc:2468] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 655dc77c27a94d4982bded34637ea861 in term 1.
I20260812 06:37:11.254734  2960 leader_election.cc:304] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 655dc77c27a94d4982bded34637ea861, 84373a2458d44cf89e224d7a86f56a77; no voters: 
I20260812 06:37:11.255131  3595 raft_consensus.cc:2804] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:11.255450  3595 raft_consensus.cc:697] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [term 1 LEADER]: Becoming Leader. State: Replica: 655dc77c27a94d4982bded34637ea861, State: Running, Role: LEADER
I20260812 06:37:11.255816  3595 consensus_queue.cc:237] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:11.259577  2843 catalog_manager.cc:5719] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 reported cstate change: term changed from 0 to 1, leader changed from <none> to 655dc77c27a94d4982bded34637ea861 (127.1.223.1). New cstate: current_term: 1 leader_uuid: "655dc77c27a94d4982bded34637ea861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:11.265388  3272 raft_consensus.cc:1275] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 1 FOLLOWER]: Refusing update from remote peer 655dc77c27a94d4982bded34637ea861: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:11.265406  3472 raft_consensus.cc:1275] T 25bf124edf474ce0bc2597f0bdede2ea P 478d32f4375a489fb99cf8171f34bd3c [term 1 FOLLOWER]: Refusing update from remote peer 655dc77c27a94d4982bded34637ea861: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:11.266260  3595 consensus_queue.cc:1048] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:11.266484  3611 consensus_queue.cc:1048] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:11.274045  3613 mvcc.cc:204] Tried to move back new op lower bound from 7317572121662316544 to 7317572121627860992. Current Snapshot: MvccSnapshot[applied={T|T < 7317572121655443456}]
I20260812 06:37:11.276618  3614 mvcc.cc:204] Tried to move back new op lower bound from 7317572121662316544 to 7317572121627860992. Current Snapshot: MvccSnapshot[applied={T|T < 7317572121655443456}]
I20260812 06:37:11.279348  3615 mvcc.cc:204] Tried to move back new op lower bound from 7317572121662316544 to 7317572121627860992. Current Snapshot: MvccSnapshot[applied={T|T < 7317572121655443456}]
I20260812 06:37:11.461807  1916 tablet_copy-itest.cc:973] Tombstoning follower tablet 25bf124edf474ce0bc2597f0bdede2ea on TS 84373a2458d44cf89e224d7a86f56a77
I20260812 06:37:11.462841  3238 tablet_service.cc:1558] Processing DeleteTablet for tablet 25bf124edf474ce0bc2597f0bdede2ea with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:50004
I20260812 06:37:11.464818  3642 tablet_replica.cc:333] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: stopping tablet replica
I20260812 06:37:11.465413  3642 raft_consensus.cc:2243] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:11.465623  3642 pending_rounds.cc:70] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Trying to abort 2 pending ops.
W20260812 06:37:11.466629  2960 consensus_peers.cc:597] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 -> Peer 84373a2458d44cf89e224d7a86f56a77 (127.1.223.2:39001): Couldn't send request to peer 84373a2458d44cf89e224d7a86f56a77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:11.465701  3642 pending_rounds.cc:77] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Aborting op as it isn't in flight: id { term: 1 index: 105 } timestamp: 7317572122470952960 op_type: WRITE_OP write_request { tablet_id: "25bf124edf474ce0bc2597f0bdede2ea" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\233\006v\n\342\230\215M\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""c707d02823e5eb66" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7317572122443014144 authz_token { token_data: "\010\303\253\360\323\006\"3\n\005slave\022*\n 9ef27ab987c945bf8b75b01e061f87c5\020\001\030\001 \001(\001" signature: "<redacted>""\r\322q,\212\313\3644!3\2022\262Z\024\370W\003\305\024\314)!`W\037\270P[\004\335\344\227\264\036\373\337dY\333\024\356P\363\200\300\343I\357*\024@\200\252Hbr8\331\377@\330\272\342" signing_key_seq_num: 0 } } request_id { client_id: "0178c41e2f354ea990a261b39d092257" seq_no: 103 first_incomplete_seq_no: 100 attempt_no: 0 }
I20260812 06:37:11.468160  3642 pending_rounds.cc:77] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Aborting op as it isn't in flight: id { term: 1 index: 104 } timestamp: 7317572122460471296 op_type: WRITE_OP write_request { tablet_id: "25bf124edf474ce0bc2597f0bdede2ea" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\305\235\2065\343\2211\235\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""ef2869a00c5d3f20" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7317572122434228224 authz_token { token_data: "\010\303\253\360\323\006\"3\n\005slave\022*\n 9ef27ab987c945bf8b75b01e061f87c5\020\001\030\001 \001(\001" signature: "<redacted>""\r\322q,\212\313\3644!3\2022\262Z\024\370W\003\305\024\314)!`W\037\270P[\004\335\344\227\264\036\373\337dY\333\024\356P\363\200\300\343I\357*\024@\200\252Hbr8\331\377@\330\272\342" signing_key_seq_num: 0 } } request_id { client_id: "0178c41e2f354ea990a261b39d092257" seq_no: 102 first_incomplete_seq_no: 99 attempt_no: 0 }
I20260812 06:37:11.468418  3642 raft_consensus.cc:2272] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:11.472771  3642 ts_tablet_manager.cc:1916] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:11.476131  3642 ts_tablet_manager.cc:1929] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.105
I20260812 06:37:11.476245  3642 log.cc:1199] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Deleting WAL directory at /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/wal/wals/25bf124edf474ce0bc2597f0bdede2ea
I20260812 06:37:12.401708  3648 ts_tablet_manager.cc:933] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Initiating tablet copy from peer 655dc77c27a94d4982bded34637ea861 (127.1.223.1:39781)
I20260812 06:37:12.404980  3648 tablet_copy_client.cc:323] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: tablet copy: Beginning tablet copy session from remote peer at address 127.1.223.1:39781
I20260812 06:37:12.420428  3096 tablet_copy_service.cc:140] P 655dc77c27a94d4982bded34637ea861: Received BeginTabletCopySession request for tablet 25bf124edf474ce0bc2597f0bdede2ea from peer 84373a2458d44cf89e224d7a86f56a77 ({username='slave'} at 127.1.223.2:53979)
I20260812 06:37:12.420675  3096 tablet_copy_service.cc:161] P 655dc77c27a94d4982bded34637ea861: Beginning new tablet copy session on tablet 25bf124edf474ce0bc2597f0bdede2ea from peer 84373a2458d44cf89e224d7a86f56a77 at {username='slave'} at 127.1.223.2:53979: session id = 84373a2458d44cf89e224d7a86f56a77-25bf124edf474ce0bc2597f0bdede2ea
I20260812 06:37:12.423537  3096 tablet_copy_source_session.cc:215] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:12.426225  3648 ts_tablet_manager.cc:1916] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:37:12.431113  3648 ts_tablet_manager.cc:1929] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.105
I20260812 06:37:12.431782  3648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bf124edf474ce0bc2597f0bdede2ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:12.434554  3648 tablet_copy_client.cc:806] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: tablet copy: Starting download of 0 data blocks...
I20260812 06:37:12.434942  3648 tablet_copy_client.cc:670] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: tablet copy: Starting download of 1 WAL segments...
I20260812 06:37:12.441519  3649 tablet_copy_client.cc:1025] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: tablet copy: Injecting latency into file download: 5000
I20260812 06:37:12.450793  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
I20260812 06:37:12.556591  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
I20260812 06:37:12.762044  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
I20260812 06:37:13.067152  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
I20260812 06:37:13.470657  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
I20260812 06:37:13.973871  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
W20260812 06:37:14.228681  2960 consensus_peers.cc:597] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 -> Peer 84373a2458d44cf89e224d7a86f56a77 (127.1.223.2:39001): Couldn't send request to peer 84373a2458d44cf89e224d7a86f56a77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260812 06:37:14.577186  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
I20260812 06:37:15.280472  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
I20260812 06:37:16.083768  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
W20260812 06:37:16.815382  2960 consensus_peers.cc:597] T 25bf124edf474ce0bc2597f0bdede2ea P 655dc77c27a94d4982bded34637ea861 -> Peer 84373a2458d44cf89e224d7a86f56a77 (127.1.223.2:39001): Couldn't send request to peer 84373a2458d44cf89e224d7a86f56a77. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260812 06:37:16.987097  1916 cluster_itest_util.cc:258] Not converged past 1 yet: 1.520 <uninitialized op> 1.520
I20260812 06:37:17.442703  3648 tablet_copy_client.cc:538] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:37:17.444936  3648 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Bootstrap starting.
I20260812 06:37:17.730237  3648 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Bootstrap replayed 1/1 log segments. Stats: ops{read=516 overwritten=0 applied=515 ignored=0} inserts{seen=514 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:37:17.730736  3648 tablet_bootstrap.cc:492] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Bootstrap complete.
I20260812 06:37:17.731010  3648 ts_tablet_manager.cc:1403] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Time spent bootstrapping tablet: real 0.286s	user 0.260s	sys 0.024s
I20260812 06:37:17.731963  3648 raft_consensus.cc:359] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:17.732440  3648 raft_consensus.cc:740] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84373a2458d44cf89e224d7a86f56a77, State: Initialized, Role: FOLLOWER
I20260812 06:37:17.732600  3648 consensus_queue.cc:260] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 515, Last appended: 1.516, Last appended by leader: 516, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "655dc77c27a94d4982bded34637ea861" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 39781 } } peers { permanent_uuid: "84373a2458d44cf89e224d7a86f56a77" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 39001 } } peers { permanent_uuid: "478d32f4375a489fb99cf8171f34bd3c" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 39837 } }
I20260812 06:37:17.732966  3648 ts_tablet_manager.cc:1434] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77: Time spent starting tablet: real 0.002s	user 0.005s	sys 0.000s
I20260812 06:37:17.733949  3096 tablet_copy_service.cc:342] P 655dc77c27a94d4982bded34637ea861: Request end of tablet copy session 84373a2458d44cf89e224d7a86f56a77-25bf124edf474ce0bc2597f0bdede2ea received from {username='slave'} at 127.1.223.2:53979
I20260812 06:37:17.734089  3096 tablet_copy_service.cc:434] P 655dc77c27a94d4982bded34637ea861: ending tablet copy session 84373a2458d44cf89e224d7a86f56a77-25bf124edf474ce0bc2597f0bdede2ea on tablet 25bf124edf474ce0bc2597f0bdede2ea with peer 84373a2458d44cf89e224d7a86f56a77
I20260812 06:37:17.813735  3272 raft_consensus.cc:1217] T 25bf124edf474ce0bc2597f0bdede2ea P 84373a2458d44cf89e224d7a86f56a77 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.105->[1.106-1.520]   Dedup: 1.516->[1.517-1.520]
I20260812 06:37:18.057785  3033 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 06:37:18.057821  3438 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 06:37:18.057813  3238 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |      Address       | Status
----------------------------------+--------------------+---------
 ebab51a682ce4d4284bc630fb6e1bbff | 127.1.223.62:32901 | HEALTHY

Unusual flags for Master:
                         Flag                         |                                                                            Value                                                                             |      Tags       |         Master
------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 catalog_manager_wait_for_new_tablets_to_elect_leader | false                                                                                                                                                        | hidden          | all 1 server(s) checked
 ipki_ca_key_size                                     | 768                                                                                                                                                          | experimental    | all 1 server(s) checked
 ipki_server_key_size                                 | 768                                                                                                                                                          | experimental    | all 1 server(s) checked
 never_fsync                                          | true                                                                                                                                                         | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override                      | 0                                                                                                                                                            | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                                        | true                                                                                                                                                         | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports                     | true                                                                                                                                                         | unsafe          | all 1 server(s) checked
 server_dump_info_format                              | pb                                                                                                                                                           | hidden          | all 1 server(s) checked
 server_dump_info_path                                | /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                                     | 512                                                                                                                                                          | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |       Value        |         Master
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.1.223.20:35869 | all 1 server(s) checked
 time_source         | builtin            | all 1 server(s) checked

Tablet Server Summary
               UUID               |      Address      | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+-------------------+---------+----------+----------------+-----------------
 478d32f4375a489fb99cf8171f34bd3c | 127.1.223.3:39837 | HEALTHY | <none>   |       0        |       0
 655dc77c27a94d4982bded34637ea861 | 127.1.223.1:39781 | HEALTHY | <none>   |       1        |       0
 84373a2458d44cf89e224d7a86f56a77 | 127.1.223.2:39001 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                    Flag                     |                                                                          Value                                                                           |      Tags       |      Tablet Server
---------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 enable_leader_failure_detection             | false                                                                                                                                                    | unsafe          | all 3 server(s) checked
 ipki_server_key_size                        | 768                                                                                                                                                      | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets               | 127.1.223.1                                                                                                                                              | experimental    | 127.1.223.1:39781
 local_ip_for_outbound_sockets               | 127.1.223.2                                                                                                                                              | experimental    | 127.1.223.2:39001
 local_ip_for_outbound_sockets               | 127.1.223.3                                                                                                                                              | experimental    | 127.1.223.3:39837
 never_fsync                                 | true                                                                                                                                                     | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override             | 0                                                                                                                                                        | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports            | true                                                                                                                                                     | unsafe          | all 3 server(s) checked
 server_dump_info_format                     | pb                                                                                                                                                       | hidden          | all 3 server(s) checked
 server_dump_info_path                       | /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb | hidden          | 127.1.223.1:39781
 server_dump_info_path                       | /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb | hidden          | 127.1.223.2:39001
 server_dump_info_path                       | /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestSlowCopyDoesntFail.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb | hidden          | 127.1.223.3:39837
 tablet_copy_download_file_inject_latency_ms | 5000                                                                                                                                                     | hidden          | all 3 server(s) checked

Flags of checked categories for Tablet Server:
        Flag         |       Value        |      Tablet Server
---------------------+--------------------+-------------------------
 builtin_ntp_servers | 127.1.223.20:35869 | all 3 server(s) checked
 time_source         | builtin            | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 06:37:18.087548  1916 log_verifier.cc:126] Checking tablet 25bf124edf474ce0bc2597f0bdede2ea
I20260812 06:37:18.218346  1916 log_verifier.cc:177] Verified matching terms for 520 ops in tablet 25bf124edf474ce0bc2597f0bdede2ea
I20260812 06:37:18.319742  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 2941
I20260812 06:37:18.356293  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 3136
I20260812 06:37:18.376847  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 3347
I20260812 06:37:18.406702  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 2799
2026-08-12T06:37:18Z chronyd exiting
[       OK ] TabletCopyITest.TestSlowCopyDoesntFail (8151 ms)
[ RUN      ] TabletCopyITest.TestTabletStateMetricsDuringTabletCopy
2026-08-12T06:37:18Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:18Z Disabled control of system clock
I20260812 06:37:18.453982  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:34477
--webserver_interface=127.1.223.62
--webserver_port=0
--builtin_ntp_servers=127.1.223.20:45273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.223.62:34477 with env {}
W20260812 06:37:18.567771  3739 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:18.568013  3739 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:18.568054  3739 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:18.571765  3739 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:18.571851  3739 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:18.571873  3739 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:18.571894  3739 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:18.576112  3739 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:45273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.223.62:34477
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:34477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.223.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.3739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:18.577350  3739 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:18.578534  3739 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 06:37:18.585147  3739 server_base.cc:1061] running on GCE node
W20260812 06:37:18.585073  3745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.585073  3749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.585098  3751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.585983  3739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:18.587016  3739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:18.588198  3739 hybrid_clock.cc:648] HybridClock initialized: now 1786516638588188 us; error 28 us; skew 500 ppm
I20260812 06:37:18.590265  3739 webserver.cc:533] Webserver started at http://127.1.223.62:35303/ using document root <none> and password file <none>
I20260812 06:37:18.590875  3739 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:18.590960  3739 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:18.591187  3739 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:18.592860  3739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/data/instance:
uuid: "5047ab01e16a4dde99402b65355852d8"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-gw5c"
I20260812 06:37:18.593386  3739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/wal/instance:
uuid: "5047ab01e16a4dde99402b65355852d8"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-gw5c"
I20260812 06:37:18.596832  3739 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:37:18.599174  3758 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.600374  3739 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:18.600528  3739 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
uuid: "5047ab01e16a4dde99402b65355852d8"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-gw5c"
I20260812 06:37:18.600663  3739 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:18.610769  3739 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:18.611575  3739 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:18.611778  3739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:18.620240  3739 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.62:34477
I20260812 06:37:18.620253  3848 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.62:34477 every 8 connection(s)
I20260812 06:37:18.621430  3739 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:18.624538  3849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:18.630105  3849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8: Bootstrap starting.
I20260812 06:37:18.630756  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 3739
I20260812 06:37:18.630893  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/master-0/wal/instance
I20260812 06:37:18.633000  3849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:18.633757  3849 log.cc:826] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:18.635520  3849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8: No bootstrap required, opened a new log
I20260812 06:37:18.638267  3849 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5047ab01e16a4dde99402b65355852d8" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 34477 } }
I20260812 06:37:18.638556  3849 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:18.638646  3849 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5047ab01e16a4dde99402b65355852d8, State: Initialized, Role: FOLLOWER
I20260812 06:37:18.639096  3849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5047ab01e16a4dde99402b65355852d8" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 34477 } }
I20260812 06:37:18.639245  3849 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:18.639330  3849 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:18.639482  3849 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:18.640309  3849 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5047ab01e16a4dde99402b65355852d8" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 34477 } }
I20260812 06:37:18.640666  3849 leader_election.cc:304] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5047ab01e16a4dde99402b65355852d8; no voters: 
I20260812 06:37:18.640978  3849 leader_election.cc:290] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:18.641117  3857 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:18.641346  3857 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [term 1 LEADER]: Becoming Leader. State: Replica: 5047ab01e16a4dde99402b65355852d8, State: Running, Role: LEADER
I20260812 06:37:18.641696  3857 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5047ab01e16a4dde99402b65355852d8" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 34477 } }
I20260812 06:37:18.642094  3849 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:18.643311  3859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5047ab01e16a4dde99402b65355852d8. Latest consensus state: current_term: 1 leader_uuid: "5047ab01e16a4dde99402b65355852d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5047ab01e16a4dde99402b65355852d8" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 34477 } } }
I20260812 06:37:18.643477  3859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:18.643757  3858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5047ab01e16a4dde99402b65355852d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5047ab01e16a4dde99402b65355852d8" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 34477 } } }
I20260812 06:37:18.643908  3858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:18.644167  3870 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:18.647006  3870 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:18.651919  3870 catalog_manager.cc:1383] Generated new cluster ID: 91a17e530d6044e787f151f8583a75b1
I20260812 06:37:18.651993  3870 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:18.667112  3870 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:18.668066  3870 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:18.679910  3870 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 5047ab01e16a4dde99402b65355852d8: Generated new TSK 0
I20260812 06:37:18.680609  3870 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:18.689189  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.1:0
--local_ip_for_outbound_sockets=127.1.223.1
--webserver_interface=127.1.223.1
--webserver_port=0
--tserver_master_addrs=127.1.223.62:34477
--builtin_ntp_servers=127.1.223.20:45273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--tablet_state_walk_min_period_ms=10 with env {}
W20260812 06:37:18.800770  3888 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:18.801367  3888 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:18.801739  3888 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:18.806731  3888 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:18.806869  3888 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.1
I20260812 06:37:18.811245  3888 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:45273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.223.1
--webserver_port=0
--tserver_master_addrs=127.1.223.62:34477
--tablet_state_walk_min_period_ms=10
--never_fsync=true
--heap_profile_path=/tmp/kudu.3888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:18.812463  3888 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:18.813614  3888 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:18.820387  3897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.820338  3899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.820433  3888 server_base.cc:1061] running on GCE node
W20260812 06:37:18.820348  3895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.821122  3888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:18.821749  3888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:18.822944  3888 hybrid_clock.cc:648] HybridClock initialized: now 1786516638822935 us; error 35 us; skew 500 ppm
I20260812 06:37:18.824949  3888 webserver.cc:533] Webserver started at http://127.1.223.1:37557/ using document root <none> and password file <none>
I20260812 06:37:18.825582  3888 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:18.825675  3888 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:18.825917  3888 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:18.827610  3888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/data/instance:
uuid: "fe2938b725b34175bc22b2e80e00a029"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-gw5c"
I20260812 06:37:18.828161  3888 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal/instance:
uuid: "fe2938b725b34175bc22b2e80e00a029"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-gw5c"
I20260812 06:37:18.831810  3888 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:18.834638  3908 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.836126  3888 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:18.836254  3888 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
uuid: "fe2938b725b34175bc22b2e80e00a029"
format_stamp: "Formatted at 2026-08-12 06:37:18 on dist-test-slave-gw5c"
I20260812 06:37:18.836365  3888 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:18.849448  3888 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:18.850199  3888 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:18.850430  3888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:18.851066  3888 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:18.852198  3888 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:18.852248  3888 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.852325  3888 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:18.852363  3888 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.862221  3888 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.1:45561
I20260812 06:37:18.862361  4082 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.1:45561 every 8 connection(s)
I20260812 06:37:18.863297  3888 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:18.866743  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 3888
I20260812 06:37:18.866899  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:18.869269  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.2:0
--local_ip_for_outbound_sockets=127.1.223.2
--webserver_interface=127.1.223.2
--webserver_port=0
--tserver_master_addrs=127.1.223.62:34477
--builtin_ntp_servers=127.1.223.20:45273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--tablet_state_walk_min_period_ms=10 with env {}
I20260812 06:37:18.872653  4083 heartbeater.cc:344] Connected to a master server at 127.1.223.62:34477
I20260812 06:37:18.872933  4083 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:18.873502  4083 heartbeater.cc:507] Master 127.1.223.62:34477 requested a full tablet report, sending...
I20260812 06:37:18.875384  3786 ts_manager.cc:194] Registered new tserver with Master: fe2938b725b34175bc22b2e80e00a029 (127.1.223.1:45561)
I20260812 06:37:18.877223  3786 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.1:36945
W20260812 06:37:18.986423  4090 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:18.986670  4090 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:18.986719  4090 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:18.990191  4090 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:18.990314  4090 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.2
I20260812 06:37:18.994217  4090 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:45273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.223.2
--webserver_port=0
--tserver_master_addrs=127.1.223.62:34477
--tablet_state_walk_min_period_ms=10
--never_fsync=true
--heap_profile_path=/tmp/kudu.4090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:18.995347  4090 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:18.996598  4090 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:19.002985  4097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:19.003105  4101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:19.002979  4099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:19.003546  4090 server_base.cc:1061] running on GCE node
I20260812 06:37:19.004004  4090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:19.004655  4090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:19.005847  4090 hybrid_clock.cc:648] HybridClock initialized: now 1786516639005829 us; error 32 us; skew 500 ppm
I20260812 06:37:19.007956  4090 webserver.cc:533] Webserver started at http://127.1.223.2:45287/ using document root <none> and password file <none>
I20260812 06:37:19.008571  4090 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:19.008630  4090 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:19.008849  4090 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:19.010423  4090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/data/instance:
uuid: "157df6771c8948aca6ab31f6a4f90b65"
format_stamp: "Formatted at 2026-08-12 06:37:19 on dist-test-slave-gw5c"
I20260812 06:37:19.010934  4090 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal/instance:
uuid: "157df6771c8948aca6ab31f6a4f90b65"
format_stamp: "Formatted at 2026-08-12 06:37:19 on dist-test-slave-gw5c"
I20260812 06:37:19.014410  4090 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 06:37:19.016816  4111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:19.017823  4090 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:19.017974  4090 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
uuid: "157df6771c8948aca6ab31f6a4f90b65"
format_stamp: "Formatted at 2026-08-12 06:37:19 on dist-test-slave-gw5c"
I20260812 06:37:19.018085  4090 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:19.031693  4090 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:19.032397  4090 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:19.032608  4090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:19.033234  4090 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:19.034268  4090 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:19.034319  4090 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:19.034361  4090 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:19.034422  4090 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:19.044936  4090 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.2:33253
I20260812 06:37:19.045040  4298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.2:33253 every 8 connection(s)
I20260812 06:37:19.045981  4090 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:19.047487  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 4090
I20260812 06:37:19.047605  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:19.050058  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.3:0
--local_ip_for_outbound_sockets=127.1.223.3
--webserver_interface=127.1.223.3
--webserver_port=0
--tserver_master_addrs=127.1.223.62:34477
--builtin_ntp_servers=127.1.223.20:45273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--tablet_state_walk_min_period_ms=10 with env {}
I20260812 06:37:19.056576  4299 heartbeater.cc:344] Connected to a master server at 127.1.223.62:34477
I20260812 06:37:19.056872  4299 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:19.057462  4299 heartbeater.cc:507] Master 127.1.223.62:34477 requested a full tablet report, sending...
I20260812 06:37:19.058658  3786 ts_manager.cc:194] Registered new tserver with Master: 157df6771c8948aca6ab31f6a4f90b65 (127.1.223.2:33253)
I20260812 06:37:19.059566  3786 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.2:41165
W20260812 06:37:19.168304  4302 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:19.168553  4302 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:19.168604  4302 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:19.172089  4302 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:19.172219  4302 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.3
I20260812 06:37:19.176352  4302 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:45273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.223.3
--webserver_port=0
--tserver_master_addrs=127.1.223.62:34477
--tablet_state_walk_min_period_ms=10
--never_fsync=true
--heap_profile_path=/tmp/kudu.4302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:19.177542  4302 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:19.178750  4302 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:19.185895  4309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:19.185945  4308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:19.186205  4302 server_base.cc:1061] running on GCE node
W20260812 06:37:19.185971  4313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:19.186785  4302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:19.187368  4302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:19.188651  4302 hybrid_clock.cc:648] HybridClock initialized: now 1786516639188653 us; error 80 us; skew 500 ppm
I20260812 06:37:19.190673  4302 webserver.cc:533] Webserver started at http://127.1.223.3:33109/ using document root <none> and password file <none>
I20260812 06:37:19.191321  4302 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:19.191438  4302 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:19.191680  4302 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:19.193336  4302 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/data/instance:
uuid: "25bdc0b1bcd549e4a60712cc853ab6f4"
format_stamp: "Formatted at 2026-08-12 06:37:19 on dist-test-slave-gw5c"
I20260812 06:37:19.193879  4302 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal/instance:
uuid: "25bdc0b1bcd549e4a60712cc853ab6f4"
format_stamp: "Formatted at 2026-08-12 06:37:19 on dist-test-slave-gw5c"
I20260812 06:37:19.197494  4302 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:37:19.199981  4323 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:19.201548  4302 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:19.201846  4302 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
uuid: "25bdc0b1bcd549e4a60712cc853ab6f4"
format_stamp: "Formatted at 2026-08-12 06:37:19 on dist-test-slave-gw5c"
I20260812 06:37:19.202013  4302 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:19.217644  4302 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:19.218402  4302 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:19.218634  4302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:19.219492  4302 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:19.220595  4302 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:19.220654  4302 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:19.220698  4302 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:19.220713  4302 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:19.230890  4302 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.3:37973
I20260812 06:37:19.230921  4482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.3:37973 every 8 connection(s)
I20260812 06:37:19.231945  4302 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:19.239131  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 4302
I20260812 06:37:19.239264  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:19.241137  4484 heartbeater.cc:344] Connected to a master server at 127.1.223.62:34477
I20260812 06:37:19.241457  4484 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:19.242125  4484 heartbeater.cc:507] Master 127.1.223.62:34477 requested a full tablet report, sending...
I20260812 06:37:19.243217  3785 ts_manager.cc:194] Registered new tserver with Master: 25bdc0b1bcd549e4a60712cc853ab6f4 (127.1.223.3:37973)
I20260812 06:37:19.243875  3785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.3:47351
I20260812 06:37:19.254117  1916 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:37:19.274444  3785 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41888:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:19.275681  3785 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:19.293191  4396 tablet_service.cc:1511] Processing CreateTablet for tablet 2746762053b14a918ab2c11652642679 (DEFAULT_TABLE table=test-workload [id=c128d6c1b7d446779d588163338a09e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:19.293385  3979 tablet_service.cc:1511] Processing CreateTablet for tablet 2746762053b14a918ab2c11652642679 (DEFAULT_TABLE table=test-workload [id=c128d6c1b7d446779d588163338a09e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:19.293385  4194 tablet_service.cc:1511] Processing CreateTablet for tablet 2746762053b14a918ab2c11652642679 (DEFAULT_TABLE table=test-workload [id=c128d6c1b7d446779d588163338a09e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:19.294210  4396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2746762053b14a918ab2c11652642679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:19.294322  3979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2746762053b14a918ab2c11652642679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:19.294322  4194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2746762053b14a918ab2c11652642679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:19.299917  4521 tablet_bootstrap.cc:492] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4: Bootstrap starting.
I20260812 06:37:19.300913  4523 tablet_bootstrap.cc:492] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Bootstrap starting.
I20260812 06:37:19.301107  4522 tablet_bootstrap.cc:492] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65: Bootstrap starting.
I20260812 06:37:19.302785  4521 tablet_bootstrap.cc:654] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:19.303330  4522 tablet_bootstrap.cc:654] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:19.303336  4523 tablet_bootstrap.cc:654] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:19.303925  4521 log.cc:826] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:19.304221  4523 log.cc:826] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:19.304222  4522 log.cc:826] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:19.305998  4521 tablet_bootstrap.cc:492] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4: No bootstrap required, opened a new log
I20260812 06:37:19.306005  4522 tablet_bootstrap.cc:492] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65: No bootstrap required, opened a new log
I20260812 06:37:19.306005  4523 tablet_bootstrap.cc:492] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: No bootstrap required, opened a new log
I20260812 06:37:19.306219  4521 ts_tablet_manager.cc:1403] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:37:19.306221  4522 ts_tablet_manager.cc:1403] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.004s
I20260812 06:37:19.306221  4523 ts_tablet_manager.cc:1403] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.002s
I20260812 06:37:19.309033  4521 raft_consensus.cc:359] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.309396  4521 raft_consensus.cc:385] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:19.309474  4521 raft_consensus.cc:740] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25bdc0b1bcd549e4a60712cc853ab6f4, State: Initialized, Role: FOLLOWER
I20260812 06:37:19.309569  4522 raft_consensus.cc:359] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.309569  4523 raft_consensus.cc:359] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.309778  4523 raft_consensus.cc:385] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:19.309778  4522 raft_consensus.cc:385] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:19.309837  4522 raft_consensus.cc:740] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 157df6771c8948aca6ab31f6a4f90b65, State: Initialized, Role: FOLLOWER
I20260812 06:37:19.309837  4523 raft_consensus.cc:740] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2938b725b34175bc22b2e80e00a029, State: Initialized, Role: FOLLOWER
I20260812 06:37:19.309996  4521 consensus_queue.cc:260] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.310259  4523 consensus_queue.cc:260] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.310259  4522 consensus_queue.cc:260] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.310796  4484 heartbeater.cc:499] Master 127.1.223.62:34477 was elected leader, sending a full tablet report...
I20260812 06:37:19.311018  4521 ts_tablet_manager.cc:1434] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 06:37:19.311100  4523 ts_tablet_manager.cc:1434] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260812 06:37:19.311100  4522 ts_tablet_manager.cc:1434] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260812 06:37:19.311453  4083 heartbeater.cc:499] Master 127.1.223.62:34477 was elected leader, sending a full tablet report...
I20260812 06:37:19.311453  4299 heartbeater.cc:499] Master 127.1.223.62:34477 was elected leader, sending a full tablet report...
W20260812 06:37:19.364998  4086 tablet.cc:2406] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:37:19.482969  4485 tablet.cc:2406] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:19.508535  4528 raft_consensus.cc:493] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:19.508782  4528 raft_consensus.cc:515] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.509987  4528 leader_election.cc:290] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 157df6771c8948aca6ab31f6a4f90b65 (127.1.223.2:33253), fe2938b725b34175bc22b2e80e00a029 (127.1.223.1:45561)
I20260812 06:37:19.514205  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2746762053b14a918ab2c11652642679" candidate_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "157df6771c8948aca6ab31f6a4f90b65" is_pre_election: true
I20260812 06:37:19.514207  4012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2746762053b14a918ab2c11652642679" candidate_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2938b725b34175bc22b2e80e00a029" is_pre_election: true
I20260812 06:37:19.514539  4222 raft_consensus.cc:2468] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25bdc0b1bcd549e4a60712cc853ab6f4 in term 0.
I20260812 06:37:19.514539  4012 raft_consensus.cc:2468] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25bdc0b1bcd549e4a60712cc853ab6f4 in term 0.
I20260812 06:37:19.515098  4325 leader_election.cc:304] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25bdc0b1bcd549e4a60712cc853ab6f4, fe2938b725b34175bc22b2e80e00a029; no voters: 
I20260812 06:37:19.515354  4528 raft_consensus.cc:2804] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:19.515475  4528 raft_consensus.cc:493] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:19.515537  4528 raft_consensus.cc:3060] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:19.516542  4528 raft_consensus.cc:515] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.516937  4528 leader_election.cc:290] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [CANDIDATE]: Term 1 election: Requested vote from peers 157df6771c8948aca6ab31f6a4f90b65 (127.1.223.2:33253), fe2938b725b34175bc22b2e80e00a029 (127.1.223.1:45561)
I20260812 06:37:19.517359  4012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2746762053b14a918ab2c11652642679" candidate_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2938b725b34175bc22b2e80e00a029"
I20260812 06:37:19.517362  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2746762053b14a918ab2c11652642679" candidate_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "157df6771c8948aca6ab31f6a4f90b65"
I20260812 06:37:19.517500  4222 raft_consensus.cc:3060] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:19.517501  4012 raft_consensus.cc:3060] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:19.519145  4222 raft_consensus.cc:2468] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25bdc0b1bcd549e4a60712cc853ab6f4 in term 1.
I20260812 06:37:19.519145  4012 raft_consensus.cc:2468] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25bdc0b1bcd549e4a60712cc853ab6f4 in term 1.
I20260812 06:37:19.519541  4328 leader_election.cc:304] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 157df6771c8948aca6ab31f6a4f90b65, 25bdc0b1bcd549e4a60712cc853ab6f4; no voters: 
I20260812 06:37:19.519760  4528 raft_consensus.cc:2804] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:19.520013  4528 raft_consensus.cc:697] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [term 1 LEADER]: Becoming Leader. State: Replica: 25bdc0b1bcd549e4a60712cc853ab6f4, State: Running, Role: LEADER
I20260812 06:37:19.520340  4528 consensus_queue.cc:237] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } }
I20260812 06:37:19.523940  3784 catalog_manager.cc:5719] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25bdc0b1bcd549e4a60712cc853ab6f4 (127.1.223.3). New cstate: current_term: 1 leader_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25bdc0b1bcd549e4a60712cc853ab6f4" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 37973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:19.547201  4300 tablet.cc:2406] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:19.612038  4012 raft_consensus.cc:1275] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 1 FOLLOWER]: Refusing update from remote peer 25bdc0b1bcd549e4a60712cc853ab6f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:19.612020  4222 raft_consensus.cc:1275] T 2746762053b14a918ab2c11652642679 P 157df6771c8948aca6ab31f6a4f90b65 [term 1 FOLLOWER]: Refusing update from remote peer 25bdc0b1bcd549e4a60712cc853ab6f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:19.612766  4535 consensus_queue.cc:1048] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2938b725b34175bc22b2e80e00a029" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 45561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:19.613323  4535 consensus_queue.cc:1048] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "157df6771c8948aca6ab31f6a4f90b65" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 33253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:19.620568  4547 mvcc.cc:204] Tried to move back new op lower bound from 7317572155854876672 to 7317572155478675456. Current Snapshot: MvccSnapshot[applied={T|T < 7317572155842707456}]
I20260812 06:37:19.625092  4550 mvcc.cc:204] Tried to move back new op lower bound from 7317572155854876672 to 7317572155478675456. Current Snapshot: MvccSnapshot[applied={T|T < 7317572155842707456}]
I20260812 06:37:19.750692  3979 tablet_service.cc:1558] Processing DeleteTablet for tablet 2746762053b14a918ab2c11652642679 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:57332
I20260812 06:37:19.751267  4580 tablet_replica.cc:333] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: stopping tablet replica
I20260812 06:37:19.751581  4580 raft_consensus.cc:2243] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:19.751881  4580 raft_consensus.cc:2272] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:19.753229  4580 ts_tablet_manager.cc:1916] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:19.755131  4580 ts_tablet_manager.cc:1929] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.27
I20260812 06:37:19.755215  4580 log.cc:1199] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Deleting WAL directory at /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.TabletCopyITest.TestTabletStateMetricsDuringTabletCopy.1786516628863504-1916-0/minicluster-data/ts-0/wal/wals/2746762053b14a918ab2c11652642679
W20260812 06:37:20.255791  4325 consensus_peers.cc:597] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4 -> Peer fe2938b725b34175bc22b2e80e00a029 (127.1.223.1:45561): Couldn't send request to peer fe2938b725b34175bc22b2e80e00a029. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:20.708914  4587 ts_tablet_manager.cc:933] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Initiating tablet copy from peer 25bdc0b1bcd549e4a60712cc853ab6f4 (127.1.223.3:37973)
I20260812 06:37:20.709573  4587 tablet_copy_client.cc:323] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: tablet copy: Beginning tablet copy session from remote peer at address 127.1.223.3:37973
I20260812 06:37:20.713397  4446 tablet_copy_service.cc:140] P 25bdc0b1bcd549e4a60712cc853ab6f4: Received BeginTabletCopySession request for tablet 2746762053b14a918ab2c11652642679 from peer fe2938b725b34175bc22b2e80e00a029 ({username='slave'} at 127.1.223.1:51173)
I20260812 06:37:20.713569  4446 tablet_copy_service.cc:161] P 25bdc0b1bcd549e4a60712cc853ab6f4: Beginning new tablet copy session on tablet 2746762053b14a918ab2c11652642679 from peer fe2938b725b34175bc22b2e80e00a029 at {username='slave'} at 127.1.223.1:51173: session id = fe2938b725b34175bc22b2e80e00a029-2746762053b14a918ab2c11652642679
I20260812 06:37:20.714810  4446 tablet_copy_source_session.cc:215] T 2746762053b14a918ab2c11652642679 P 25bdc0b1bcd549e4a60712cc853ab6f4: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:20.716280  4587 ts_tablet_manager.cc:1916] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:37:20.718048  4587 ts_tablet_manager.cc:1929] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.27
I20260812 06:37:20.718221  4587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2746762053b14a918ab2c11652642679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:20.719280  4587 tablet_copy_client.cc:806] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: tablet copy: Starting download of 0 data blocks...
I20260812 06:37:20.719589  4587 tablet_copy_client.cc:670] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: tablet copy: Starting download of 1 WAL segments...
I20260812 06:37:20.721753  4587 tablet_copy_client.cc:538] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:37:20.723304  4587 tablet_bootstrap.cc:492] T 2746762053b14a918ab2c11652642679 P fe2938b725b34175bc22b2e80e00a029: Bootstrap starting.
I20260812 06:37:20.732498  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 3888
I20260812 06:37:20.753043  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 4090
I20260812 06:37:20.769994  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 4302
I20260812 06:37:20.786695  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 3739
2026-08-12T06:37:20Z chronyd exiting
[       OK ] TabletCopyITest.TestTabletStateMetricsDuringTabletCopy (2373 ms)
[----------] 3 tests from TabletCopyITest (11943 ms total)

[----------] 1 test from FailureCause/TabletCopyFailureITest
[ RUN      ] FailureCause/TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote/1
2026-08-12T06:37:20Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:20Z Disabled control of system clock
I20260812 06:37:20.826826  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:45325
--webserver_interface=127.1.223.62
--webserver_port=0
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.223.62:45325
--catalog_manager_evict_excess_replicas=false
--master_add_server_when_underreplicated=false with env {}
W20260812 06:37:20.935937  4597 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:20.936196  4597 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:20.936249  4597 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:20.939697  4597 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:20.939760  4597 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:20.939781  4597 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:20.939800  4597 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:20.943871  4597 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
--catalog_manager_evict_excess_replicas=false
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.1.223.62:45325
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:45325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.223.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.4597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:20.944983  4597 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:20.946051  4597 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:20.951522  4608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:20.951534  4612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:20.951538  4607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:20.951831  4597 server_base.cc:1061] running on GCE node
I20260812 06:37:20.952318  4597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:20.953114  4597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:20.954294  4597 hybrid_clock.cc:648] HybridClock initialized: now 1786516640954285 us; error 27 us; skew 500 ppm
I20260812 06:37:20.956013  4597 webserver.cc:533] Webserver started at http://127.1.223.62:42691/ using document root <none> and password file <none>
I20260812 06:37:20.956571  4597 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:20.956651  4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:20.956861  4597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:20.958357  4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/instance:
uuid: "bb7db5fe968645e683ae9193f879df6c"
format_stamp: "Formatted at 2026-08-12 06:37:20 on dist-test-slave-gw5c"
I20260812 06:37:20.958839  4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal/instance:
uuid: "bb7db5fe968645e683ae9193f879df6c"
format_stamp: "Formatted at 2026-08-12 06:37:20 on dist-test-slave-gw5c"
I20260812 06:37:20.962205  4597 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:37:20.964381  4624 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:20.965423  4597 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:20.965559  4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
uuid: "bb7db5fe968645e683ae9193f879df6c"
format_stamp: "Formatted at 2026-08-12 06:37:20 on dist-test-slave-gw5c"
I20260812 06:37:20.965670  4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:20.988161  4597 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:20.988873  4597 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:20.989080  4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:20.997016  4705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.62:45325 every 8 connection(s)
I20260812 06:37:20.997016  4597 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.62:45325
I20260812 06:37:20.998147  4597 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:21.001076  4707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:21.003175  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 4597
I20260812 06:37:21.003321  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal/instance
I20260812 06:37:21.006088  4707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Bootstrap starting.
I20260812 06:37:21.008622  4707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:21.009529  4707 log.cc:826] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:21.011623  4707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: No bootstrap required, opened a new log
I20260812 06:37:21.014391  4707 raft_consensus.cc:359] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } }
I20260812 06:37:21.014581  4707 raft_consensus.cc:385] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:21.014616  4707 raft_consensus.cc:740] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7db5fe968645e683ae9193f879df6c, State: Initialized, Role: FOLLOWER
I20260812 06:37:21.014952  4707 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } }
I20260812 06:37:21.015059  4707 raft_consensus.cc:399] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:21.015095  4707 raft_consensus.cc:493] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:21.015174  4707 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:21.016026  4707 raft_consensus.cc:515] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } }
I20260812 06:37:21.016330  4707 leader_election.cc:304] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb7db5fe968645e683ae9193f879df6c; no voters: 
I20260812 06:37:21.016636  4707 leader_election.cc:290] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:21.017027  4714 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:21.017565  4714 raft_consensus.cc:697] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 1 LEADER]: Becoming Leader. State: Replica: bb7db5fe968645e683ae9193f879df6c, State: Running, Role: LEADER
I20260812 06:37:21.017885  4707 sys_catalog.cc:565] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:21.017861  4714 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } }
I20260812 06:37:21.019433  4715 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb7db5fe968645e683ae9193f879df6c. Latest consensus state: current_term: 1 leader_uuid: "bb7db5fe968645e683ae9193f879df6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } } }
I20260812 06:37:21.019572  4715 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:21.019906  4712 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb7db5fe968645e683ae9193f879df6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } } }
I20260812 06:37:21.020000  4712 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: This master's current role is: LEADER
W20260812 06:37:21.022921  4738 catalog_manager.cc:1594] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:37:21.023018  4738 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:37:21.023089  4731 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:21.023917  4731 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:21.029175  4731 catalog_manager.cc:1383] Generated new cluster ID: a6c9385ba91e4bc39800b09e00fb2fcb
I20260812 06:37:21.029281  4731 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:21.043139  4731 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:21.044081  4731 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:21.053074  4731 catalog_manager.cc:6092] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Generated new TSK 0
I20260812 06:37:21.053814  4731 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:21.063699  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.1:0
--local_ip_for_outbound_sockets=127.1.223.1
--webserver_interface=127.1.223.1
--webserver_port=0
--tserver_master_addrs=127.1.223.62:45325
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--tablet_copy_fault_crash_on_fetch_all=1.0 with env {}
W20260812 06:37:21.175469  4742 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:21.175711  4742 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:21.175752  4742 flags.cc:432] Enabled unsafe flag: --tablet_copy_fault_crash_on_fetch_all=1
W20260812 06:37:21.175828  4742 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:21.179440  4742 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:21.179606  4742 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.1
I20260812 06:37:21.183785  4742 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.223.1
--webserver_port=0
--tablet_copy_fault_crash_on_fetch_all=1
--tserver_master_addrs=127.1.223.62:45325
--never_fsync=true
--heap_profile_path=/tmp/kudu.4742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:21.185014  4742 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:21.186215  4742 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:21.192924  4754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:21.192940  4759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:21.192934  4755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:21.193102  4742 server_base.cc:1061] running on GCE node
I20260812 06:37:21.193570  4742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:21.194159  4742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:21.195348  4742 hybrid_clock.cc:648] HybridClock initialized: now 1786516641195329 us; error 38 us; skew 500 ppm
I20260812 06:37:21.197180  4742 webserver.cc:533] Webserver started at http://127.1.223.1:41447/ using document root <none> and password file <none>
I20260812 06:37:21.197783  4742 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:21.197870  4742 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:21.198096  4742 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:21.199805  4742 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/instance:
uuid: "45d12906776541588d507ddfdf9b36d9"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.200419  4742 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal/instance:
uuid: "45d12906776541588d507ddfdf9b36d9"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.204301  4742 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260812 06:37:21.206750  4766 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.208189  4742 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 06:37:21.208369  4742 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
uuid: "45d12906776541588d507ddfdf9b36d9"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.208510  4742 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:21.239228  4742 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:21.240005  4742 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:21.240217  4742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:21.240883  4742 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:21.242002  4742 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:21.242053  4742 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.242093  4742 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:21.242133  4742 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.252113  4742 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.1:42565
I20260812 06:37:21.252146  4941 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.1:42565 every 8 connection(s)
I20260812 06:37:21.253185  4742 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:21.261618  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 4742
I20260812 06:37:21.261766  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:21.262992  4945 heartbeater.cc:344] Connected to a master server at 127.1.223.62:45325
I20260812 06:37:21.263276  4945 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:21.263899  4945 heartbeater.cc:507] Master 127.1.223.62:45325 requested a full tablet report, sending...
I20260812 06:37:21.264021  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.2:0
--local_ip_for_outbound_sockets=127.1.223.2
--webserver_interface=127.1.223.2
--webserver_port=0
--tserver_master_addrs=127.1.223.62:45325
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--tablet_copy_fault_crash_on_fetch_all=1.0 with env {}
I20260812 06:37:21.265617  4649 ts_manager.cc:194] Registered new tserver with Master: 45d12906776541588d507ddfdf9b36d9 (127.1.223.1:42565)
I20260812 06:37:21.267021  4649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.1:47057
W20260812 06:37:21.385607  4948 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:21.385865  4948 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:21.385906  4948 flags.cc:432] Enabled unsafe flag: --tablet_copy_fault_crash_on_fetch_all=1
W20260812 06:37:21.385927  4948 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:21.389478  4948 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:21.389614  4948 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.2
I20260812 06:37:21.393910  4948 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.223.2
--webserver_port=0
--tablet_copy_fault_crash_on_fetch_all=1
--tserver_master_addrs=127.1.223.62:45325
--never_fsync=true
--heap_profile_path=/tmp/kudu.4948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:21.395080  4948 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:21.396354  4948 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:21.403842  4963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:21.403842  4961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:21.403856  4966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:21.404467  4948 server_base.cc:1061] running on GCE node
I20260812 06:37:21.405351  4948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:21.406062  4948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:21.407294  4948 hybrid_clock.cc:648] HybridClock initialized: now 1786516641407272 us; error 36 us; skew 500 ppm
I20260812 06:37:21.410050  4948 webserver.cc:533] Webserver started at http://127.1.223.2:34467/ using document root <none> and password file <none>
I20260812 06:37:21.410737  4948 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:21.410836  4948 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:21.411067  4948 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:21.413100  4948 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/data/instance:
uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.413807  4948 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/wal/instance:
uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.417862  4948 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260812 06:37:21.420665  4974 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.421841  4948 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:21.422020  4948 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/wal
uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.422153  4948 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:21.438165  4948 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:21.439073  4948 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:21.439301  4948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:21.440024  4948 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:21.441159  4948 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:21.441236  4948 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.441309  4948 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:21.441356  4948 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.451359  4948 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.2:38749
I20260812 06:37:21.451417  5150 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.2:38749 every 8 connection(s)
I20260812 06:37:21.452502  4948 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:21.461479  5153 heartbeater.cc:344] Connected to a master server at 127.1.223.62:45325
I20260812 06:37:21.461774  5153 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:21.462329  5153 heartbeater.cc:507] Master 127.1.223.62:45325 requested a full tablet report, sending...
I20260812 06:37:21.462698  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 4948
I20260812 06:37:21.462821  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:21.463606  4649 ts_manager.cc:194] Registered new tserver with Master: f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749)
I20260812 06:37:21.464264  4649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.2:32865
I20260812 06:37:21.465287  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.3:0
--local_ip_for_outbound_sockets=127.1.223.3
--webserver_interface=127.1.223.3
--webserver_port=0
--tserver_master_addrs=127.1.223.62:45325
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--tablet_copy_fault_crash_on_fetch_all=1.0 with env {}
W20260812 06:37:21.578552  5159 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:21.578794  5159 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:21.578835  5159 flags.cc:432] Enabled unsafe flag: --tablet_copy_fault_crash_on_fetch_all=1
W20260812 06:37:21.578855  5159 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:21.582240  5159 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:21.582367  5159 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.3
I20260812 06:37:21.586346  5159 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.223.3
--webserver_port=0
--tablet_copy_fault_crash_on_fetch_all=1
--tserver_master_addrs=127.1.223.62:45325
--never_fsync=true
--heap_profile_path=/tmp/kudu.5159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:21.587478  5159 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:21.588591  5159 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:21.595574  5166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:21.595574  5170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:21.595893  5159 server_base.cc:1061] running on GCE node
W20260812 06:37:21.595606  5167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:21.596429  5159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:21.597011  5159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:21.598227  5159 hybrid_clock.cc:648] HybridClock initialized: now 1786516641598195 us; error 37 us; skew 500 ppm
I20260812 06:37:21.600188  5159 webserver.cc:533] Webserver started at http://127.1.223.3:39041/ using document root <none> and password file <none>
I20260812 06:37:21.600812  5159 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:21.600903  5159 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:21.601138  5159 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:21.602847  5159 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/instance:
uuid: "064d62ad9bd64d2cafeb4403115b13a9"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.603377  5159 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal/instance:
uuid: "064d62ad9bd64d2cafeb4403115b13a9"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.606909  5159 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:21.609454  5180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.610605  5159 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:21.610772  5159 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
uuid: "064d62ad9bd64d2cafeb4403115b13a9"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.610899  5159 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:21.621245  5159 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:21.622224  5159 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:21.622465  5159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:21.623131  5159 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:21.624364  5159 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:21.624442  5159 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.624516  5159 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:21.624570  5159 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.635119  5159 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.3:45893
I20260812 06:37:21.635145  5357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.3:45893 every 8 connection(s)
I20260812 06:37:21.636209  5159 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:21.642824  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 5159
I20260812 06:37:21.642946  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:21.644887  5358 heartbeater.cc:344] Connected to a master server at 127.1.223.62:45325
I20260812 06:37:21.645159  5358 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:21.645429  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.4:0
--local_ip_for_outbound_sockets=127.1.223.4
--webserver_interface=127.1.223.4
--webserver_port=0
--tserver_master_addrs=127.1.223.62:45325
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--tablet_copy_fault_crash_on_fetch_all=1.0 with env {}
I20260812 06:37:21.645759  5358 heartbeater.cc:507] Master 127.1.223.62:45325 requested a full tablet report, sending...
I20260812 06:37:21.646852  4649 ts_manager.cc:194] Registered new tserver with Master: 064d62ad9bd64d2cafeb4403115b13a9 (127.1.223.3:45893)
I20260812 06:37:21.647478  4649 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.3:46153
W20260812 06:37:21.758883  5362 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:21.759227  5362 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:21.759333  5362 flags.cc:432] Enabled unsafe flag: --tablet_copy_fault_crash_on_fetch_all=1
W20260812 06:37:21.759402  5362 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:21.763170  5362 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:21.763384  5362 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.4
I20260812 06:37:21.767717  5362 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.4:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.1.223.4
--webserver_port=0
--tablet_copy_fault_crash_on_fetch_all=1
--tserver_master_addrs=127.1.223.62:45325
--never_fsync=true
--heap_profile_path=/tmp/kudu.5362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:21.768985  5362 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:21.770227  5362 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:21.776865  5373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:21.776865  5378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:21.777045  5362 server_base.cc:1061] running on GCE node
W20260812 06:37:21.776865  5374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:21.777469  5362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:21.778029  5362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:21.779209  5362 hybrid_clock.cc:648] HybridClock initialized: now 1786516641779195 us; error 31 us; skew 500 ppm
I20260812 06:37:21.781028  5362 webserver.cc:533] Webserver started at http://127.1.223.4:40437/ using document root <none> and password file <none>
I20260812 06:37:21.781630  5362 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:21.781719  5362 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:21.781960  5362 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:21.783670  5362 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/instance:
uuid: "0c251a4437df41d69f92433c3427f71e"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.784211  5362 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal/instance:
uuid: "0c251a4437df41d69f92433c3427f71e"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.787869  5362 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:37:21.790500  5390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.791702  5362 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:21.791859  5362 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
uuid: "0c251a4437df41d69f92433c3427f71e"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:21.791976  5362 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:21.801069  5362 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:21.801831  5362 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:21.802070  5362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:21.802778  5362 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:21.804037  5362 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:21.804118  5362 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.804198  5362 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:21.804241  5362 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:21.815243  5362 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.4:40751
I20260812 06:37:21.815270  5574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.4:40751 every 8 connection(s)
I20260812 06:37:21.816448  5362 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/info.pb
I20260812 06:37:21.824368  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 5362
I20260812 06:37:21.824518  1916 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal/instance
I20260812 06:37:21.825850  5575 heartbeater.cc:344] Connected to a master server at 127.1.223.62:45325
I20260812 06:37:21.826144  5575 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:21.826706  5575 heartbeater.cc:507] Master 127.1.223.62:45325 requested a full tablet report, sending...
I20260812 06:37:21.827863  4647 ts_manager.cc:194] Registered new tserver with Master: 0c251a4437df41d69f92433c3427f71e (127.1.223.4:40751)
I20260812 06:37:21.828465  4647 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.4:50627
I20260812 06:37:21.839877  1916 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20260812 06:37:21.860715  4647 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59442:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:37:21.880079  5048 tablet_service.cc:1511] Processing CreateTablet for tablet 1acd54cf05e946139e1225805aec9e2b (DEFAULT_TABLE table=test-workload [id=c23ca0279f5c4054a9507a9e89f3e8e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:21.880152  5257 tablet_service.cc:1511] Processing CreateTablet for tablet 1acd54cf05e946139e1225805aec9e2b (DEFAULT_TABLE table=test-workload [id=c23ca0279f5c4054a9507a9e89f3e8e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:21.881065  5048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1acd54cf05e946139e1225805aec9e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:21.881122  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1acd54cf05e946139e1225805aec9e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:21.880954  5462 tablet_service.cc:1511] Processing CreateTablet for tablet 1acd54cf05e946139e1225805aec9e2b (DEFAULT_TABLE table=test-workload [id=c23ca0279f5c4054a9507a9e89f3e8e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:21.881886  5462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1acd54cf05e946139e1225805aec9e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:21.886022  5607 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5: Bootstrap starting.
I20260812 06:37:21.887295  5608 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Bootstrap starting.
I20260812 06:37:21.888512  5612 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Bootstrap starting.
I20260812 06:37:21.888829  5607 tablet_bootstrap.cc:654] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:21.889614  5608 tablet_bootstrap.cc:654] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:21.890132  5607 log.cc:826] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:21.890646  5608 log.cc:826] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:21.891153  5612 tablet_bootstrap.cc:654] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:21.891889  5612 log.cc:826] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:21.892448  5607 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5: No bootstrap required, opened a new log
I20260812 06:37:21.892627  5608 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: No bootstrap required, opened a new log
I20260812 06:37:21.892721  5607 ts_tablet_manager.cc:1403] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5: Time spent bootstrapping tablet: real 0.007s	user 0.006s	sys 0.000s
I20260812 06:37:21.892807  5608 ts_tablet_manager.cc:1403] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:37:21.893388  5612 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: No bootstrap required, opened a new log
I20260812 06:37:21.893589  5612 ts_tablet_manager.cc:1403] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.002s
I20260812 06:37:21.896469  5612 raft_consensus.cc:359] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
I20260812 06:37:21.896704  5612 raft_consensus.cc:385] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:21.896775  5612 raft_consensus.cc:740] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c251a4437df41d69f92433c3427f71e, State: Initialized, Role: FOLLOWER
I20260812 06:37:21.897292  5612 consensus_queue.cc:260] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
I20260812 06:37:21.896600  5608 raft_consensus.cc:359] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
I20260812 06:37:21.898061  5608 raft_consensus.cc:385] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:21.898260  5575 heartbeater.cc:499] Master 127.1.223.62:45325 was elected leader, sending a full tablet report...
I20260812 06:37:21.898324  5608 raft_consensus.cc:740] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 064d62ad9bd64d2cafeb4403115b13a9, State: Initialized, Role: FOLLOWER
I20260812 06:37:21.898330  5612 ts_tablet_manager.cc:1434] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.005s
I20260812 06:37:21.898787  5608 consensus_queue.cc:260] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
I20260812 06:37:21.896603  5607 raft_consensus.cc:359] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
I20260812 06:37:21.899550  5358 heartbeater.cc:499] Master 127.1.223.62:45325 was elected leader, sending a full tablet report...
I20260812 06:37:21.899571  5607 raft_consensus.cc:385] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:21.899744  5607 raft_consensus.cc:740] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f89b6d0bcdaa40b6b9c7ff931abd05d5, State: Initialized, Role: FOLLOWER
I20260812 06:37:21.899788  5608 ts_tablet_manager.cc:1434] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260812 06:37:21.900281  5607 consensus_queue.cc:260] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
I20260812 06:37:21.901084  5607 ts_tablet_manager.cc:1434] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260812 06:37:21.901429  5153 heartbeater.cc:499] Master 127.1.223.62:45325 was elected leader, sending a full tablet report...
I20260812 06:37:21.941560  5619 raft_consensus.cc:493] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:21.941882  5619 raft_consensus.cc:515] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
I20260812 06:37:21.943228  5619 leader_election.cc:290] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749), 064d62ad9bd64d2cafeb4403115b13a9 (127.1.223.3:45893)
I20260812 06:37:21.947695  5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acd54cf05e946139e1225805aec9e2b" candidate_uuid: "0c251a4437df41d69f92433c3427f71e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" is_pre_election: true
I20260812 06:37:21.948025  5074 raft_consensus.cc:2468] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c251a4437df41d69f92433c3427f71e in term 0.
I20260812 06:37:21.948053  5293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acd54cf05e946139e1225805aec9e2b" candidate_uuid: "0c251a4437df41d69f92433c3427f71e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "064d62ad9bd64d2cafeb4403115b13a9" is_pre_election: true
I20260812 06:37:21.948254  5293 raft_consensus.cc:2468] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c251a4437df41d69f92433c3427f71e in term 0.
I20260812 06:37:21.948542  5395 leader_election.cc:304] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c251a4437df41d69f92433c3427f71e, f89b6d0bcdaa40b6b9c7ff931abd05d5; no voters: 
I20260812 06:37:21.948797  5619 raft_consensus.cc:2804] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:21.948891  5619 raft_consensus.cc:493] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:21.948969  5619 raft_consensus.cc:3060] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:21.949913  5619 raft_consensus.cc:515] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
I20260812 06:37:21.950333  5619 leader_election.cc:290] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 1 election: Requested vote from peers f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749), 064d62ad9bd64d2cafeb4403115b13a9 (127.1.223.3:45893)
I20260812 06:37:21.950733  5074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acd54cf05e946139e1225805aec9e2b" candidate_uuid: "0c251a4437df41d69f92433c3427f71e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5"
I20260812 06:37:21.950767  5293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acd54cf05e946139e1225805aec9e2b" candidate_uuid: "0c251a4437df41d69f92433c3427f71e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "064d62ad9bd64d2cafeb4403115b13a9"
I20260812 06:37:21.950879  5074 raft_consensus.cc:3060] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:21.950912  5293 raft_consensus.cc:3060] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:21.952327  5293 raft_consensus.cc:2468] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c251a4437df41d69f92433c3427f71e in term 1.
I20260812 06:37:21.952507  5074 raft_consensus.cc:2468] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c251a4437df41d69f92433c3427f71e in term 1.
I20260812 06:37:21.952697  5393 leader_election.cc:304] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 064d62ad9bd64d2cafeb4403115b13a9, 0c251a4437df41d69f92433c3427f71e; no voters: 
I20260812 06:37:21.952924  5619 raft_consensus.cc:2804] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:21.953150  5619 raft_consensus.cc:697] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 LEADER]: Becoming Leader. State: Replica: 0c251a4437df41d69f92433c3427f71e, State: Running, Role: LEADER
I20260812 06:37:21.953612  5619 consensus_queue.cc:237] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } }
W20260812 06:37:21.953778  5156 tablet.cc:2406] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:21.957031  4649 catalog_manager.cc:5719] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c251a4437df41d69f92433c3427f71e (127.1.223.4). New cstate: current_term: 1 leader_uuid: "0c251a4437df41d69f92433c3427f71e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:22.067493  5576 tablet.cc:2406] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:37:22.137339  5359 tablet.cc:2406] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:22.269428  4945 heartbeater.cc:499] Master 127.1.223.62:45325 was elected leader, sending a full tablet report...
I20260812 06:37:22.340790  5619 consensus_queue.cc:1048] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:22.347044  5638 consensus_queue.cc:1048] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:22.352228  5495 consensus_queue.cc:237] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:22.354107  5293 raft_consensus.cc:1275] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 1 FOLLOWER]: Refusing update from remote peer 0c251a4437df41d69f92433c3427f71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:22.354240  5074 raft_consensus.cc:1275] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [term 1 FOLLOWER]: Refusing update from remote peer 0c251a4437df41d69f92433c3427f71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:22.354604  5627 consensus_queue.cc:1048] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:37:22.354884  5638 consensus_queue.cc:1048] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 06:37:22.358098  5627 raft_consensus.cc:2955] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 45d12906776541588d507ddfdf9b36d9 (127.1.223.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } } }
W20260812 06:37:22.358474  5395 consensus_peers.cc:597] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e -> Peer 45d12906776541588d507ddfdf9b36d9 (127.1.223.1:42565): Couldn't send request to peer 45d12906776541588d507ddfdf9b36d9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1acd54cf05e946139e1225805aec9e2b. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:22.358906  5074 raft_consensus.cc:2955] T 1acd54cf05e946139e1225805aec9e2b P f89b6d0bcdaa40b6b9c7ff931abd05d5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 45d12906776541588d507ddfdf9b36d9 (127.1.223.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } } }
I20260812 06:37:22.360602  5293 raft_consensus.cc:2955] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 45d12906776541588d507ddfdf9b36d9 (127.1.223.1) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } } }
I20260812 06:37:22.361058  4649 catalog_manager.cc:5719] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e reported cstate change: config changed from index -1 to 2, VOTER 45d12906776541588d507ddfdf9b36d9 (127.1.223.1) added. New cstate: current_term: 1 leader_uuid: "0c251a4437df41d69f92433c3427f71e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:22.732904  5643 ts_tablet_manager.cc:933] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Initiating tablet copy from peer 0c251a4437df41d69f92433c3427f71e (127.1.223.4:40751)
I20260812 06:37:22.733572  5643 tablet_copy_client.cc:323] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: tablet copy: Beginning tablet copy session from remote peer at address 127.1.223.4:40751
I20260812 06:37:22.737670  5533 tablet_copy_service.cc:140] P 0c251a4437df41d69f92433c3427f71e: Received BeginTabletCopySession request for tablet 1acd54cf05e946139e1225805aec9e2b from peer 45d12906776541588d507ddfdf9b36d9 ({username='slave'} at 127.1.223.1:52707)
I20260812 06:37:22.737834  5533 tablet_copy_service.cc:161] P 0c251a4437df41d69f92433c3427f71e: Beginning new tablet copy session on tablet 1acd54cf05e946139e1225805aec9e2b from peer 45d12906776541588d507ddfdf9b36d9 at {username='slave'} at 127.1.223.1:52707: session id = 45d12906776541588d507ddfdf9b36d9-1acd54cf05e946139e1225805aec9e2b
I20260812 06:37:22.739131  5533 tablet_copy_source_session.cc:215] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:22.742645  5643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1acd54cf05e946139e1225805aec9e2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 06:37:22.747268  5643 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 06:37:22.747350  5643 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20260812 06:37:22.747378  5643 fault_injection.cc:59] injecting fault for kudu (pid 4742): FLAGS_tablet_copy_fault_crash_on_fetch_all (process will exit)
I20260812 06:37:22.875303  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 4948
W20260812 06:37:22.888892  5395 connection.cc:573] client connection to 127.1.223.2:38749 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:22.889082  5395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:37:22.889403  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 5159
W20260812 06:37:22.899338  5395 consensus_peers.cc:597] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e -> Peer f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749): Couldn't send request to peer f89b6d0bcdaa40b6b9c7ff931abd05d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.223.2:38749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:22.905622  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 5362
I20260812 06:37:22.925825  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 4597
I20260812 06:37:22.940963  1916 tablet_copy-itest.cc:1348] Restarting tablet servers. New replica TS UUID: 45d12906776541588d507ddfdf9b36d9, tablet data state: TABLET_DATA_COPYING, last-logged opid: 1.0
I20260812 06:37:22.941414  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:45325
--webserver_interface=127.1.223.62
--webserver_port=42691
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.223.62:45325
--catalog_manager_evict_excess_replicas=false
--master_add_server_when_underreplicated=false with env {}
W20260812 06:37:23.056625  5656 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:23.056893  5656 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:23.056936  5656 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:23.060758  5656 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:23.060842  5656 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:23.060864  5656 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:23.060889  5656 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:23.065200  5656 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
--catalog_manager_evict_excess_replicas=false
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.1.223.62:45325
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.223.62:45325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.223.62
--webserver_port=42691
--never_fsync=true
--heap_profile_path=/tmp/kudu.5656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:23.066406  5656 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:23.067557  5656 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:23.073423  5662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.073470  5665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.073423  5667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:23.073763  5656 server_base.cc:1061] running on GCE node
I20260812 06:37:23.074440  5656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:23.075726  5656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:23.076905  5656 hybrid_clock.cc:648] HybridClock initialized: now 1786516643076899 us; error 48 us; skew 500 ppm
I20260812 06:37:23.078940  5656 webserver.cc:533] Webserver started at http://127.1.223.62:42691/ using document root <none> and password file <none>
I20260812 06:37:23.079726  5656 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:23.079842  5656 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:23.083277  5656 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:23.085336  5677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:23.086324  5656 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:23.086489  5656 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
uuid: "bb7db5fe968645e683ae9193f879df6c"
format_stamp: "Formatted at 2026-08-12 06:37:20 on dist-test-slave-gw5c"
I20260812 06:37:23.086908  5656 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:23.100238  5656 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:23.101043  5656 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:23.101263  5656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:23.110487  5656 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.62:45325
I20260812 06:37:23.110502  5760 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.62:45325 every 8 connection(s)
I20260812 06:37:23.111828  5656 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:23.116261  5762 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:37:23.117985  5762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Bootstrap starting.
I20260812 06:37:23.119551  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 5656
I20260812 06:37:23.120136  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.1:42565
--local_ip_for_outbound_sockets=127.1.223.1
--tserver_master_addrs=127.1.223.62:45325
--webserver_port=41447
--webserver_interface=127.1.223.1
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 06:37:23.133764  5762 log.cc:826] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:23.142262  5762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=3 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:23.142792  5762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Bootstrap complete.
I20260812 06:37:23.146445  5762 raft_consensus.cc:359] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } }
I20260812 06:37:23.146785  5762 raft_consensus.cc:740] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7db5fe968645e683ae9193f879df6c, State: Initialized, Role: FOLLOWER
I20260812 06:37:23.147356  5762 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } }
I20260812 06:37:23.147554  5762 raft_consensus.cc:399] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:23.147634  5762 raft_consensus.cc:493] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:23.147754  5762 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:23.149335  5762 raft_consensus.cc:515] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } }
I20260812 06:37:23.149689  5762 leader_election.cc:304] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb7db5fe968645e683ae9193f879df6c; no voters: 
I20260812 06:37:23.150025  5762 leader_election.cc:290] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 06:37:23.150121  5768 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:23.150321  5768 raft_consensus.cc:697] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [term 2 LEADER]: Becoming Leader. State: Replica: bb7db5fe968645e683ae9193f879df6c, State: Running, Role: LEADER
I20260812 06:37:23.150609  5768 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } }
I20260812 06:37:23.151202  5762 sys_catalog.cc:565] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:23.151557  5768 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb7db5fe968645e683ae9193f879df6c. Latest consensus state: current_term: 2 leader_uuid: "bb7db5fe968645e683ae9193f879df6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } } }
I20260812 06:37:23.151763  5768 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:23.152211  5773 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:23.152165  5769 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bb7db5fe968645e683ae9193f879df6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb7db5fe968645e683ae9193f879df6c" member_type: VOTER last_known_addr { host: "127.1.223.62" port: 45325 } } }
I20260812 06:37:23.152387  5769 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:23.155995  5773 catalog_manager.cc:679] Loaded metadata for table test-workload [id=c23ca0279f5c4054a9507a9e89f3e8e8]
I20260812 06:37:23.157407  5773 tablet_loader.cc:96] loaded metadata for tablet 1acd54cf05e946139e1225805aec9e2b (table test-workload [id=c23ca0279f5c4054a9507a9e89f3e8e8])
I20260812 06:37:23.157583  5773 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:23.158252  5773 catalog_manager.cc:1295] Loaded cluster ID: a6c9385ba91e4bc39800b09e00fb2fcb
I20260812 06:37:23.158351  5773 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:23.161190  5773 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:23.161836  5773 catalog_manager.cc:6103] T 00000000000000000000000000000000 P bb7db5fe968645e683ae9193f879df6c: Loaded TSK: 0
I20260812 06:37:23.162608  5773 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 06:37:23.249027  5765 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:23.249334  5765 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:23.249418  5765 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:23.253273  5765 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:23.253468  5765 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.1
I20260812 06:37:23.257798  5765 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.1:42565
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.223.1
--webserver_port=41447
--tserver_master_addrs=127.1.223.62:45325
--never_fsync=true
--heap_profile_path=/tmp/kudu.5765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:23.259042  5765 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:23.260288  5765 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:23.267251  5804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.267263  5801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.267251  5802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:23.268371  5765 server_base.cc:1061] running on GCE node
I20260812 06:37:23.268823  5765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:23.269425  5765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:23.270617  5765 hybrid_clock.cc:648] HybridClock initialized: now 1786516643270596 us; error 42 us; skew 500 ppm
I20260812 06:37:23.272681  5765 webserver.cc:533] Webserver started at http://127.1.223.1:41447/ using document root <none> and password file <none>
I20260812 06:37:23.273506  5765 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:23.273634  5765 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:23.277400  5765 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.004s	sys 0.000s
I20260812 06:37:23.280000  5813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:23.281610  5765 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:23.281724  5765 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
uuid: "45d12906776541588d507ddfdf9b36d9"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:23.282181  5765 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:23.302896  5765 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:23.303727  5765 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:23.303952  5765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:23.304670  5765 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:23.306037  5826 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260812 06:37:23.310729  5826 ts_tablet_manager.cc:1863] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_COPYING
I20260812 06:37:23.312376  5826 ts_tablet_manager.cc:1916] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 06:37:23.316979  5826 ts_tablet_manager.cc:1929] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20260812 06:37:23.318148  5765 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260812 06:37:23.318261  5765 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.012s	user 0.001s	sys 0.000s
I20260812 06:37:23.318359  5765 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:23.318392  5765 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:23.331365  5765 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.1:42565
I20260812 06:37:23.331483  6010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.1:42565 every 8 connection(s)
I20260812 06:37:23.332512  5765 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:23.339326  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 5765
I20260812 06:37:23.339977  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.3:45893
--local_ip_for_outbound_sockets=127.1.223.3
--tserver_master_addrs=127.1.223.62:45325
--webserver_port=39041
--webserver_interface=127.1.223.3
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 06:37:23.351384  6012 heartbeater.cc:344] Connected to a master server at 127.1.223.62:45325
I20260812 06:37:23.351729  6012 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:23.352504  6012 heartbeater.cc:507] Master 127.1.223.62:45325 requested a full tablet report, sending...
I20260812 06:37:23.354724  5703 ts_manager.cc:194] Registered new tserver with Master: 45d12906776541588d507ddfdf9b36d9 (127.1.223.1:42565)
I20260812 06:37:23.356892  5703 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.1:59241
W20260812 06:37:23.462283  6017 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:23.462568  6017 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:23.462652  6017 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:23.466073  6017 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:23.466251  6017 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.3
I20260812 06:37:23.470299  6017 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.3:45893
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.223.3
--webserver_port=39041
--tserver_master_addrs=127.1.223.62:45325
--never_fsync=true
--heap_profile_path=/tmp/kudu.6017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:23.471449  6017 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:23.472620  6017 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:23.479211  6026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.479296  6025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.479211  6032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:23.479575  6017 server_base.cc:1061] running on GCE node
I20260812 06:37:23.480019  6017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:23.480641  6017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:23.481853  6017 hybrid_clock.cc:648] HybridClock initialized: now 1786516643481836 us; error 35 us; skew 500 ppm
I20260812 06:37:23.483965  6017 webserver.cc:533] Webserver started at http://127.1.223.3:39041/ using document root <none> and password file <none>
I20260812 06:37:23.484609  6017 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:23.484745  6017 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:23.488651  6017 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:23.490993  6045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:23.492295  6017 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:37:23.492416  6017 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
uuid: "064d62ad9bd64d2cafeb4403115b13a9"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:23.492872  6017 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:23.514169  6017 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:23.514801  6017 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:23.514967  6017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:23.515594  6017 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:23.516829  6055 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:23.520622  6017 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:23.520709  6017 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:37:23.520803  6017 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:23.522434  6017 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:23.522516  6017 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:37:23.522883  6055 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Bootstrap starting.
I20260812 06:37:23.534090  6017 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.3:45893
I20260812 06:37:23.534189  6233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.3:45893 every 8 connection(s)
I20260812 06:37:23.535175  6017 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:23.538287  6055 log.cc:826] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:23.539973  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 6017
I20260812 06:37:23.540490  1916 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
/tmp/dist-test-taskSvRSWo/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.223.4:40751
--local_ip_for_outbound_sockets=127.1.223.4
--tserver_master_addrs=127.1.223.62:45325
--webserver_port=40437
--webserver_interface=127.1.223.4
--builtin_ntp_servers=127.1.223.20:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20260812 06:37:23.541564  6055 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:23.541953  6055 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Bootstrap complete.
I20260812 06:37:23.543723  6055 ts_tablet_manager.cc:1403] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.010s
I20260812 06:37:23.544867  6234 heartbeater.cc:344] Connected to a master server at 127.1.223.62:45325
I20260812 06:37:23.545142  6234 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:23.545676  6234 heartbeater.cc:507] Master 127.1.223.62:45325 requested a full tablet report, sending...
I20260812 06:37:23.546562  6055 raft_consensus.cc:359] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:23.546936  6055 raft_consensus.cc:740] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 064d62ad9bd64d2cafeb4403115b13a9, State: Initialized, Role: FOLLOWER
I20260812 06:37:23.547369  6055 consensus_queue.cc:260] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:23.547811  5703 ts_manager.cc:194] Registered new tserver with Master: 064d62ad9bd64d2cafeb4403115b13a9 (127.1.223.3:45893)
I20260812 06:37:23.548439  6055 ts_tablet_manager.cc:1434] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260812 06:37:23.548852  5703 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.3:33409
I20260812 06:37:23.550595  6234 heartbeater.cc:499] Master 127.1.223.62:45325 was elected leader, sending a full tablet report...
W20260812 06:37:23.653234  6242 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:23.653470  6242 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:23.653546  6242 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:23.657155  6242 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:23.657281  6242 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.223.4
I20260812 06:37:23.661868  6242 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.223.20:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.223.4:40751
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.1.223.4
--webserver_port=40437
--tserver_master_addrs=127.1.223.62:45325
--never_fsync=true
--heap_profile_path=/tmp/kudu.6242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.223.4

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:23.663060  6242 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:23.664270  6242 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:23.670910  6255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.670910  6261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.670953  6257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:23.671000  6242 server_base.cc:1061] running on GCE node
I20260812 06:37:23.671629  6242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:23.672257  6242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:23.673444  6242 hybrid_clock.cc:648] HybridClock initialized: now 1786516643673427 us; error 36 us; skew 500 ppm
I20260812 06:37:23.675122  6242 webserver.cc:533] Webserver started at http://127.1.223.4:40437/ using document root <none> and password file <none>
I20260812 06:37:23.675797  6242 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:23.675901  6242 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:23.679585  6242 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.004s	sys 0.000s
I20260812 06:37:23.681633  6272 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:23.683015  6242 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:23.683111  6242 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data,/tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
uuid: "0c251a4437df41d69f92433c3427f71e"
format_stamp: "Formatted at 2026-08-12 06:37:21 on dist-test-slave-gw5c"
I20260812 06:37:23.683568  6242 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:23.701397  6242 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:23.702299  6242 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:23.702565  6242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:23.703271  6242 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:23.704605  6283 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:23.707990  6242 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:23.708060  6242 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:37:23.708154  6242 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:23.709710  6242 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:23.709755  6242 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:37:23.710098  6283 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Bootstrap starting.
I20260812 06:37:23.721529  6242 rpc_server.cc:307] RPC server started. Bound to: 127.1.223.4:40751
I20260812 06:37:23.721545  6461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.223.4:40751 every 8 connection(s)
I20260812 06:37:23.722636  6242 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskSvRSWo/test-tmp/tablet_copy-itest.2.FailureCause_TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote_1.1786516628863504-1916-0/minicluster-data/ts-3/data/info.pb
I20260812 06:37:23.723006  1916 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu as pid 6242
I20260812 06:37:23.726459  6283 log.cc:826] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:23.730825  6283 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:23.731518  6283 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Bootstrap complete.
I20260812 06:37:23.732996  6283 ts_tablet_manager.cc:1403] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.015s
I20260812 06:37:23.733378  6462 heartbeater.cc:344] Connected to a master server at 127.1.223.62:45325
I20260812 06:37:23.733623  6462 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:23.734282  6462 heartbeater.cc:507] Master 127.1.223.62:45325 requested a full tablet report, sending...
I20260812 06:37:23.736104  6283 raft_consensus.cc:359] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:23.736403  5700 ts_manager.cc:194] Registered new tserver with Master: 0c251a4437df41d69f92433c3427f71e (127.1.223.4:40751)
I20260812 06:37:23.736480  6283 raft_consensus.cc:740] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c251a4437df41d69f92433c3427f71e, State: Initialized, Role: FOLLOWER
I20260812 06:37:23.736960  6283 consensus_queue.cc:260] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:23.737452  5700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.223.4:48027
I20260812 06:37:23.737901  6283 ts_tablet_manager.cc:1434] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.006s
I20260812 06:37:23.739930  6462 heartbeater.cc:499] Master 127.1.223.62:45325 was elected leader, sending a full tablet report...
W20260812 06:37:23.758211  6316 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.758213  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.758211  6318 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.758213  6315 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.764462  5587 meta_cache.cc:302] tablet 1acd54cf05e946139e1225805aec9e2b: replica f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749) has failed: Network error: Client connection negotiation failed: client connection to 127.1.223.2:38749: connect: Connection refused (error 111)
W20260812 06:37:23.771936  6093 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.771939  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.771939  6091 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.771936  6092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.797847  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.797851  6316 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.806900  6092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.807976  6092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.811627  6316 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.823146  6316 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.833608  6316 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.844658  6316 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.845088  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.860031  6316 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.860044  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.874588  6316 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.874679  6318 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.874679  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.891546  6092 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.891547  6093 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.891547  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.907933  6318 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.908592  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.925812  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.936919  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.948925  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:23.956766  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.978060  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:23.988579  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.002349  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.008515  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.023733  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.047017  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.047017  6318 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.069576  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.072592  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.095731  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.123082  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.149549  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.161785  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.178408  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.189904  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.213698  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.241696  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.247048  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.272311  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.295938  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.329322  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.340986  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
I20260812 06:37:24.359974  6012 heartbeater.cc:499] Master 127.1.223.62:45325 was elected leader, sending a full tablet report...
W20260812 06:37:24.367527  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.384088  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.420683  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.443645  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.459932  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.488858  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.513906  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.530038  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.564091  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.575670  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.604812  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.636665  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.679432  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.725666  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.741088  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.773211  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.777240  5587 meta_cache.cc:302] tablet 1acd54cf05e946139e1225805aec9e2b: replica f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749) has failed: Network error: Client connection negotiation failed: client connection to 127.1.223.2:38749: connect: Connection refused (error 111)
W20260812 06:37:24.820588  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.833797  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.867837  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.883265  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.924803  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
W20260812 06:37:24.956753  6094 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:48272: Illegal state: replica 064d62ad9bd64d2cafeb4403115b13a9 is not leader of this config: current role FOLLOWER
W20260812 06:37:24.976368  6313 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:33006: Illegal state: replica 0c251a4437df41d69f92433c3427f71e is not leader of this config: current role FOLLOWER
I20260812 06:37:24.981364  6495 raft_consensus.cc:493] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:24.981571  6495 raft_consensus.cc:515] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:24.982911  6495 leader_election.cc:290] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749), 064d62ad9bd64d2cafeb4403115b13a9 (127.1.223.3:45893), 45d12906776541588d507ddfdf9b36d9 (127.1.223.1:42565)
W20260812 06:37:24.983603  6278 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.223.2:38749: connect: Connection refused (error 111)
W20260812 06:37:24.984534  6278 leader_election.cc:336] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749): Network error: Client connection negotiation failed: client connection to 127.1.223.2:38749: connect: Connection refused (error 111)
I20260812 06:37:24.987478  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acd54cf05e946139e1225805aec9e2b" candidate_uuid: "0c251a4437df41d69f92433c3427f71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "064d62ad9bd64d2cafeb4403115b13a9" is_pre_election: true
I20260812 06:37:24.987862  6157 raft_consensus.cc:2468] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c251a4437df41d69f92433c3427f71e in term 1.
I20260812 06:37:24.987486  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acd54cf05e946139e1225805aec9e2b" candidate_uuid: "0c251a4437df41d69f92433c3427f71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45d12906776541588d507ddfdf9b36d9" is_pre_election: true
I20260812 06:37:24.988513  5934 raft_consensus.cc:1803] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.0
I20260812 06:37:24.988831  5934 raft_consensus.cc:2468] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c251a4437df41d69f92433c3427f71e in term 1.
I20260812 06:37:24.989236  6278 leader_election.cc:304] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 064d62ad9bd64d2cafeb4403115b13a9, 0c251a4437df41d69f92433c3427f71e, 45d12906776541588d507ddfdf9b36d9; no voters: f89b6d0bcdaa40b6b9c7ff931abd05d5
I20260812 06:37:24.989470  6495 raft_consensus.cc:2804] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:37:24.989542  6495 raft_consensus.cc:493] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:24.989584  6495 raft_consensus.cc:3060] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:24.991179  6495 raft_consensus.cc:515] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:24.991775  6495 leader_election.cc:290] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 2 election: Requested vote from peers f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749), 064d62ad9bd64d2cafeb4403115b13a9 (127.1.223.3:45893), 45d12906776541588d507ddfdf9b36d9 (127.1.223.1:42565)
I20260812 06:37:24.992254  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acd54cf05e946139e1225805aec9e2b" candidate_uuid: "0c251a4437df41d69f92433c3427f71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "064d62ad9bd64d2cafeb4403115b13a9"
I20260812 06:37:24.992358  5934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1acd54cf05e946139e1225805aec9e2b" candidate_uuid: "0c251a4437df41d69f92433c3427f71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45d12906776541588d507ddfdf9b36d9"
I20260812 06:37:24.992413  6157 raft_consensus.cc:3060] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:24.992452  5934 raft_consensus.cc:1803] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 1 FOLLOWER]: voting while tombstoned based on last-logged opid 1.0
I20260812 06:37:24.992515  5934 raft_consensus.cc:3060] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 1 FOLLOWER]: Advancing to term 2
W20260812 06:37:24.992729  6278 leader_election.cc:336] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749): Network error: Client connection negotiation failed: client connection to 127.1.223.2:38749: connect: Connection refused (error 111)
I20260812 06:37:24.993649  5934 raft_consensus.cc:2468] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c251a4437df41d69f92433c3427f71e in term 2.
I20260812 06:37:24.994446  6157 raft_consensus.cc:2468] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c251a4437df41d69f92433c3427f71e in term 2.
I20260812 06:37:24.994870  6277 leader_election.cc:304] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 064d62ad9bd64d2cafeb4403115b13a9, 0c251a4437df41d69f92433c3427f71e, 45d12906776541588d507ddfdf9b36d9; no voters: f89b6d0bcdaa40b6b9c7ff931abd05d5
I20260812 06:37:24.995093  6495 raft_consensus.cc:2804] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:24.995335  6495 raft_consensus.cc:697] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [term 2 LEADER]: Becoming Leader. State: Replica: 0c251a4437df41d69f92433c3427f71e, State: Running, Role: LEADER
I20260812 06:37:24.995680  6495 consensus_queue.cc:237] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:24.998817  5698 catalog_manager.cc:5719] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "0c251a4437df41d69f92433c3427f71e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:25.020051  6157 raft_consensus.cc:1275] T 1acd54cf05e946139e1225805aec9e2b P 064d62ad9bd64d2cafeb4403115b13a9 [term 2 FOLLOWER]: Refusing update from remote peer 0c251a4437df41d69f92433c3427f71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260812 06:37:25.020308  6278 consensus_peers.cc:597] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e -> Peer 45d12906776541588d507ddfdf9b36d9 (127.1.223.1:42565): Couldn't send request to peer 45d12906776541588d507ddfdf9b36d9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 06:37:25.020458  6278 consensus_peers.cc:597] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e -> Peer f89b6d0bcdaa40b6b9c7ff931abd05d5 (127.1.223.2:38749): Couldn't send request to peer f89b6d0bcdaa40b6b9c7ff931abd05d5. Status: Network error: Client connection negotiation failed: client connection to 127.1.223.2:38749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:25.021036  6495 consensus_queue.cc:1048] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:37:25.403040  6521 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:25.403246  6521 raft_consensus.cc:2243] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:25.403337  6521 raft_consensus.cc:2272] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:25.403688  6521 ts_tablet_manager.cc:933] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Initiating tablet copy from peer 0c251a4437df41d69f92433c3427f71e (127.1.223.4:40751)
I20260812 06:37:25.404210  6521 tablet_copy_client.cc:323] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: tablet copy: Beginning tablet copy session from remote peer at address 127.1.223.4:40751
I20260812 06:37:25.408601  6428 tablet_copy_service.cc:140] P 0c251a4437df41d69f92433c3427f71e: Received BeginTabletCopySession request for tablet 1acd54cf05e946139e1225805aec9e2b from peer 45d12906776541588d507ddfdf9b36d9 ({username='slave'} at 127.1.223.1:57655)
I20260812 06:37:25.408787  6428 tablet_copy_service.cc:161] P 0c251a4437df41d69f92433c3427f71e: Beginning new tablet copy session on tablet 1acd54cf05e946139e1225805aec9e2b from peer 45d12906776541588d507ddfdf9b36d9 at {username='slave'} at 127.1.223.1:57655: session id = 45d12906776541588d507ddfdf9b36d9-1acd54cf05e946139e1225805aec9e2b
I20260812 06:37:25.410352  6428 tablet_copy_source_session.cc:215] T 1acd54cf05e946139e1225805aec9e2b P 0c251a4437df41d69f92433c3427f71e: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:25.412041  6521 ts_tablet_manager.cc:1916] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 06:37:25.413872  6521 ts_tablet_manager.cc:1929] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20260812 06:37:25.414218  6521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1acd54cf05e946139e1225805aec9e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:25.415500  6521 tablet_copy_client.cc:806] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: tablet copy: Starting download of 0 data blocks...
I20260812 06:37:25.415716  6521 tablet_copy_client.cc:670] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: tablet copy: Starting download of 1 WAL segments...
I20260812 06:37:25.417863  6521 tablet_copy_client.cc:538] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:37:25.419521  6521 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Bootstrap starting.
I20260812 06:37:25.425372  6521 log.cc:826] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:25.428973  6521 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 5 replicates
I20260812 06:37:25.429548  6521 tablet_bootstrap.cc:492] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Bootstrap complete.
I20260812 06:37:25.429895  6521 ts_tablet_manager.cc:1403] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.001s
I20260812 06:37:25.432016  6521 raft_consensus.cc:359] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 2 FOLLOWER]: Replica starting. Triggering 5 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:25.434139  6521 raft_consensus.cc:740] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45d12906776541588d507ddfdf9b36d9, State: Initialized, Role: FOLLOWER
I20260812 06:37:25.434706  6521 consensus_queue.cc:260] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f89b6d0bcdaa40b6b9c7ff931abd05d5" member_type: VOTER last_known_addr { host: "127.1.223.2" port: 38749 } } peers { permanent_uuid: "0c251a4437df41d69f92433c3427f71e" member_type: VOTER last_known_addr { host: "127.1.223.4" port: 40751 } } peers { permanent_uuid: "064d62ad9bd64d2cafeb4403115b13a9" member_type: VOTER last_known_addr { host: "127.1.223.3" port: 45893 } } peers { permanent_uuid: "45d12906776541588d507ddfdf9b36d9" member_type: VOTER last_known_addr { host: "127.1.223.1" port: 42565 } attrs { } }
I20260812 06:37:25.435679  6521 ts_tablet_manager.cc:1434] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260812 06:37:25.436721  6428 tablet_copy_service.cc:342] P 0c251a4437df41d69f92433c3427f71e: Request end of tablet copy session 45d12906776541588d507ddfdf9b36d9-1acd54cf05e946139e1225805aec9e2b received from {username='slave'} at 127.1.223.1:57655
I20260812 06:37:25.436857  6428 tablet_copy_service.cc:434] P 0c251a4437df41d69f92433c3427f71e: ending tablet copy session 45d12906776541588d507ddfdf9b36d9-1acd54cf05e946139e1225805aec9e2b on tablet 1acd54cf05e946139e1225805aec9e2b with peer 45d12906776541588d507ddfdf9b36d9
I20260812 06:37:25.903607  5934 raft_consensus.cc:1217] T 1acd54cf05e946139e1225805aec9e2b P 45d12906776541588d507ddfdf9b36d9 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.7]   Dedup: 2.7->[]
I20260812 06:37:25.905431  6536 mvcc.cc:204] Tried to move back new op lower bound from 7317572177990651904 to 7317572177905147904. Current Snapshot: MvccSnapshot[applied={T|T < 7317572177990651904}]
I20260812 06:37:25.907842  6548 mvcc.cc:204] Tried to move back new op lower bound from 7317572178798317568 to 7317572177905147904. Current Snapshot: MvccSnapshot[applied={T|T < 7317572177990651904}]
I20260812 06:37:26.768092  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 5765
I20260812 06:37:26.799053  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 6017
I20260812 06:37:26.815601  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 6242
I20260812 06:37:26.837361  1916 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskSvRSWo/build/debug/bin/kudu with pid 5656
2026-08-12T06:37:26Z chronyd exiting
[       OK ] FailureCause/TabletCopyFailureITest.TestTabletCopyNewReplicaFailureCanVote/1 (6052 ms)
[----------] 1 test from FailureCause/TabletCopyFailureITest (6052 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 2 test suites ran. (17995 ms total)
[  PASSED  ] 4 tests.
I20260812 06:37:26.869789  1916 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 8 messages since previous log ~2 seconds ago
