Note: This is test shard 3 of 4.
[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from HmsConfigurations/MasterFailoverTest
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestPauseAfterCreateTableIssued/0
2026-08-12T08:02:37Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:37Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 08:02:37.566993 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:39305
--webserver_interface=127.22.169.126
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:02:37.666627 23218 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:37.666802 23218 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:37.666837 23218 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:37.669971 23218 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:37.670023 23218 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:37.670042 23218 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:37.670059 23218 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:37.673635 23218 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:39305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.169.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.23218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:37.674536 23218 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:37.675464 23218 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:37.680210 23231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:37.680202 23234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:37.680199 23227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:37.680502 23218 server_base.cc:1061] running on GCE node
I20260812 08:02:37.680991 23218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:37.681766 23218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:37.682915 23218 hybrid_clock.cc:648] HybridClock initialized: now 1786521757682923 us; error 105 us; skew 500 ppm
I20260812 08:02:37.684440 23218 webserver.cc:533] Webserver started at http://127.22.169.126:44801/ using document root <none> and password file <none>
I20260812 08:02:37.684955 23218 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:37.685014 23218 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:37.685175 23218 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:37.686576 23218 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/data/instance:
uuid: "86709aa6ff854e12aaf2aa8fa234327b"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:37.686987 23218 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/wal/instance:
uuid: "86709aa6ff854e12aaf2aa8fa234327b"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:37.690172 23218 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:37.692018 23243 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:37.692865 23218 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:37.692975 23218 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/wal
uuid: "86709aa6ff854e12aaf2aa8fa234327b"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:37.693053 23218 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:37.703840 23218 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:37.704331 23218 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:37.704478 23218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:37.711128 23218 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.126:39305
I20260812 08:02:37.711131 23342 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.126:39305 every 8 connection(s)
I20260812 08:02:37.711987 23218 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:37.714568 23343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:37.717219 23343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:37.721796 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 23218
I20260812 08:02:37.721944 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-0/wal/instance
I20260812 08:02:37.723361 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:46639
--webserver_interface=127.22.169.125
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:02:37.729444 23343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:37.730124 23248 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.169.125:46639: connect: Connection refused (error 111)
W20260812 08:02:37.730885 23343 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:46639: Network error: Client connection negotiation failed: client connection to 127.22.169.125:46639: connect: Connection refused (error 111)
I20260812 08:02:37.780088 23343 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } attempt: 1
W20260812 08:02:37.781482 23343 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:46639: Network error: Client connection negotiation failed: client connection to 127.22.169.125:46639: connect: Connection refused (error 111)
W20260812 08:02:37.823222 23347 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:37.823390 23347 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:37.823426 23347 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:37.826565 23347 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:37.826611 23347 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:37.826630 23347 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:37.826653 23347 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:37.830348 23347 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:46639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.169.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.23347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:37.831185 23347 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:37.832129 23347 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:37.837044 23357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:37.837049 23356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:37.837234 23347 server_base.cc:1061] running on GCE node
W20260812 08:02:37.837050 23359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:37.837793 23347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:37.838634 23347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:37.839779 23347 hybrid_clock.cc:648] HybridClock initialized: now 1786521757839759 us; error 34 us; skew 500 ppm
I20260812 08:02:37.841292 23347 webserver.cc:533] Webserver started at http://127.22.169.125:33911/ using document root <none> and password file <none>
I20260812 08:02:37.841807 23347 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:37.841862 23347 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:37.842062 23347 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:37.843480 23347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/data/instance:
uuid: "c33584259c8544a2bb2b4bf97621c84e"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:37.843924 23347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/wal/instance:
uuid: "c33584259c8544a2bb2b4bf97621c84e"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:37.846899 23347 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:37.848742 23371 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:37.849625 23347 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:37.849653 23343 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } attempt: 2
I20260812 08:02:37.849728 23347 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/wal
uuid: "c33584259c8544a2bb2b4bf97621c84e"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:37.849818 23347 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 08:02:37.850920 23343 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:46639: Network error: Client connection negotiation failed: client connection to 127.22.169.125:46639: connect: Connection refused (error 111)
I20260812 08:02:37.860404 23347 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:37.860898 23347 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:37.861042 23347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:37.867622 23469 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.125:46639 every 8 connection(s)
I20260812 08:02:37.867630 23347 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.125:46639
I20260812 08:02:37.868520 23347 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
I20260812 08:02:37.871088 23470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:37.873713 23470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:37.878681 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 23347
I20260812 08:02:37.878768 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-1/wal/instance
I20260812 08:02:37.879434 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:35721
--webserver_interface=127.22.169.124
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:02:37.881379 23470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:37.887003 23470 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:37.887643 23378 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.169.124:35721: connect: Connection refused (error 111)
W20260812 08:02:37.888449 23470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:35721: Network error: Client connection negotiation failed: client connection to 127.22.169.124:35721: connect: Connection refused (error 111)
I20260812 08:02:37.937645 23470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } attempt: 1
W20260812 08:02:37.938997 23470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:35721: Network error: Client connection negotiation failed: client connection to 127.22.169.124:35721: connect: Connection refused (error 111)
I20260812 08:02:37.942083 23343 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } attempt: 3
I20260812 08:02:37.946081 23343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:37.947222 23343 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:35721: Network error: Client connection negotiation failed: client connection to 127.22.169.124:35721: connect: Connection refused (error 111)
I20260812 08:02:37.978376 23343 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } attempt: 1
W20260812 08:02:37.979549 23343 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:35721: Network error: Client connection negotiation failed: client connection to 127.22.169.124:35721: connect: Connection refused (error 111)
W20260812 08:02:37.981249 23473 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:37.981415 23473 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:37.981472 23473 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:37.984630 23473 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:37.984680 23473 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:37.984710 23473 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:37.984741 23473 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:37.988391 23473 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:35721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.169.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.23473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:37.989254 23473 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:37.990263 23473 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:37.995034 23490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:37.995014 23491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:37.995105 23499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:37.995257 23473 server_base.cc:1061] running on GCE node
I20260812 08:02:37.995692 23473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:37.996443 23473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:37.997591 23473 hybrid_clock.cc:648] HybridClock initialized: now 1786521757997577 us; error 24 us; skew 500 ppm
I20260812 08:02:37.999070 23473 webserver.cc:533] Webserver started at http://127.22.169.124:38379/ using document root <none> and password file <none>
I20260812 08:02:37.999570 23473 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:37.999624 23473 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:37.999799 23473 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:38.001137 23473 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/data/instance:
uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:38.001564 23473 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/wal/instance:
uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:38.004559 23473 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260812 08:02:38.006399 23511 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.007140 23470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } attempt: 2
I20260812 08:02:38.007256 23473 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:38.007362 23473 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/wal
uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-tc2s"
I20260812 08:02:38.007454 23473 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 08:02:38.008375 23470 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:35721: Network error: Client connection negotiation failed: client connection to 127.22.169.124:35721: connect: Connection refused (error 111)
I20260812 08:02:38.021761 23473 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:38.022305 23473 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:38.022431 23473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:38.028992 23610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.124:35721 every 8 connection(s)
I20260812 08:02:38.028995 23473 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.124:35721
I20260812 08:02:38.029963 23473 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
I20260812 08:02:38.032538 23611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:38.034996 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 23473
I20260812 08:02:38.035079 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/master-2/wal/instance
I20260812 08:02:38.035303 23611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:38.043824 23611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:38.047904 23611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:38.054704 23343 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } attempt: 2
I20260812 08:02:38.055259 23611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5: Bootstrap starting.
I20260812 08:02:38.057271 23611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:38.058115 23611 log.cc:826] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:38.059778 23611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5: No bootstrap required, opened a new log
I20260812 08:02:38.059818 23343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: Bootstrap starting.
I20260812 08:02:38.061561 23343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:38.062343 23611 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.062500 23611 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:38.062551 23611 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1663f9c31e4c4be4bb6c2a6b41f478a5, State: Initialized, Role: FOLLOWER
I20260812 08:02:38.062533 23343 log.cc:826] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:38.062958 23611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.063426 23626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.063524 23626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:38.064031 23611 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:38.064410 23343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: No bootstrap required, opened a new log
I20260812 08:02:38.067152 23343 raft_consensus.cc:359] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.067363 23343 raft_consensus.cc:385] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:38.067477 23343 raft_consensus.cc:740] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86709aa6ff854e12aaf2aa8fa234327b, State: Initialized, Role: FOLLOWER
I20260812 08:02:38.067932 23343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
W20260812 08:02:38.068509 23644 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:38.068583 23644 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:02:38.067022 23473 master_runner.cc:187] Error getting master registration for 127.22.169.126:39305: OK, instance_id { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" instance_seqno: 1786521757709283 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:02:38.069048 23343 sys_catalog.cc:565] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:38.069062 23473 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:38.071378 23646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.071591 23646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:38.073911 23665 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:38.073984 23665 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:02:38.073529 23218 master_runner.cc:187] Error getting master registration for 127.22.169.125:46639: OK, instance_id { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" instance_seqno: 1786521757865819 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:02:38.075631 23218 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:38.099514 23470 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } attempt: 3
I20260812 08:02:38.105526 23470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e: Bootstrap starting.
I20260812 08:02:38.107637 23470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:38.108299 23470 log.cc:826] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:38.109728 23470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e: No bootstrap required, opened a new log
I20260812 08:02:38.112425 23470 raft_consensus.cc:359] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.112567 23470 raft_consensus.cc:385] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:38.112679 23470 raft_consensus.cc:740] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c33584259c8544a2bb2b4bf97621c84e, State: Initialized, Role: FOLLOWER
I20260812 08:02:38.113191 23470 consensus_queue.cc:260] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.114733 23470 sys_catalog.cc:565] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:02:38.119216 23695 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:38.119331 23695 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:02:38.122412 23347 master_runner.cc:264] No leader master found from master c33584259c8544a2bb2b4bf97621c84e
I20260812 08:02:38.122479 23347 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:38.122720 23670 sys_catalog.cc:455] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.122821 23670 sys_catalog.cc:458] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:38.189590 23670 raft_consensus.cc:493] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:38.189779 23670 raft_consensus.cc:515] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.191267 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c33584259c8544a2bb2b4bf97621c84e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b" is_pre_election: true
I20260812 08:02:38.191546 23290 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c33584259c8544a2bb2b4bf97621c84e in term 0.
I20260812 08:02:38.192072 23378 leader_election.cc:304] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86709aa6ff854e12aaf2aa8fa234327b, c33584259c8544a2bb2b4bf97621c84e; no voters: 
I20260812 08:02:38.192963 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c33584259c8544a2bb2b4bf97621c84e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" is_pre_election: true
I20260812 08:02:38.193231 23560 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c33584259c8544a2bb2b4bf97621c84e in term 0.
I20260812 08:02:38.193681 23670 leader_election.cc:290] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), 1663f9c31e4c4be4bb6c2a6b41f478a5 (127.22.169.124:35721)
I20260812 08:02:38.194006 23670 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:38.194123 23670 raft_consensus.cc:493] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:38.194212 23670 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:38.195587 23670 raft_consensus.cc:515] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.196249 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c33584259c8544a2bb2b4bf97621c84e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b"
I20260812 08:02:38.196367 23290 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:38.197467 23290 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c33584259c8544a2bb2b4bf97621c84e in term 1.
I20260812 08:02:38.197862 23378 leader_election.cc:304] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86709aa6ff854e12aaf2aa8fa234327b, c33584259c8544a2bb2b4bf97621c84e; no voters: 
I20260812 08:02:38.198422 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c33584259c8544a2bb2b4bf97621c84e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5"
I20260812 08:02:38.198526 23560 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:38.199591 23560 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c33584259c8544a2bb2b4bf97621c84e in term 1.
I20260812 08:02:38.199975 23670 leader_election.cc:290] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [CANDIDATE]: Term 1 election: Requested vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), 1663f9c31e4c4be4bb6c2a6b41f478a5 (127.22.169.124:35721)
I20260812 08:02:38.200177 23670 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:38.200295 23670 raft_consensus.cc:697] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 1 LEADER]: Becoming Leader. State: Replica: c33584259c8544a2bb2b4bf97621c84e, State: Running, Role: LEADER
I20260812 08:02:38.200671 23670 consensus_queue.cc:237] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.202478 23670 sys_catalog.cc:455] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c33584259c8544a2bb2b4bf97621c84e. Latest consensus state: current_term: 1 leader_uuid: "c33584259c8544a2bb2b4bf97621c84e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.202643 23670 sys_catalog.cc:458] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:38.204236 23702 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:38.205276 23702 catalog_manager.cc:1520] Initializing Kudu cluster ID...
W20260812 08:02:38.205619 23254 tablet.cc:2406] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:38.212492 23560 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Refusing update from remote peer c33584259c8544a2bb2b4bf97621c84e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:38.213132 23670 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:38.216588 23626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c33584259c8544a2bb2b4bf97621c84e. Latest consensus state: current_term: 1 leader_uuid: "c33584259c8544a2bb2b4bf97621c84e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.216686 23626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:38.217569 23290 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 1 FOLLOWER]: Refusing update from remote peer c33584259c8544a2bb2b4bf97621c84e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:38.218171 23670 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:38.221221 23646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c33584259c8544a2bb2b4bf97621c84e. Latest consensus state: current_term: 1 leader_uuid: "c33584259c8544a2bb2b4bf97621c84e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.221318 23646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:38.225790 23670 sys_catalog.cc:455] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c33584259c8544a2bb2b4bf97621c84e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.225932 23670 sys_catalog.cc:458] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:38.227049 23646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c33584259c8544a2bb2b4bf97621c84e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.227139 23646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:38.227516 23706 mvcc.cc:204] Tried to move back new op lower bound from 7317593121631371264 to 7317593121593278464. Current Snapshot: MvccSnapshot[applied={T|T < 7317593121631371264}]
I20260812 08:02:38.231778 23699 sys_catalog.cc:455] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c33584259c8544a2bb2b4bf97621c84e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.231876 23699 sys_catalog.cc:458] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:38.232930 23626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c33584259c8544a2bb2b4bf97621c84e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:38.233037 23626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:38.233708 23713 mvcc.cc:204] Tried to move back new op lower bound from 7317593121631371264 to 7317593121593278464. Current Snapshot: MvccSnapshot[applied={T|T < 7317593121631371264}]
I20260812 08:02:38.233927 23707 mvcc.cc:204] Tried to move back new op lower bound from 7317593121631371264 to 7317593121593278464. Current Snapshot: MvccSnapshot[applied={T|T < 7317593121631371264}]
I20260812 08:02:38.238366 23702 catalog_manager.cc:1383] Generated new cluster ID: 0cf72338e6e74afdb38b274853a41c79
I20260812 08:02:38.238426 23702 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:38.273054 23702 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:38.274204 23702 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:38.291107 23702 catalog_manager.cc:6092] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e: Generated new TSK 0
I20260812 08:02:38.291782 23702 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:38.315160 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.65:0
--local_ip_for_outbound_sockets=127.22.169.65
--webserver_interface=127.22.169.65
--webserver_port=0
--tserver_master_addrs=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--builtin_ntp_servers=127.22.169.84:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:02:38.418043 23720 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:38.418215 23720 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:38.418277 23720 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:38.421375 23720 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:38.421487 23720 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.65
I20260812 08:02:38.425067 23720 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.169.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--never_fsync=true
--heap_profile_path=/tmp/kudu.23720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:38.425972 23720 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:38.426965 23720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:38.432708 23738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.432881 23735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.432703 23734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.432845 23720 server_base.cc:1061] running on GCE node
I20260812 08:02:38.433284 23720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:38.433787 23720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:38.434934 23720 hybrid_clock.cc:648] HybridClock initialized: now 1786521758434917 us; error 33 us; skew 500 ppm
I20260812 08:02:38.436404 23720 webserver.cc:533] Webserver started at http://127.22.169.65:45741/ using document root <none> and password file <none>
I20260812 08:02:38.436923 23720 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:38.436983 23720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:38.437161 23720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:38.438592 23720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/data/instance:
uuid: "43319670b55d4c0d87e125571c122986"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.439029 23720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/wal/instance:
uuid: "43319670b55d4c0d87e125571c122986"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.442257 23720 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:38.444227 23754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.445067 23720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:38.445166 23720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
uuid: "43319670b55d4c0d87e125571c122986"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.445245 23720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:38.458818 23720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:38.459316 23720 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:38.459465 23720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:38.459928 23720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:38.460855 23720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:38.460903 23720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.460949 23720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:38.460978 23720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.469089 23720 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.65:43339
I20260812 08:02:38.469146 23997 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.65:43339 every 8 connection(s)
I20260812 08:02:38.469928 23720 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:38.470814 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 23720
I20260812 08:02:38.470925 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:38.473737 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.66:0
--local_ip_for_outbound_sockets=127.22.169.66
--webserver_interface=127.22.169.66
--webserver_port=0
--tserver_master_addrs=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--builtin_ntp_servers=127.22.169.84:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:02:38.479918 24001 heartbeater.cc:344] Connected to a master server at 127.22.169.125:46639
I20260812 08:02:38.479969 23999 heartbeater.cc:344] Connected to a master server at 127.22.169.124:35721
I20260812 08:02:38.479981 24000 heartbeater.cc:344] Connected to a master server at 127.22.169.126:39305
I20260812 08:02:38.480142 24000 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.480137 23999 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.480137 24001 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.480734 23999 heartbeater.cc:507] Master 127.22.169.124:35721 requested a full tablet report, sending...
I20260812 08:02:38.480747 24001 heartbeater.cc:507] Master 127.22.169.125:46639 requested a full tablet report, sending...
I20260812 08:02:38.480841 24000 heartbeater.cc:507] Master 127.22.169.126:39305 requested a full tablet report, sending...
I20260812 08:02:38.482241 23538 ts_manager.cc:194] Registered new tserver with Master: 43319670b55d4c0d87e125571c122986 (127.22.169.65:43339)
I20260812 08:02:38.482241 23272 ts_manager.cc:194] Registered new tserver with Master: 43319670b55d4c0d87e125571c122986 (127.22.169.65:43339)
I20260812 08:02:38.482501 23404 ts_manager.cc:194] Registered new tserver with Master: 43319670b55d4c0d87e125571c122986 (127.22.169.65:43339)
I20260812 08:02:38.484000 23404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.65:58237
W20260812 08:02:38.575635 24020 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:38.575799 24020 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:38.575843 24020 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:38.578951 24020 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:38.579049 24020 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.66
I20260812 08:02:38.582620 24020 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.169.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--never_fsync=true
--heap_profile_path=/tmp/kudu.24020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:38.583483 24020 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:38.584482 24020 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:38.590159 24033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.590308 24020 server_base.cc:1061] running on GCE node
W20260812 08:02:38.590166 24035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.590167 24029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.590794 24020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:38.591270 24020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:38.592412 24020 hybrid_clock.cc:648] HybridClock initialized: now 1786521758592404 us; error 21 us; skew 500 ppm
I20260812 08:02:38.593855 24020 webserver.cc:533] Webserver started at http://127.22.169.66:42619/ using document root <none> and password file <none>
I20260812 08:02:38.594390 24020 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:38.594448 24020 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:38.594635 24020 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:38.596072 24020 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/data/instance:
uuid: "adff8ca501be4c8c9b2e1e58ffad98a8"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.596534 24020 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/wal/instance:
uuid: "adff8ca501be4c8c9b2e1e58ffad98a8"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.599763 24020 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 08:02:38.601748 24045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.602659 24020 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:38.602756 24020 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
uuid: "adff8ca501be4c8c9b2e1e58ffad98a8"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.602833 24020 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:38.630393 24020 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:38.630906 24020 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:38.631057 24020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:38.631541 24020 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:38.632445 24020 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:38.632501 24020 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.632551 24020 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:38.632575 24020 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.640856 24020 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.66:41957
I20260812 08:02:38.640887 24285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.66:41957 every 8 connection(s)
I20260812 08:02:38.641685 24020 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:38.649757 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 24020
I20260812 08:02:38.649859 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:38.650107 24288 heartbeater.cc:344] Connected to a master server at 127.22.169.124:35721
I20260812 08:02:38.650167 24289 heartbeater.cc:344] Connected to a master server at 127.22.169.126:39305
I20260812 08:02:38.650190 24290 heartbeater.cc:344] Connected to a master server at 127.22.169.125:46639
I20260812 08:02:38.650318 24289 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.650321 24290 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.650321 24288 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.650869 24290 heartbeater.cc:507] Master 127.22.169.125:46639 requested a full tablet report, sending...
I20260812 08:02:38.650870 24289 heartbeater.cc:507] Master 127.22.169.126:39305 requested a full tablet report, sending...
I20260812 08:02:38.650869 24288 heartbeater.cc:507] Master 127.22.169.124:35721 requested a full tablet report, sending...
I20260812 08:02:38.651973 23402 ts_manager.cc:194] Registered new tserver with Master: adff8ca501be4c8c9b2e1e58ffad98a8 (127.22.169.66:41957)
I20260812 08:02:38.652325 23272 ts_manager.cc:194] Registered new tserver with Master: adff8ca501be4c8c9b2e1e58ffad98a8 (127.22.169.66:41957)
I20260812 08:02:38.652590 23538 ts_manager.cc:194] Registered new tserver with Master: adff8ca501be4c8c9b2e1e58ffad98a8 (127.22.169.66:41957)
I20260812 08:02:38.652637 23402 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.66:54451
I20260812 08:02:38.653234 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.67:0
--local_ip_for_outbound_sockets=127.22.169.67
--webserver_interface=127.22.169.67
--webserver_port=0
--tserver_master_addrs=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--builtin_ntp_servers=127.22.169.84:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:02:38.752903 24301 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:38.753084 24301 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:38.753154 24301 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:38.756345 24301 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:38.756462 24301 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.67
I20260812 08:02:38.760095 24301 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.169.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:39305,127.22.169.125:46639,127.22.169.124:35721
--never_fsync=true
--heap_profile_path=/tmp/kudu.24301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:38.761036 24301 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:38.762061 24301 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:38.767864 24311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.767915 24308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.768066 24309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.768051 24301 server_base.cc:1061] running on GCE node
I20260812 08:02:38.768396 24301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:38.768885 24301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:38.770030 24301 hybrid_clock.cc:648] HybridClock initialized: now 1786521758770019 us; error 27 us; skew 500 ppm
I20260812 08:02:38.771572 24301 webserver.cc:533] Webserver started at http://127.22.169.67:37605/ using document root <none> and password file <none>
I20260812 08:02:38.772083 24301 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:38.772147 24301 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:38.772320 24301 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:38.773721 24301 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/data/instance:
uuid: "ac4460caf5b043be8387a6498fb05703"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.774176 24301 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/instance:
uuid: "ac4460caf5b043be8387a6498fb05703"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.777119 24301 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:38.779049 24324 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.779917 24301 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:38.780020 24301 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
uuid: "ac4460caf5b043be8387a6498fb05703"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-tc2s"
I20260812 08:02:38.780094 24301 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:38.788570 24336 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c33584259c8544a2bb2b4bf97621c84e)
I20260812 08:02:38.788697 24336 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:38.789628 24336 leader_election.cc:290] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639)
I20260812 08:02:38.790074 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b" is_pre_election: true
I20260812 08:02:38.790181 23425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:38.790704 23514 leader_election.cc:304] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5; no voters: 86709aa6ff854e12aaf2aa8fa234327b, c33584259c8544a2bb2b4bf97621c84e
I20260812 08:02:38.790912 24336 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:38.790925 24301 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:38.791416 24301 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:38.791541 24301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:38.791945 24301 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:38.792829 24301 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:38.792872 24301 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.792906 24301 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:38.792925 24301 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.801384 24301 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.67:44377
I20260812 08:02:38.801415 24558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.67:44377 every 8 connection(s)
I20260812 08:02:38.802222 24301 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:38.808444 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 24301
I20260812 08:02:38.808560 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:38.810918 24562 heartbeater.cc:344] Connected to a master server at 127.22.169.125:46639
I20260812 08:02:38.810878 24559 heartbeater.cc:344] Connected to a master server at 127.22.169.124:35721
I20260812 08:02:38.811154 24562 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.811196 24559 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.811667 24562 heartbeater.cc:507] Master 127.22.169.125:46639 requested a full tablet report, sending...
I20260812 08:02:38.811672 24559 heartbeater.cc:507] Master 127.22.169.124:35721 requested a full tablet report, sending...
I20260812 08:02:38.810881 24561 heartbeater.cc:344] Connected to a master server at 127.22.169.126:39305
I20260812 08:02:38.812242 24561 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.812389 24561 heartbeater.cc:507] Master 127.22.169.126:39305 requested a full tablet report, sending...
I20260812 08:02:38.813170 23272 ts_manager.cc:194] Registered new tserver with Master: ac4460caf5b043be8387a6498fb05703 (127.22.169.67:44377)
I20260812 08:02:38.813222 23402 ts_manager.cc:194] Registered new tserver with Master: ac4460caf5b043be8387a6498fb05703 (127.22.169.67:44377)
I20260812 08:02:38.813251 23538 ts_manager.cc:194] Registered new tserver with Master: ac4460caf5b043be8387a6498fb05703 (127.22.169.67:44377)
I20260812 08:02:38.813870 23402 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.67:52275
I20260812 08:02:38.827374 23205 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:38.839148 23402 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47644:
name: "default.test_pause_after_create_table_issued"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:38.841507 23402 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_pause_after_create_table_issued in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:38.847049 23205 master_failover-itest.cc:212] Pausing leader master
I20260812 08:02:38.985754 24001 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:39.069788 23644 catalog_manager.cc:1295] Loaded cluster ID: 0cf72338e6e74afdb38b274853a41c79
I20260812 08:02:39.069875 23644 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5: loading cluster ID for follower catalog manager: success
I20260812 08:02:39.071729 23644 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5: acquiring CA information for follower catalog manager: success
I20260812 08:02:39.072774 23644 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:02:39.074997 23665 catalog_manager.cc:1295] Loaded cluster ID: 0cf72338e6e74afdb38b274853a41c79
I20260812 08:02:39.075055 23665 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: loading cluster ID for follower catalog manager: success
I20260812 08:02:39.076507 23665 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: acquiring CA information for follower catalog manager: success
I20260812 08:02:39.077375 23665 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:02:39.154238 24290 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:39.315596 24562 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:39.346205 24607 raft_consensus.cc:493] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c33584259c8544a2bb2b4bf97621c84e)
I20260812 08:02:39.346341 24607 raft_consensus.cc:515] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:39.346880 24608 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c33584259c8544a2bb2b4bf97621c84e)
I20260812 08:02:39.346980 24608 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:39.347349 24607 leader_election.cc:290] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639), 1663f9c31e4c4be4bb6c2a6b41f478a5 (127.22.169.124:35721)
I20260812 08:02:39.347410 24608 leader_election.cc:290] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639)
I20260812 08:02:39.347756 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b" is_pre_election: true
I20260812 08:02:39.347853 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" is_pre_election: true
I20260812 08:02:39.347884 23290 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 in term 1.
I20260812 08:02:39.347978 23560 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86709aa6ff854e12aaf2aa8fa234327b in term 1.
I20260812 08:02:39.348209 23517 leader_election.cc:304] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5, 86709aa6ff854e12aaf2aa8fa234327b; no voters: 
I20260812 08:02:39.348308 23250 leader_election.cc:304] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5, 86709aa6ff854e12aaf2aa8fa234327b; no voters: 
I20260812 08:02:39.348366 24608 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:39.348414 24608 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c33584259c8544a2bb2b4bf97621c84e)
I20260812 08:02:39.348441 24608 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:39.348553 24607 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:39.348601 24607 raft_consensus.cc:493] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c33584259c8544a2bb2b4bf97621c84e)
I20260812 08:02:39.348649 24607 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:39.349370 24608 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:39.349455 24607 raft_consensus.cc:515] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:39.349822 24608 leader_election.cc:290] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 2 election: Requested vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639)
I20260812 08:02:39.349877 24607 leader_election.cc:290] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 2 election: Requested vote from peers c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639), 1663f9c31e4c4be4bb6c2a6b41f478a5 (127.22.169.124:35721)
I20260812 08:02:39.350063 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b"
I20260812 08:02:39.350208 23290 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 in current term 2: Already voted for candidate 86709aa6ff854e12aaf2aa8fa234327b in this term.
I20260812 08:02:39.350212 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5"
I20260812 08:02:39.350371 23560 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86709aa6ff854e12aaf2aa8fa234327b in current term 2: Already voted for candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 in this term.
W20260812 08:02:39.862011 23514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.511s (SENT)
W20260812 08:02:39.987181 24001 heartbeater.cc:646] Failed to heartbeat to 127.22.169.125:46639 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.169.125:46639 timed out after 1.000s (SENT)
W20260812 08:02:40.155680 24290 heartbeater.cc:646] Failed to heartbeat to 127.22.169.125:46639 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.169.125:46639 timed out after 1.000s (SENT)
W20260812 08:02:40.316751 24562 heartbeater.cc:646] Failed to heartbeat to 127.22.169.125:46639 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.169.125:46639 timed out after 1.000s (SENT)
W20260812 08:02:40.375377 23514 leader_election.cc:336] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.511s (SENT)
I20260812 08:02:40.375489 23514 leader_election.cc:304] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5; no voters: 86709aa6ff854e12aaf2aa8fa234327b, c33584259c8544a2bb2b4bf97621c84e
I20260812 08:02:40.375801 24615 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 08:02:40.378364 23248 leader_election.cc:336] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.513s (SENT)
I20260812 08:02:40.378450 23248 leader_election.cc:304] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86709aa6ff854e12aaf2aa8fa234327b; no voters: 1663f9c31e4c4be4bb6c2a6b41f478a5, c33584259c8544a2bb2b4bf97621c84e
I20260812 08:02:40.378736 24616 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 08:02:40.444212 23248 leader_election.cc:336] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.547s (SENT)
I20260812 08:02:40.487450 24001 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
W20260812 08:02:40.500072 23514 leader_election.cc:336] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.575s (SENT)
I20260812 08:02:40.655963 24290 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:40.817054 24562 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:40.906838 24617 raft_consensus.cc:493] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:40.906971 24617 raft_consensus.cc:515] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:40.907480 24617 leader_election.cc:290] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639), 1663f9c31e4c4be4bb6c2a6b41f478a5 (127.22.169.124:35721)
I20260812 08:02:40.907948 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 3 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" is_pre_election: true
I20260812 08:02:40.908082 23560 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86709aa6ff854e12aaf2aa8fa234327b in term 2.
I20260812 08:02:40.908398 23250 leader_election.cc:304] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5, 86709aa6ff854e12aaf2aa8fa234327b; no voters: 
I20260812 08:02:40.908588 24617 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:02:40.908658 24617 raft_consensus.cc:493] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:40.908699 24617 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:40.909586 24617 raft_consensus.cc:515] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:40.909976 24617 leader_election.cc:290] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 3 election: Requested vote from peers c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639), 1663f9c31e4c4be4bb6c2a6b41f478a5 (127.22.169.124:35721)
I20260812 08:02:40.910292 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 3 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5"
I20260812 08:02:40.910391 23560 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:40.911185 23560 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86709aa6ff854e12aaf2aa8fa234327b in term 3.
I20260812 08:02:40.911497 23250 leader_election.cc:304] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5, 86709aa6ff854e12aaf2aa8fa234327b; no voters: 
I20260812 08:02:40.911664 24617 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:02:40.911856 24617 raft_consensus.cc:697] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 3 LEADER]: Becoming Leader. State: Replica: 86709aa6ff854e12aaf2aa8fa234327b, State: Running, Role: LEADER
I20260812 08:02:40.912158 24617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:40.913468 24618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86709aa6ff854e12aaf2aa8fa234327b. Latest consensus state: current_term: 3 leader_uuid: "86709aa6ff854e12aaf2aa8fa234327b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:40.913574 24618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:40.913829 24621 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:40.915164 24621 catalog_manager.cc:679] Loaded metadata for table default.test_pause_after_create_table_issued [id=fa733a9f7cc84264984ea2dcd013d57d]
I20260812 08:02:40.916021 24621 tablet_loader.cc:96] loaded metadata for tablet 7601c17a306c49b984b76901575676c7 (table default.test_pause_after_create_table_issued [id=fa733a9f7cc84264984ea2dcd013d57d])
I20260812 08:02:40.916127 24621 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:40.916450 24621 catalog_manager.cc:1295] Loaded cluster ID: 0cf72338e6e74afdb38b274853a41c79
I20260812 08:02:40.916491 24621 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:40.916966 24621 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:40.917306 24621 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b: Loaded TSK: 0
I20260812 08:02:40.917845 24621 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:41.081682 23560 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Refusing update from remote peer 86709aa6ff854e12aaf2aa8fa234327b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 3 index: 7. (index mismatch)
I20260812 08:02:41.082206 24618 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 08:02:41.083704 24624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86709aa6ff854e12aaf2aa8fa234327b. Latest consensus state: current_term: 3 leader_uuid: "86709aa6ff854e12aaf2aa8fa234327b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:41.083835 24624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:41.084889 24617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "86709aa6ff854e12aaf2aa8fa234327b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:41.085001 24617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:41.085520 24624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "86709aa6ff854e12aaf2aa8fa234327b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:41.085616 24624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:41.093771 23856 tablet_service.cc:1511] Processing CreateTablet for tablet 7601c17a306c49b984b76901575676c7 (DEFAULT_TABLE table=default.test_pause_after_create_table_issued [id=fa733a9f7cc84264984ea2dcd013d57d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:41.093935 24431 tablet_service.cc:1511] Processing CreateTablet for tablet 7601c17a306c49b984b76901575676c7 (DEFAULT_TABLE table=default.test_pause_after_create_table_issued [id=fa733a9f7cc84264984ea2dcd013d57d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:41.094045 24143 tablet_service.cc:1511] Processing CreateTablet for tablet 7601c17a306c49b984b76901575676c7 (DEFAULT_TABLE table=default.test_pause_after_create_table_issued [id=fa733a9f7cc84264984ea2dcd013d57d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:41.094702 23856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601c17a306c49b984b76901575676c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:41.094806 24431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601c17a306c49b984b76901575676c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:41.094805 24143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7601c17a306c49b984b76901575676c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:41.099586 24644 tablet_bootstrap.cc:492] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986: Bootstrap starting.
I20260812 08:02:41.099992 24645 tablet_bootstrap.cc:492] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: Bootstrap starting.
I20260812 08:02:41.100369 24646 tablet_bootstrap.cc:492] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8: Bootstrap starting.
I20260812 08:02:41.102310 24646 tablet_bootstrap.cc:654] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.102310 24644 tablet_bootstrap.cc:654] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.103137 24644 log.cc:826] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.103137 24646 log.cc:826] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.103539 24645 tablet_bootstrap.cc:654] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.104182 24645 log.cc:826] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.104763 24646 tablet_bootstrap.cc:492] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8: No bootstrap required, opened a new log
I20260812 08:02:41.104763 24644 tablet_bootstrap.cc:492] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986: No bootstrap required, opened a new log
I20260812 08:02:41.104945 24644 ts_tablet_manager.cc:1403] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:41.104945 24646 ts_tablet_manager.cc:1403] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:02:41.105455 24645 tablet_bootstrap.cc:492] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: No bootstrap required, opened a new log
I20260812 08:02:41.105635 24645 ts_tablet_manager.cc:1403] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.000s
I20260812 08:02:41.108368 24645 raft_consensus.cc:359] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.108384 24646 raft_consensus.cc:359] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.108523 24646 raft_consensus.cc:385] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.108526 24645 raft_consensus.cc:385] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.108553 24646 raft_consensus.cc:740] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adff8ca501be4c8c9b2e1e58ffad98a8, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.108614 24645 raft_consensus.cc:740] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4460caf5b043be8387a6498fb05703, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.108850 24646 consensus_queue.cc:260] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.108986 24645 consensus_queue.cc:260] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.109800 24645 ts_tablet_manager.cc:1434] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:41.110985 24644 raft_consensus.cc:359] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.112080 24644 raft_consensus.cc:385] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.112152 24644 raft_consensus.cc:740] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43319670b55d4c0d87e125571c122986, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.112502 24644 consensus_queue.cc:260] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.113327 24644 ts_tablet_manager.cc:1434] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260812 08:02:41.113523 24000 heartbeater.cc:499] Master 127.22.169.126:39305 was elected leader, sending a full tablet report...
I20260812 08:02:41.113813 24646 ts_tablet_manager.cc:1434] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260812 08:02:41.114038 24289 heartbeater.cc:499] Master 127.22.169.126:39305 was elected leader, sending a full tablet report...
I20260812 08:02:41.114806 24561 heartbeater.cc:499] Master 127.22.169.126:39305 was elected leader, sending a full tablet report...
W20260812 08:02:41.144660 24294 tablet.cc:2406] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:41.223245 24009 tablet.cc:2406] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:41.307674 24564 tablet.cc:2406] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:41.361758 24653 raft_consensus.cc:493] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:41.361992 24653 raft_consensus.cc:515] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.363338 24653 leader_election.cc:290] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43319670b55d4c0d87e125571c122986 (127.22.169.65:43339), ac4460caf5b043be8387a6498fb05703 (127.22.169.67:44377)
I20260812 08:02:41.367244 23898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601c17a306c49b984b76901575676c7" candidate_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43319670b55d4c0d87e125571c122986" is_pre_election: true
I20260812 08:02:41.367300 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601c17a306c49b984b76901575676c7" candidate_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4460caf5b043be8387a6498fb05703" is_pre_election: true
I20260812 08:02:41.367517 23898 raft_consensus.cc:2468] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adff8ca501be4c8c9b2e1e58ffad98a8 in term 0.
I20260812 08:02:41.367532 24471 raft_consensus.cc:2468] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adff8ca501be4c8c9b2e1e58ffad98a8 in term 0.
I20260812 08:02:41.367941 24049 leader_election.cc:304] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac4460caf5b043be8387a6498fb05703, adff8ca501be4c8c9b2e1e58ffad98a8; no voters: 
I20260812 08:02:41.368176 24653 raft_consensus.cc:2804] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:41.368244 24653 raft_consensus.cc:493] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:41.368273 24653 raft_consensus.cc:3060] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.369094 24653 raft_consensus.cc:515] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.369419 24653 leader_election.cc:290] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [CANDIDATE]: Term 1 election: Requested vote from peers 43319670b55d4c0d87e125571c122986 (127.22.169.65:43339), ac4460caf5b043be8387a6498fb05703 (127.22.169.67:44377)
I20260812 08:02:41.369721 23898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601c17a306c49b984b76901575676c7" candidate_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43319670b55d4c0d87e125571c122986"
I20260812 08:02:41.369767 24471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7601c17a306c49b984b76901575676c7" candidate_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4460caf5b043be8387a6498fb05703"
I20260812 08:02:41.369839 23898 raft_consensus.cc:3060] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.369920 24471 raft_consensus.cc:3060] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.370939 24471 raft_consensus.cc:2468] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adff8ca501be4c8c9b2e1e58ffad98a8 in term 1.
I20260812 08:02:41.370939 23898 raft_consensus.cc:2468] T 7601c17a306c49b984b76901575676c7 P 43319670b55d4c0d87e125571c122986 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adff8ca501be4c8c9b2e1e58ffad98a8 in term 1.
I20260812 08:02:41.371204 24049 leader_election.cc:304] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac4460caf5b043be8387a6498fb05703, adff8ca501be4c8c9b2e1e58ffad98a8; no voters: 
I20260812 08:02:41.371403 24653 raft_consensus.cc:2804] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:41.371585 24653 raft_consensus.cc:697] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [term 1 LEADER]: Becoming Leader. State: Replica: adff8ca501be4c8c9b2e1e58ffad98a8, State: Running, Role: LEADER
I20260812 08:02:41.371883 24653 consensus_queue.cc:237] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } }
I20260812 08:02:41.375155 23270 catalog_manager.cc:5719] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to adff8ca501be4c8c9b2e1e58ffad98a8 (127.22.169.66). New cstate: current_term: 1 leader_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adff8ca501be4c8c9b2e1e58ffad98a8" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 41957 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:41.488844 24001 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:41.657117 24290 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:41.818176 24562 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:41.850169 24653 consensus_queue.cc:1048] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4460caf5b043be8387a6498fb05703" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 44377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:41.855698 24653 consensus_queue.cc:1048] T 7601c17a306c49b984b76901575676c7 P adff8ca501be4c8c9b2e1e58ffad98a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43319670b55d4c0d87e125571c122986" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:42.224330 23248 leader_election.cc:336] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.657s (SENT)
I20260812 08:02:42.262372 24692 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86709aa6ff854e12aaf2aa8fa234327b)
I20260812 08:02:42.262547 24692 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:42.263043 24692 leader_election.cc:290] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639)
I20260812 08:02:42.263509 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b" is_pre_election: true
I20260812 08:02:42.490227 24001 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:42.659025 24290 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:42.819658 24562 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
W20260812 08:02:42.886920 23248 leader_election.cc:336] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.987s (SENT)
W20260812 08:02:43.437160 23514 leader_election.cc:336] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.586s (SENT)
I20260812 08:02:43.437266 23514 leader_election.cc:304] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5; no voters: 86709aa6ff854e12aaf2aa8fa234327b, c33584259c8544a2bb2b4bf97621c84e
I20260812 08:02:43.437577 24702 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:02:43.871363 24290 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:43.991694 24001 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:44.321601 24562 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:44.667301 24705 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86709aa6ff854e12aaf2aa8fa234327b)
I20260812 08:02:44.667428 24705 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:44.667906 24705 leader_election.cc:290] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639)
I20260812 08:02:44.668355 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b" is_pre_election: true
W20260812 08:02:45.247094 23514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.578s (SENT) [suppressed 2 similar messages]
I20260812 08:02:45.372570 24290 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:45.493441 24001 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:45.823115 24562 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
W20260812 08:02:45.826774 23514 leader_election.cc:336] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.578s (SENT)
I20260812 08:02:45.826870 23514 leader_election.cc:304] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5; no voters: 86709aa6ff854e12aaf2aa8fa234327b, c33584259c8544a2bb2b4bf97621c84e
I20260812 08:02:45.827203 24712 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:02:46.543607 24714 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86709aa6ff854e12aaf2aa8fa234327b)
I20260812 08:02:46.543745 24714 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:46.544209 24714 leader_election.cc:290] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639)
I20260812 08:02:46.544668 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b" is_pre_election: true
I20260812 08:02:46.874451 24290 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:46.995184 24001 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:47.324548 24562 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
W20260812 08:02:47.861207 23514 leader_election.cc:336] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639): Timed out: RequestConsensusVote RPC to 127.22.169.125:46639 timed out after 0.657s (SENT)
I20260812 08:02:47.861318 23514 leader_election.cc:304] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5; no voters: 86709aa6ff854e12aaf2aa8fa234327b, c33584259c8544a2bb2b4bf97621c84e
I20260812 08:02:47.861675 24720 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:02:48.376585 24290 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:48.496855 24001 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
I20260812 08:02:48.577013 24722 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86709aa6ff854e12aaf2aa8fa234327b)
I20260812 08:02:48.577145 24722 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:48.577569 24722 leader_election.cc:290] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86709aa6ff854e12aaf2aa8fa234327b (127.22.169.126:39305), c33584259c8544a2bb2b4bf97621c84e (127.22.169.125:46639)
I20260812 08:02:48.578047 23290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "86709aa6ff854e12aaf2aa8fa234327b" is_pre_election: true
I20260812 08:02:48.825747 24562 heartbeater.cc:499] Master 127.22.169.125:46639 was elected leader, sending a full tablet report...
W20260812 08:02:48.860734 24575 master_proxy_rpc.cc:203] Re-attempting IsCreateTableDone request to leader Master (127.22.169.125:46639)
I20260812 08:02:48.879271 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 23720
I20260812 08:02:48.884478 23560 raft_consensus.cc:1217] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6]   Dedup: 1.6->[]
I20260812 08:02:48.884657 23560 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Rejecting Update request from peer c33584259c8544a2bb2b4bf97621c84e for earlier term 1. Current term is 3. Ops: [1.6-1.6]
I20260812 08:02:48.885250 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.885473 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e"
I20260812 08:02:48.885624 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e"
I20260812 08:02:48.885720 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.885807 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.885914 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.886019 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 3 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.886108 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 3 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.886195 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 3 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e"
I20260812 08:02:48.886281 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86709aa6ff854e12aaf2aa8fa234327b" candidate_term: 3 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e"
I20260812 08:02:48.886580 23406 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:48.886642 23406 raft_consensus.cc:740] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c33584259c8544a2bb2b4bf97621c84e, State: Running, Role: LEADER
I20260812 08:02:48.886783 23406 consensus_queue.cc:260] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.6, Last appended by leader: 6, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } }
I20260812 08:02:48.886924 23406 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 1 FOLLOWER]: Advancing to term 3
I20260812 08:02:48.887943 23406 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Refusing update from remote peer 86709aa6ff854e12aaf2aa8fa234327b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 3 index: 7. (index mismatch)
I20260812 08:02:48.888254 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.888394 23407 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 in term 3.
I20260812 08:02:48.888599 23411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.888700 23411 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 in term 3.
I20260812 08:02:48.888903 23413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.889004 23413 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 in term 3.
I20260812 08:02:48.889182 23415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.889281 23415 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 in term 3.
I20260812 08:02:48.889461 23416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.889570 23416 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 in term 3.
I20260812 08:02:48.889747 23418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.889858 23418 raft_consensus.cc:2368] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 for earlier term 2. Current term is 3.
I20260812 08:02:48.893672 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e"
I20260812 08:02:48.893790 23419 raft_consensus.cc:2368] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 for earlier term 2. Current term is 3.
I20260812 08:02:48.893986 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e"
I20260812 08:02:48.894073 23422 raft_consensus.cc:2368] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 for earlier term 2. Current term is 3.
I20260812 08:02:48.894196 23425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c33584259c8544a2bb2b4bf97621c84e" is_pre_election: true
I20260812 08:02:48.894279 23425 raft_consensus.cc:2368] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1663f9c31e4c4be4bb6c2a6b41f478a5 for earlier term 2. Current term is 3.
I20260812 08:02:48.897980 23290 raft_consensus.cc:1217] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 3 LEADER]: Deduplicated request from leader. Original: 1.5->[1.6-1.6]   Dedup: 1.6->[]
I20260812 08:02:48.898126 23290 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [term 3 LEADER]: Rejecting Update request from peer c33584259c8544a2bb2b4bf97621c84e for earlier term 1. Current term is 3. Ops: [1.6-1.6]
I20260812 08:02:48.900871 23514 leader_election.cc:304] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1663f9c31e4c4be4bb6c2a6b41f478a5; no voters: 86709aa6ff854e12aaf2aa8fa234327b, c33584259c8544a2bb2b4bf97621c84e
I20260812 08:02:48.901070 24722 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1663f9c31e4c4be4bb6c2a6b41f478a5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:02:48.902107 24724 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 08:02:48.902232 24724 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 86709aa6ff854e12aaf2aa8fa234327b [LEADER]: Peer c33584259c8544a2bb2b4bf97621c84e log is divergent from this leader: its last log entry 1.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260812 08:02:48.903081 23425 pending_rounds.cc:85] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e: Aborting all ops after (but not including) 5
I20260812 08:02:48.903159 23425 pending_rounds.cc:107] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e: Aborting uncommitted WRITE_OP operation due to leader change: 1.6
E20260812 08:02:48.903506 23695 catalog_manager.cc:826] Error processing pending assignments: Aborted: error persisting updated tablet metadata: Op aborted by new leader
I20260812 08:02:48.904568 24589 sys_catalog.cc:455] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86709aa6ff854e12aaf2aa8fa234327b. Latest consensus state: current_term: 3 leader_uuid: "86709aa6ff854e12aaf2aa8fa234327b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:48.904659 24589 sys_catalog.cc:458] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:48.904733 24589 sys_catalog.cc:455] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "86709aa6ff854e12aaf2aa8fa234327b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86709aa6ff854e12aaf2aa8fa234327b" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 39305 } } peers { permanent_uuid: "c33584259c8544a2bb2b4bf97621c84e" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 46639 } } peers { permanent_uuid: "1663f9c31e4c4be4bb6c2a6b41f478a5" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 35721 } } }
I20260812 08:02:48.904788 24589 sys_catalog.cc:458] T 00000000000000000000000000000000 P c33584259c8544a2bb2b4bf97621c84e [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:48.915045 23377 connection.cc:573] server connection from 127.22.169.65:58237 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:48.915766 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 24020
I20260812 08:02:48.948144 24431 tablet_service.cc:1558] Processing DeleteTablet for tablet 7601c17a306c49b984b76901575676c7 with delete_type TABLET_DATA_TOMBSTONED (Replica has no consensus available (current committed config index is 0)) from {username='slave'} at 127.0.0.1:57198
I20260812 08:02:48.948644 24748 tablet_replica.cc:333] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: stopping tablet replica
I20260812 08:02:48.948954 24748 raft_consensus.cc:2243] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:48.949244 24748 raft_consensus.cc:2272] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:48.950379 24748 ts_tablet_manager.cc:1916] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260812 08:02:48.952099 23373 connection.cc:573] client connection to 127.22.169.66:41957 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:48.952179 23373 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 2 similar messages]
I20260812 08:02:48.952724 24748 ts_tablet_manager.cc:1929] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:48.952840 24748 log.cc:1199] T 7601c17a306c49b984b76901575676c7 P ac4460caf5b043be8387a6498fb05703: Deleting WAL directory at /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/wals/7601c17a306c49b984b76901575676c7
W20260812 08:02:48.953025 23373 catalog_manager.cc:4777] TS adff8ca501be4c8c9b2e1e58ffad98a8 (127.22.169.66:41957): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7601c17a306c49b984b76901575676c7: Network error: Client connection negotiation failed: client connection to 127.22.169.66:41957: connect: Connection refused (error 111)
I20260812 08:02:48.953060 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 24301
I20260812 08:02:48.977506 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 23218
I20260812 08:02:48.988987 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 23347
I20260812 08:02:49.001106 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 23473
2026-08-12T08:02:49Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestPauseAfterCreateTableIssued/0 (11477 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestRenameTableSync/0
2026-08-12T08:02:49Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:49Z Disabled control of system clock
I20260812 08:02:49.036577 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:40335
--webserver_interface=127.22.169.126
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:38869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:02:49.133759 24755 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:49.133957 24755 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:49.133996 24755 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:49.137081 24755 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:49.137126 24755 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:49.137144 24755 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:49.137164 24755 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:49.140727 24755 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:38869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:40335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.169.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.24755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:49.141552 24755 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:49.142514 24755 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:49.147330 24767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:49.147351 24770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:49.147379 24776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:49.147538 24755 server_base.cc:1061] running on GCE node
I20260812 08:02:49.148094 24755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:49.148878 24755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:49.150014 24755 hybrid_clock.cc:648] HybridClock initialized: now 1786521769150001 us; error 29 us; skew 500 ppm
I20260812 08:02:49.151495 24755 webserver.cc:533] Webserver started at http://127.22.169.126:46831/ using document root <none> and password file <none>
I20260812 08:02:49.151988 24755 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:49.152045 24755 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:49.152210 24755 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:49.153586 24755 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/data/instance:
uuid: "ae9ca593d2cf4016abe9e61d29a445a7"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.154040 24755 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/wal/instance:
uuid: "ae9ca593d2cf4016abe9e61d29a445a7"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.156967 24755 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:49.158924 24784 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:49.159773 24755 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:49.159893 24755 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/wal
uuid: "ae9ca593d2cf4016abe9e61d29a445a7"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.159968 24755 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:49.173852 24755 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:49.174381 24755 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:49.174538 24755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:49.180953 24755 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.126:40335
I20260812 08:02:49.180958 24888 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.126:40335 every 8 connection(s)
I20260812 08:02:49.181821 24755 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:49.184417 24889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:49.187445 24889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:49.190342 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 24755
I20260812 08:02:49.190449 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-0/wal/instance
I20260812 08:02:49.191150 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:45717
--webserver_interface=127.22.169.125
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:38869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:02:49.196213 24889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:49.196858 24792 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.169.125:45717: connect: Connection refused (error 111)
W20260812 08:02:49.197613 24889 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:45717: Network error: Client connection negotiation failed: client connection to 127.22.169.125:45717: connect: Connection refused (error 111)
I20260812 08:02:49.246819 24889 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } attempt: 1
W20260812 08:02:49.248248 24889 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:45717: Network error: Client connection negotiation failed: client connection to 127.22.169.125:45717: connect: Connection refused (error 111)
W20260812 08:02:49.291549 24895 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:49.291723 24895 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:49.291776 24895 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:49.294914 24895 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:49.294965 24895 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:49.294991 24895 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:49.295014 24895 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:49.298681 24895 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:38869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:45717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.169.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.24895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:49.299532 24895 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:49.300498 24895 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:49.305087 24918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:49.305085 24912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:49.305073 24911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:49.305517 24895 server_base.cc:1061] running on GCE node
I20260812 08:02:49.305977 24895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:49.306769 24895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:49.307929 24895 hybrid_clock.cc:648] HybridClock initialized: now 1786521769307912 us; error 27 us; skew 500 ppm
I20260812 08:02:49.309494 24895 webserver.cc:533] Webserver started at http://127.22.169.125:33667/ using document root <none> and password file <none>
I20260812 08:02:49.310019 24895 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:49.310078 24895 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:49.310256 24895 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:49.311592 24895 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/data/instance:
uuid: "3eb08e3c3e6549f8972fd86af3c059f6"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.311996 24895 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/wal/instance:
uuid: "3eb08e3c3e6549f8972fd86af3c059f6"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.314939 24895 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:49.316398 24889 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } attempt: 2
I20260812 08:02:49.316815 24926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260812 08:02:49.317641 24889 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:45717: Network error: Client connection negotiation failed: client connection to 127.22.169.125:45717: connect: Connection refused (error 111)
I20260812 08:02:49.317948 24895 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:49.318053 24895 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/wal
uuid: "3eb08e3c3e6549f8972fd86af3c059f6"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.318137 24895 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:49.331023 24895 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:49.331545 24895 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:49.331693 24895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:49.338171 24895 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.125:45717
I20260812 08:02:49.338168 25038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.125:45717 every 8 connection(s)
I20260812 08:02:49.339052 24895 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
I20260812 08:02:49.341674 25041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:49.344808 25041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:49.347293 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 24895
I20260812 08:02:49.347419 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-1/wal/instance
I20260812 08:02:49.347990 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:41197
--webserver_interface=127.22.169.124
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:38869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:02:49.352632 25041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:49.358122 25041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:49.358763 24932 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.169.124:41197: connect: Connection refused (error 111)
W20260812 08:02:49.360613 25041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:41197: Network error: Client connection negotiation failed: client connection to 127.22.169.124:41197: connect: Connection refused (error 111)
I20260812 08:02:49.408792 24889 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } attempt: 3
I20260812 08:02:49.410127 25041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } attempt: 1
W20260812 08:02:49.413148 25041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:41197: Network error: Client connection negotiation failed: client connection to 127.22.169.124:41197: connect: Connection refused (error 111)
I20260812 08:02:49.414078 24889 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:49.415191 24889 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:41197: Network error: Client connection negotiation failed: client connection to 127.22.169.124:41197: connect: Connection refused (error 111)
I20260812 08:02:49.446352 24889 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } attempt: 1
W20260812 08:02:49.447598 24889 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:41197: Network error: Client connection negotiation failed: client connection to 127.22.169.124:41197: connect: Connection refused (error 111)
W20260812 08:02:49.452184 25046 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:49.452350 25046 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:49.452409 25046 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:49.455672 25046 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:49.455720 25046 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:49.455751 25046 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:49.455785 25046 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:49.459442 25046 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:38869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:41197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.169.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.25046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:49.460408 25046 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:49.461506 25046 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:49.466578 25064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:49.466603 25067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:49.466575 25061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:49.466958 25046 server_base.cc:1061] running on GCE node
I20260812 08:02:49.467387 25046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:49.468165 25046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:49.469319 25046 hybrid_clock.cc:648] HybridClock initialized: now 1786521769469307 us; error 26 us; skew 500 ppm
I20260812 08:02:49.470916 25046 webserver.cc:533] Webserver started at http://127.22.169.124:33653/ using document root <none> and password file <none>
I20260812 08:02:49.471410 25046 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:49.471467 25046 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:49.471619 25046 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:49.473034 25046 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/data/instance:
uuid: "722e472e30714999b0d21f40b6335351"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.473446 25046 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/wal/instance:
uuid: "722e472e30714999b0d21f40b6335351"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.476498 25046 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260812 08:02:49.478380 25074 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:49.479261 25046 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:49.479369 25046 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/wal
uuid: "722e472e30714999b0d21f40b6335351"
format_stamp: "Formatted at 2026-08-12 08:02:49 on dist-test-slave-tc2s"
I20260812 08:02:49.479461 25046 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:49.481325 25041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } attempt: 2
W20260812 08:02:49.482715 25041 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:41197: Network error: Client connection negotiation failed: client connection to 127.22.169.124:41197: connect: Connection refused (error 111)
I20260812 08:02:49.498356 25046 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:49.498874 25046 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:49.499038 25046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:49.505741 25189 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.124:41197 every 8 connection(s)
I20260812 08:02:49.505750 25046 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.124:41197
I20260812 08:02:49.506677 25046 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
I20260812 08:02:49.509320 25190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:49.512414 25190 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:49.513588 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 25046
I20260812 08:02:49.513688 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/master-2/wal/instance
I20260812 08:02:49.520140 25190 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:49.522759 24889 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } attempt: 2
I20260812 08:02:49.525914 25190 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:49.529310 24889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: Bootstrap starting.
I20260812 08:02:49.531155 25190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351: Bootstrap starting.
I20260812 08:02:49.531556 24889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:49.532392 24889 log.cc:826] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:49.532884 25190 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:49.533519 25190 log.cc:826] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:49.534068 24889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: No bootstrap required, opened a new log
I20260812 08:02:49.535087 25190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351: No bootstrap required, opened a new log
I20260812 08:02:49.536456 24889 raft_consensus.cc:359] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.536597 24889 raft_consensus.cc:385] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:49.536651 24889 raft_consensus.cc:740] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae9ca593d2cf4016abe9e61d29a445a7, State: Initialized, Role: FOLLOWER
I20260812 08:02:49.537026 24889 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.537432 25204 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.537436 25190 raft_consensus.cc:359] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.537546 25204 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:49.537580 25190 raft_consensus.cc:385] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:49.537634 25190 raft_consensus.cc:740] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 722e472e30714999b0d21f40b6335351, State: Initialized, Role: FOLLOWER
I20260812 08:02:49.538009 25190 consensus_queue.cc:260] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.538110 24889 sys_catalog.cc:565] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:49.538414 25205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.538534 25205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:49.538882 25190 sys_catalog.cc:565] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:02:49.542819 25235 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:49.542951 25235 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 08:02:49.545341 25247 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:49.545460 25247 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:02:49.543510 24755 master_runner.cc:187] Error getting master registration for 127.22.169.125:45717: OK, instance_id { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" instance_seqno: 1786521769336412 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:02:49.545647 24755 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:49.547309 25046 master_runner.cc:187] Error getting master registration for 127.22.169.125:45717: OK, instance_id { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" instance_seqno: 1786521769336412 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:02:49.548887 25046 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:49.573869 25041 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } attempt: 3
I20260812 08:02:49.580013 25041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: Bootstrap starting.
I20260812 08:02:49.582226 25041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:49.583145 25041 log.cc:826] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:49.584707 25041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: No bootstrap required, opened a new log
I20260812 08:02:49.587118 25041 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.587260 25041 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:49.587334 25041 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb08e3c3e6549f8972fd86af3c059f6, State: Initialized, Role: FOLLOWER
I20260812 08:02:49.587736 25041 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.588169 25250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.588326 25250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:49.589813 25041 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:02:49.594357 25275 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:49.594486 25275 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:02:49.596948 24895 master_runner.cc:264] No leader master found from master 3eb08e3c3e6549f8972fd86af3c059f6
I20260812 08:02:49.597009 24895 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:02:49.675763 24799 tablet.cc:2406] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:49.750043 25086 tablet.cc:2406] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:49.827216 25205 raft_consensus.cc:493] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:49.827438 25205 raft_consensus.cc:515] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.828584 25205 leader_election.cc:290] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae9ca593d2cf4016abe9e61d29a445a7 (127.22.169.126:40335), 3eb08e3c3e6549f8972fd86af3c059f6 (127.22.169.125:45717)
I20260812 08:02:49.829037 24833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "722e472e30714999b0d21f40b6335351" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" is_pre_election: true
I20260812 08:02:49.829116 24988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "722e472e30714999b0d21f40b6335351" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" is_pre_election: true
I20260812 08:02:49.829337 24833 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722e472e30714999b0d21f40b6335351 in term 0.
I20260812 08:02:49.829347 24988 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 722e472e30714999b0d21f40b6335351 in term 0.
I20260812 08:02:49.829737 25081 leader_election.cc:304] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 722e472e30714999b0d21f40b6335351, ae9ca593d2cf4016abe9e61d29a445a7; no voters: 
I20260812 08:02:49.829967 25205 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:49.830053 25205 raft_consensus.cc:493] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:49.830096 25205 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:49.831278 25205 raft_consensus.cc:515] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.831657 25205 leader_election.cc:290] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [CANDIDATE]: Term 1 election: Requested vote from peers ae9ca593d2cf4016abe9e61d29a445a7 (127.22.169.126:40335), 3eb08e3c3e6549f8972fd86af3c059f6 (127.22.169.125:45717)
I20260812 08:02:49.831993 24988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "722e472e30714999b0d21f40b6335351" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eb08e3c3e6549f8972fd86af3c059f6"
I20260812 08:02:49.832049 24833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "722e472e30714999b0d21f40b6335351" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae9ca593d2cf4016abe9e61d29a445a7"
I20260812 08:02:49.832113 24988 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:49.832140 24833 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 08:02:49.832901 24939 tablet.cc:2406] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:49.833178 24833 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722e472e30714999b0d21f40b6335351 in term 1.
I20260812 08:02:49.833178 24988 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 722e472e30714999b0d21f40b6335351 in term 1.
I20260812 08:02:49.833493 25081 leader_election.cc:304] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 722e472e30714999b0d21f40b6335351, ae9ca593d2cf4016abe9e61d29a445a7; no voters: 
I20260812 08:02:49.833676 25205 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:49.833945 25205 raft_consensus.cc:697] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 1 LEADER]: Becoming Leader. State: Replica: 722e472e30714999b0d21f40b6335351, State: Running, Role: LEADER
I20260812 08:02:49.834293 25205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:49.836155 25278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 722e472e30714999b0d21f40b6335351. Latest consensus state: current_term: 1 leader_uuid: "722e472e30714999b0d21f40b6335351" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.836269 25278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:49.836638 25281 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:49.837514 25281 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:49.842078 24833 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 1 FOLLOWER]: Refusing update from remote peer 722e472e30714999b0d21f40b6335351: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:49.842079 24988 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Refusing update from remote peer 722e472e30714999b0d21f40b6335351: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:49.842628 25278 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:49.843806 25278 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:49.846174 25250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 722e472e30714999b0d21f40b6335351. Latest consensus state: current_term: 1 leader_uuid: "722e472e30714999b0d21f40b6335351" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.846275 25250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:49.847101 25204 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 722e472e30714999b0d21f40b6335351. Latest consensus state: current_term: 1 leader_uuid: "722e472e30714999b0d21f40b6335351" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.847198 25204 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:49.848136 25205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "722e472e30714999b0d21f40b6335351" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.848230 25205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:49.848640 25250 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "722e472e30714999b0d21f40b6335351" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.848729 25250 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:49.848924 25287 mvcc.cc:204] Tried to move back new op lower bound from 7317593169267011584 to 7317593169243754496. Current Snapshot: MvccSnapshot[applied={T|T < 7317593169267011584}]
I20260812 08:02:49.849941 25281 catalog_manager.cc:1383] Generated new cluster ID: 65149d8acebc4638bfeafc3c492f6f00
I20260812 08:02:49.850001 25281 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:49.850036 25278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "722e472e30714999b0d21f40b6335351" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.850106 25278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:49.850972 25204 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "722e472e30714999b0d21f40b6335351" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:49.851066 25204 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:49.874766 25281 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:49.875768 25281 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:49.883438 25281 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351: Generated new TSK 0
I20260812 08:02:49.884038 25281 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:49.899762 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.65:0
--local_ip_for_outbound_sockets=127.22.169.65
--webserver_interface=127.22.169.65
--webserver_port=0
--tserver_master_addrs=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--builtin_ntp_servers=127.22.169.84:38869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:02:50.000877 25300 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:50.001114 25300 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:50.001180 25300 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:50.004357 25300 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:50.004477 25300 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.65
I20260812 08:02:50.008077 25300 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:38869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.169.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--never_fsync=true
--heap_profile_path=/tmp/kudu.25300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:50.008965 25300 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:50.009979 25300 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:50.015792 25311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.015798 25308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.015803 25309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:50.016099 25300 server_base.cc:1061] running on GCE node
I20260812 08:02:50.016414 25300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:50.016903 25300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:50.018049 25300 hybrid_clock.cc:648] HybridClock initialized: now 1786521770018036 us; error 26 us; skew 500 ppm
I20260812 08:02:50.019510 25300 webserver.cc:533] Webserver started at http://127.22.169.65:46853/ using document root <none> and password file <none>
I20260812 08:02:50.020006 25300 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:50.020058 25300 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:50.020241 25300 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:50.021672 25300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/data/instance:
uuid: "7ed0b3cbef154f179873b992f4eefe84"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.022118 25300 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/wal/instance:
uuid: "7ed0b3cbef154f179873b992f4eefe84"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.025151 25300 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20260812 08:02:50.027220 25320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.028093 25300 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:50.028185 25300 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
uuid: "7ed0b3cbef154f179873b992f4eefe84"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.028267 25300 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:50.039317 25300 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:50.039852 25300 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:50.039992 25300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:50.040547 25300 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:50.041483 25300 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:50.041529 25300 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.041563 25300 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:50.041584 25300 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.049757 25300 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.65:46553
I20260812 08:02:50.049782 25548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.65:46553 every 8 connection(s)
I20260812 08:02:50.050599 25300 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:50.055411 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 25300
I20260812 08:02:50.055513 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:50.058108 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.66:0
--local_ip_for_outbound_sockets=127.22.169.66
--webserver_interface=127.22.169.66
--webserver_port=0
--tserver_master_addrs=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--builtin_ntp_servers=127.22.169.84:38869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:02:50.059924 25553 heartbeater.cc:344] Connected to a master server at 127.22.169.125:45717
I20260812 08:02:50.060098 25549 heartbeater.cc:344] Connected to a master server at 127.22.169.124:41197
I20260812 08:02:50.060149 25553 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.060176 25549 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.060591 25549 heartbeater.cc:507] Master 127.22.169.124:41197 requested a full tablet report, sending...
I20260812 08:02:50.060591 25553 heartbeater.cc:507] Master 127.22.169.125:45717 requested a full tablet report, sending...
I20260812 08:02:50.061388 25551 heartbeater.cc:344] Connected to a master server at 127.22.169.126:40335
I20260812 08:02:50.061476 25551 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.061631 25551 heartbeater.cc:507] Master 127.22.169.126:40335 requested a full tablet report, sending...
I20260812 08:02:50.062538 24817 ts_manager.cc:194] Registered new tserver with Master: 7ed0b3cbef154f179873b992f4eefe84 (127.22.169.65:46553)
I20260812 08:02:50.062549 24964 ts_manager.cc:194] Registered new tserver with Master: 7ed0b3cbef154f179873b992f4eefe84 (127.22.169.65:46553)
I20260812 08:02:50.063176 25115 ts_manager.cc:194] Registered new tserver with Master: 7ed0b3cbef154f179873b992f4eefe84 (127.22.169.65:46553)
I20260812 08:02:50.064666 25115 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.65:36589
W20260812 08:02:50.158710 25563 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:50.158878 25563 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:50.158943 25563 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:50.162073 25563 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:50.162187 25563 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.66
I20260812 08:02:50.165782 25563 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:38869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.169.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--never_fsync=true
--heap_profile_path=/tmp/kudu.25563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:50.166663 25563 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:50.167614 25563 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:50.173318 25575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.173321 25579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.173413 25571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:50.173550 25563 server_base.cc:1061] running on GCE node
I20260812 08:02:50.173821 25563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:50.174316 25563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:50.175477 25563 hybrid_clock.cc:648] HybridClock initialized: now 1786521770175445 us; error 33 us; skew 500 ppm
I20260812 08:02:50.176993 25563 webserver.cc:533] Webserver started at http://127.22.169.66:42409/ using document root <none> and password file <none>
I20260812 08:02:50.177487 25563 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:50.177544 25563 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:50.177711 25563 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:50.179095 25563 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/data/instance:
uuid: "211748574d8d4d869720dfc7b1932353"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.179515 25563 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/wal/instance:
uuid: "211748574d8d4d869720dfc7b1932353"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.182659 25563 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260812 08:02:50.184664 25587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.185570 25563 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:50.185668 25563 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
uuid: "211748574d8d4d869720dfc7b1932353"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.185741 25563 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:50.199213 25563 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:50.199712 25563 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:50.199860 25563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:50.200340 25563 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:50.201236 25563 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:50.201283 25563 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.201332 25563 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:50.201359 25563 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.222033 25563 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.66:39259
I20260812 08:02:50.222157 25802 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.66:39259 every 8 connection(s)
I20260812 08:02:50.223187 25563 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:50.224360 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 25563
I20260812 08:02:50.224459 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:50.228228 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.67:0
--local_ip_for_outbound_sockets=127.22.169.67
--webserver_interface=127.22.169.67
--webserver_port=0
--tserver_master_addrs=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--builtin_ntp_servers=127.22.169.84:38869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:02:50.236093 25803 heartbeater.cc:344] Connected to a master server at 127.22.169.124:41197
I20260812 08:02:50.236204 25805 heartbeater.cc:344] Connected to a master server at 127.22.169.126:40335
I20260812 08:02:50.236334 25803 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.236333 25805 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.236884 25803 heartbeater.cc:507] Master 127.22.169.124:41197 requested a full tablet report, sending...
I20260812 08:02:50.236908 25807 heartbeater.cc:344] Connected to a master server at 127.22.169.125:45717
I20260812 08:02:50.236886 25805 heartbeater.cc:507] Master 127.22.169.126:40335 requested a full tablet report, sending...
I20260812 08:02:50.237023 25807 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.237171 25807 heartbeater.cc:507] Master 127.22.169.125:45717 requested a full tablet report, sending...
I20260812 08:02:50.238000 24964 ts_manager.cc:194] Registered new tserver with Master: 211748574d8d4d869720dfc7b1932353 (127.22.169.66:39259)
I20260812 08:02:50.238050 25115 ts_manager.cc:194] Registered new tserver with Master: 211748574d8d4d869720dfc7b1932353 (127.22.169.66:39259)
I20260812 08:02:50.238248 24817 ts_manager.cc:194] Registered new tserver with Master: 211748574d8d4d869720dfc7b1932353 (127.22.169.66:39259)
I20260812 08:02:50.238730 25115 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.66:37759
W20260812 08:02:50.339900 25817 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:50.340094 25817 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:50.340148 25817 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:50.343365 25817 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:50.343477 25817 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.67
I20260812 08:02:50.347086 25817 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:38869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.169.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:40335,127.22.169.125:45717,127.22.169.124:41197
--never_fsync=true
--heap_profile_path=/tmp/kudu.25817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:50.347957 25817 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:50.348928 25817 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:50.354650 25828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.354665 25825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.354643 25826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:50.355002 25817 server_base.cc:1061] running on GCE node
I20260812 08:02:50.355329 25817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:50.355801 25817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:50.356935 25817 hybrid_clock.cc:648] HybridClock initialized: now 1786521770356927 us; error 30 us; skew 500 ppm
I20260812 08:02:50.358729 25817 webserver.cc:533] Webserver started at http://127.22.169.67:41047/ using document root <none> and password file <none>
I20260812 08:02:50.359333 25817 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:50.359387 25817 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:50.359539 25817 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:50.360857 25817 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/data/instance:
uuid: "7a6a447332234369b798026c6132c069"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.361271 25817 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/instance:
uuid: "7a6a447332234369b798026c6132c069"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.364280 25817 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:50.366225 25836 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.367108 25817 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:50.367198 25817 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
uuid: "7a6a447332234369b798026c6132c069"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-tc2s"
I20260812 08:02:50.367288 25817 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:50.384336 25842 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 722e472e30714999b0d21f40b6335351)
I20260812 08:02:50.384460 25842 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:50.385339 25842 leader_election.cc:290] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae9ca593d2cf4016abe9e61d29a445a7 (127.22.169.126:40335), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:50.385813 24833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" is_pre_election: true
I20260812 08:02:50.385877 25136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:02:50.386365 24932 leader_election.cc:304] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eb08e3c3e6549f8972fd86af3c059f6; no voters: 722e472e30714999b0d21f40b6335351, ae9ca593d2cf4016abe9e61d29a445a7
I20260812 08:02:50.386585 25842 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:50.390801 25817 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:50.391355 25817 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:50.391487 25817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:50.391959 25817 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:50.392887 25817 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:50.392935 25817 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.392969 25817 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:50.392995 25817 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.401638 25817 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.67:43455
I20260812 08:02:50.401696 26054 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.67:43455 every 8 connection(s)
I20260812 08:02:50.402503 25817 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:50.405388 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 25817
I20260812 08:02:50.405509 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:50.411425 26058 heartbeater.cc:344] Connected to a master server at 127.22.169.125:45717
I20260812 08:02:50.411526 26055 heartbeater.cc:344] Connected to a master server at 127.22.169.124:41197
I20260812 08:02:50.411633 26055 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.411635 26058 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.412107 26057 heartbeater.cc:344] Connected to a master server at 127.22.169.126:40335
I20260812 08:02:50.412081 26055 heartbeater.cc:507] Master 127.22.169.124:41197 requested a full tablet report, sending...
I20260812 08:02:50.412220 26057 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.412081 26058 heartbeater.cc:507] Master 127.22.169.125:45717 requested a full tablet report, sending...
I20260812 08:02:50.412379 26057 heartbeater.cc:507] Master 127.22.169.126:40335 requested a full tablet report, sending...
I20260812 08:02:50.413146 24964 ts_manager.cc:194] Registered new tserver with Master: 7a6a447332234369b798026c6132c069 (127.22.169.67:43455)
I20260812 08:02:50.413184 24817 ts_manager.cc:194] Registered new tserver with Master: 7a6a447332234369b798026c6132c069 (127.22.169.67:43455)
I20260812 08:02:50.413184 25115 ts_manager.cc:194] Registered new tserver with Master: 7a6a447332234369b798026c6132c069 (127.22.169.67:43455)
I20260812 08:02:50.413695 25115 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.67:46793
I20260812 08:02:50.424836 23205 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:50.433173 25115 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56634:
name: "default.test_alter_table_sync"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:50.434231 25115 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_alter_table_sync in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:50.451965 25416 tablet_service.cc:1511] Processing CreateTablet for tablet 8047b062c9be45b1bc4bff502da18d1a (DEFAULT_TABLE table=default.test_alter_table_sync [id=79e270e2dc774da9bab82a2613842545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:50.452991 25416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8047b062c9be45b1bc4bff502da18d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:50.453128 25683 tablet_service.cc:1511] Processing CreateTablet for tablet 8047b062c9be45b1bc4bff502da18d1a (DEFAULT_TABLE table=default.test_alter_table_sync [id=79e270e2dc774da9bab82a2613842545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:50.453097 25940 tablet_service.cc:1511] Processing CreateTablet for tablet 8047b062c9be45b1bc4bff502da18d1a (DEFAULT_TABLE table=default.test_alter_table_sync [id=79e270e2dc774da9bab82a2613842545]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:50.453830 25683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8047b062c9be45b1bc4bff502da18d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:50.453939 25940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8047b062c9be45b1bc4bff502da18d1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:50.458670 26099 tablet_bootstrap.cc:492] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353: Bootstrap starting.
I20260812 08:02:50.459299 26100 tablet_bootstrap.cc:492] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84: Bootstrap starting.
I20260812 08:02:50.460597 26099 tablet_bootstrap.cc:654] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:50.460898 26100 tablet_bootstrap.cc:654] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:50.461236 26099 log.cc:826] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:50.461474 26100 log.cc:826] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:50.461817 26104 tablet_bootstrap.cc:492] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069: Bootstrap starting.
I20260812 08:02:50.462844 26099 tablet_bootstrap.cc:492] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353: No bootstrap required, opened a new log
I20260812 08:02:50.462968 26100 tablet_bootstrap.cc:492] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84: No bootstrap required, opened a new log
I20260812 08:02:50.463083 26099 ts_tablet_manager.cc:1403] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.001s
I20260812 08:02:50.463153 26100 ts_tablet_manager.cc:1403] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84: Time spent bootstrapping tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:50.463852 26104 tablet_bootstrap.cc:654] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:50.464489 26104 log.cc:826] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:50.465749 26104 tablet_bootstrap.cc:492] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069: No bootstrap required, opened a new log
I20260812 08:02:50.465935 26104 ts_tablet_manager.cc:1403] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069: Time spent bootstrapping tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:50.466229 26100 raft_consensus.cc:359] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.466229 26099 raft_consensus.cc:359] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.466428 26100 raft_consensus.cc:385] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:50.466428 26099 raft_consensus.cc:385] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:50.466486 26099 raft_consensus.cc:740] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 211748574d8d4d869720dfc7b1932353, State: Initialized, Role: FOLLOWER
I20260812 08:02:50.466521 26100 raft_consensus.cc:740] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ed0b3cbef154f179873b992f4eefe84, State: Initialized, Role: FOLLOWER
I20260812 08:02:50.466985 26100 consensus_queue.cc:260] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.467059 26099 consensus_queue.cc:260] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.467626 25549 heartbeater.cc:499] Master 127.22.169.124:41197 was elected leader, sending a full tablet report...
I20260812 08:02:50.467805 26100 ts_tablet_manager.cc:1434] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:50.467854 26099 ts_tablet_manager.cc:1434] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260812 08:02:50.468181 25803 heartbeater.cc:499] Master 127.22.169.124:41197 was elected leader, sending a full tablet report...
I20260812 08:02:50.468787 26104 raft_consensus.cc:359] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.468971 26104 raft_consensus.cc:385] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:50.469077 26104 raft_consensus.cc:740] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a6a447332234369b798026c6132c069, State: Initialized, Role: FOLLOWER
I20260812 08:02:50.469558 26104 consensus_queue.cc:260] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.470280 26104 ts_tablet_manager.cc:1434] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:50.470621 26055 heartbeater.cc:499] Master 127.22.169.124:41197 was elected leader, sending a full tablet report...
W20260812 08:02:50.474941 25810 tablet.cc:2406] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:50.544163 25235 catalog_manager.cc:1295] Loaded cluster ID: 65149d8acebc4638bfeafc3c492f6f00
I20260812 08:02:50.544234 25235 catalog_manager.cc:1588] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: loading cluster ID for follower catalog manager: success
I20260812 08:02:50.545862 25235 catalog_manager.cc:1610] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: acquiring CA information for follower catalog manager: success
I20260812 08:02:50.546883 25235 catalog_manager.cc:1638] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 08:02:50.551882 25554 tablet.cc:2406] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:50.595724 25275 catalog_manager.cc:1295] Loaded cluster ID: 65149d8acebc4638bfeafc3c492f6f00
I20260812 08:02:50.595794 25275 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: loading cluster ID for follower catalog manager: success
I20260812 08:02:50.597442 25275 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: acquiring CA information for follower catalog manager: success
I20260812 08:02:50.598500 25275 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 08:02:50.654072 26059 tablet.cc:2406] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:50.712428 26114 raft_consensus.cc:493] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:50.712630 26114 raft_consensus.cc:515] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.713775 26114 leader_election.cc:290] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ed0b3cbef154f179873b992f4eefe84 (127.22.169.65:46553), 7a6a447332234369b798026c6132c069 (127.22.169.67:43455)
I20260812 08:02:50.717229 25450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8047b062c9be45b1bc4bff502da18d1a" candidate_uuid: "211748574d8d4d869720dfc7b1932353" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ed0b3cbef154f179873b992f4eefe84" is_pre_election: true
I20260812 08:02:50.717231 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8047b062c9be45b1bc4bff502da18d1a" candidate_uuid: "211748574d8d4d869720dfc7b1932353" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a6a447332234369b798026c6132c069" is_pre_election: true
I20260812 08:02:50.717483 25450 raft_consensus.cc:2468] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 211748574d8d4d869720dfc7b1932353 in term 0.
I20260812 08:02:50.717489 25972 raft_consensus.cc:2468] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 211748574d8d4d869720dfc7b1932353 in term 0.
I20260812 08:02:50.717985 25592 leader_election.cc:304] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 211748574d8d4d869720dfc7b1932353, 7ed0b3cbef154f179873b992f4eefe84; no voters: 
I20260812 08:02:50.718245 26114 raft_consensus.cc:2804] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:50.718312 26114 raft_consensus.cc:493] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:50.718345 26114 raft_consensus.cc:3060] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:50.719190 26114 raft_consensus.cc:515] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.719515 26114 leader_election.cc:290] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [CANDIDATE]: Term 1 election: Requested vote from peers 7ed0b3cbef154f179873b992f4eefe84 (127.22.169.65:46553), 7a6a447332234369b798026c6132c069 (127.22.169.67:43455)
I20260812 08:02:50.719794 25450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8047b062c9be45b1bc4bff502da18d1a" candidate_uuid: "211748574d8d4d869720dfc7b1932353" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ed0b3cbef154f179873b992f4eefe84"
I20260812 08:02:50.719858 25972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8047b062c9be45b1bc4bff502da18d1a" candidate_uuid: "211748574d8d4d869720dfc7b1932353" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a6a447332234369b798026c6132c069"
I20260812 08:02:50.719916 25450 raft_consensus.cc:3060] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:50.719959 25972 raft_consensus.cc:3060] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:50.720952 25450 raft_consensus.cc:2468] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 211748574d8d4d869720dfc7b1932353 in term 1.
I20260812 08:02:50.720952 25972 raft_consensus.cc:2468] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 211748574d8d4d869720dfc7b1932353 in term 1.
I20260812 08:02:50.721247 25590 leader_election.cc:304] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 211748574d8d4d869720dfc7b1932353, 7a6a447332234369b798026c6132c069; no voters: 
I20260812 08:02:50.721401 26114 raft_consensus.cc:2804] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:50.721578 26114 raft_consensus.cc:697] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [term 1 LEADER]: Becoming Leader. State: Replica: 211748574d8d4d869720dfc7b1932353, State: Running, Role: LEADER
I20260812 08:02:50.722082 26114 consensus_queue.cc:237] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } }
I20260812 08:02:50.725303 25113 catalog_manager.cc:5719] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 reported cstate change: term changed from 0 to 1, leader changed from <none> to 211748574d8d4d869720dfc7b1932353 (127.22.169.66). New cstate: current_term: 1 leader_uuid: "211748574d8d4d869720dfc7b1932353" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "211748574d8d4d869720dfc7b1932353" member_type: VOTER last_known_addr { host: "127.22.169.66" port: 39259 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:50.732933 23205 master_failover-itest.cc:269] Pausing leader master
I20260812 08:02:51.166596 26114 consensus_queue.cc:1048] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ed0b3cbef154f179873b992f4eefe84" member_type: VOTER last_known_addr { host: "127.22.169.65" port: 46553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:51.172369 26125 consensus_queue.cc:1048] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a6a447332234369b798026c6132c069" member_type: VOTER last_known_addr { host: "127.22.169.67" port: 43455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:51.230229 26142 raft_consensus.cc:493] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 722e472e30714999b0d21f40b6335351)
I20260812 08:02:51.230355 26142 raft_consensus.cc:515] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:51.230625 26143 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 722e472e30714999b0d21f40b6335351)
I20260812 08:02:51.230731 26143 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:51.231146 26143 leader_election.cc:290] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae9ca593d2cf4016abe9e61d29a445a7 (127.22.169.126:40335), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:51.231433 26142 leader_election.cc:290] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eb08e3c3e6549f8972fd86af3c059f6 (127.22.169.125:45717), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:51.231529 24833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" is_pre_election: true
I20260812 08:02:51.231670 24833 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eb08e3c3e6549f8972fd86af3c059f6 in term 1.
I20260812 08:02:51.231753 24988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" is_pre_election: true
I20260812 08:02:51.231871 24988 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae9ca593d2cf4016abe9e61d29a445a7 in term 1.
I20260812 08:02:51.232051 24932 leader_election.cc:304] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eb08e3c3e6549f8972fd86af3c059f6, ae9ca593d2cf4016abe9e61d29a445a7; no voters: 
I20260812 08:02:51.232224 26143 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:51.232286 26143 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 722e472e30714999b0d21f40b6335351)
I20260812 08:02:51.232332 26143 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:51.232401 24792 leader_election.cc:304] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eb08e3c3e6549f8972fd86af3c059f6, ae9ca593d2cf4016abe9e61d29a445a7; no voters: 
I20260812 08:02:51.232610 26142 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:51.232671 26142 raft_consensus.cc:493] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 722e472e30714999b0d21f40b6335351)
I20260812 08:02:51.232714 26142 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:51.233417 26143 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:51.233726 26142 raft_consensus.cc:515] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:51.233803 26143 leader_election.cc:290] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 2 election: Requested vote from peers ae9ca593d2cf4016abe9e61d29a445a7 (127.22.169.126:40335), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:51.234128 26142 leader_election.cc:290] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 2 election: Requested vote from peers 3eb08e3c3e6549f8972fd86af3c059f6 (127.22.169.125:45717), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:51.234189 24833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ae9ca593d2cf4016abe9e61d29a445a7"
I20260812 08:02:51.234324 24833 raft_consensus.cc:2393] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3eb08e3c3e6549f8972fd86af3c059f6 in current term 2: Already voted for candidate ae9ca593d2cf4016abe9e61d29a445a7 in this term.
I20260812 08:02:51.234371 24988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "3eb08e3c3e6549f8972fd86af3c059f6"
I20260812 08:02:51.234520 24988 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ae9ca593d2cf4016abe9e61d29a445a7 in current term 2: Already voted for candidate 3eb08e3c3e6549f8972fd86af3c059f6 in this term.
W20260812 08:02:51.976202 25549 heartbeater.cc:646] Failed to heartbeat to 127.22.169.124:41197 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.169.124:41197 timed out after 1.000s (SENT)
W20260812 08:02:51.977268 26055 heartbeater.cc:646] Failed to heartbeat to 127.22.169.124:41197 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.169.124:41197 timed out after 1.000s (SENT)
W20260812 08:02:52.172665 25803 heartbeater.cc:646] Failed to heartbeat to 127.22.169.124:41197 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.169.124:41197 timed out after 1.000s (SENT)
W20260812 08:02:52.241514 24932 leader_election.cc:336] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.502s (SENT)
I20260812 08:02:52.241621 24932 leader_election.cc:304] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eb08e3c3e6549f8972fd86af3c059f6; no voters: 722e472e30714999b0d21f40b6335351, ae9ca593d2cf4016abe9e61d29a445a7
I20260812 08:02:52.241967 26151 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 08:02:52.574337 24792 leader_election.cc:336] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.670s (SENT)
W20260812 08:02:52.602826 24792 leader_election.cc:336] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.683s (SENT)
I20260812 08:02:52.602922 24792 leader_election.cc:304] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae9ca593d2cf4016abe9e61d29a445a7; no voters: 3eb08e3c3e6549f8972fd86af3c059f6, 722e472e30714999b0d21f40b6335351
I20260812 08:02:52.603229 26152 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 08:02:52.651365 24932 leader_election.cc:336] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.709s (SENT)
I20260812 08:02:52.961558 26157 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:52.961686 26157 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:52.962163 26157 leader_election.cc:290] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae9ca593d2cf4016abe9e61d29a445a7 (127.22.169.126:40335), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:52.962608 24833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" is_pre_election: true
I20260812 08:02:52.962738 24833 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eb08e3c3e6549f8972fd86af3c059f6 in term 2.
I20260812 08:02:52.963063 24932 leader_election.cc:304] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eb08e3c3e6549f8972fd86af3c059f6, ae9ca593d2cf4016abe9e61d29a445a7; no voters: 
I20260812 08:02:52.963265 26157 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:02:52.963317 26157 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:52.963347 26157 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:52.964269 26157 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:52.964635 26157 leader_election.cc:290] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 3 election: Requested vote from peers ae9ca593d2cf4016abe9e61d29a445a7 (127.22.169.126:40335), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:52.964932 24833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ae9ca593d2cf4016abe9e61d29a445a7"
I20260812 08:02:52.965052 24833 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:52.965835 24833 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eb08e3c3e6549f8972fd86af3c059f6 in term 3.
I20260812 08:02:52.966133 24932 leader_election.cc:304] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eb08e3c3e6549f8972fd86af3c059f6, ae9ca593d2cf4016abe9e61d29a445a7; no voters: 
I20260812 08:02:52.966293 26157 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:02:52.966492 26157 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 3 LEADER]: Becoming Leader. State: Replica: 3eb08e3c3e6549f8972fd86af3c059f6, State: Running, Role: LEADER
I20260812 08:02:52.966789 26157 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:52.967758 26161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eb08e3c3e6549f8972fd86af3c059f6. Latest consensus state: current_term: 3 leader_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:52.967886 26161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:52.968174 26165 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:52.969512 26165 catalog_manager.cc:679] Loaded metadata for table default.test_alter_table_sync [id=79e270e2dc774da9bab82a2613842545]
I20260812 08:02:52.970463 26165 tablet_loader.cc:96] loaded metadata for tablet 8047b062c9be45b1bc4bff502da18d1a (table default.test_alter_table_sync [id=79e270e2dc774da9bab82a2613842545])
I20260812 08:02:52.970592 26165 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:52.970949 26165 catalog_manager.cc:1295] Loaded cluster ID: 65149d8acebc4638bfeafc3c492f6f00
I20260812 08:02:52.971005 26165 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:52.971525 26165 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:52.971901 26165 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: Loaded TSK: 0
I20260812 08:02:52.972455 26165 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:53.507596 24833 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Refusing update from remote peer 3eb08e3c3e6549f8972fd86af3c059f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
I20260812 08:02:53.508150 26161 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:02:53.509414 26167 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eb08e3c3e6549f8972fd86af3c059f6. Latest consensus state: current_term: 3 leader_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:53.509524 26167 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:53.510751 26171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:53.510857 26171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:53.510995 26167 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:02:53.511150 26167 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:53.679432 25553 heartbeater.cc:499] Master 127.22.169.125:45717 was elected leader, sending a full tablet report...
I20260812 08:02:53.681306 26058 heartbeater.cc:499] Master 127.22.169.125:45717 was elected leader, sending a full tablet report...
I20260812 08:02:53.782073 25807 heartbeater.cc:499] Master 127.22.169.125:45717 was elected leader, sending a full tablet report...
W20260812 08:02:54.317401 24932 leader_election.cc:336] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.675s (SENT)
I20260812 08:02:54.879922 26183 raft_consensus.cc:493] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3eb08e3c3e6549f8972fd86af3c059f6)
I20260812 08:02:54.880057 26183 raft_consensus.cc:515] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:54.880475 26183 leader_election.cc:290] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3eb08e3c3e6549f8972fd86af3c059f6 (127.22.169.125:45717), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:54.880913 24988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" is_pre_election: true
W20260812 08:02:54.914508 24932 leader_election.cc:336] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.975s (SENT)
W20260812 08:02:55.559834 24792 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.678s (SENT) [suppressed 6 similar messages]
W20260812 08:02:56.240185 24792 leader_election.cc:336] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.678s (SENT)
I20260812 08:02:56.240284 24792 leader_election.cc:304] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae9ca593d2cf4016abe9e61d29a445a7; no voters: 3eb08e3c3e6549f8972fd86af3c059f6, 722e472e30714999b0d21f40b6335351
I20260812 08:02:56.240645 26200 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:02:57.009107 26202 raft_consensus.cc:493] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3eb08e3c3e6549f8972fd86af3c059f6)
I20260812 08:02:57.009243 26202 raft_consensus.cc:515] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:57.009668 26202 leader_election.cc:290] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3eb08e3c3e6549f8972fd86af3c059f6 (127.22.169.125:45717), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:57.010139 24988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" is_pre_election: true
W20260812 08:02:58.219062 24792 leader_election.cc:336] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.603s (SENT)
I20260812 08:02:58.219166 24792 leader_election.cc:304] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae9ca593d2cf4016abe9e61d29a445a7; no voters: 3eb08e3c3e6549f8972fd86af3c059f6, 722e472e30714999b0d21f40b6335351
I20260812 08:02:58.219501 26209 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:02:59.360908 26213 raft_consensus.cc:493] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3eb08e3c3e6549f8972fd86af3c059f6)
I20260812 08:02:59.361032 26213 raft_consensus.cc:515] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:02:59.361449 26213 leader_election.cc:290] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3eb08e3c3e6549f8972fd86af3c059f6 (127.22.169.125:45717), 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197)
I20260812 08:02:59.361819 24988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" is_pre_election: true
W20260812 08:03:00.694909 24792 leader_election.cc:336] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 722e472e30714999b0d21f40b6335351 (127.22.169.124:41197): Timed out: RequestConsensusVote RPC to 127.22.169.124:41197 timed out after 0.665s (SENT)
I20260812 08:03:00.695016 24792 leader_election.cc:304] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae9ca593d2cf4016abe9e61d29a445a7; no voters: 3eb08e3c3e6549f8972fd86af3c059f6, 722e472e30714999b0d21f40b6335351
I20260812 08:03:00.695328 26220 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 08:03:00.747201 26073 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.22.169.124:41197)
I20260812 08:03:00.749553 24963 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34620:
table { table_name: "default.test_alter_table_sync" } new_table_name: "default.test_alter_table_sync_renamed" modify_external_catalogs: true
I20260812 08:03:00.765287 26252 tablet.cc:1724] T 8047b062c9be45b1bc4bff502da18d1a P 211748574d8d4d869720dfc7b1932353: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260812 08:03:00.766199 26253 tablet.cc:1724] T 8047b062c9be45b1bc4bff502da18d1a P 7ed0b3cbef154f179873b992f4eefe84: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260812 08:03:00.766250 26256 tablet.cc:1724] T 8047b062c9be45b1bc4bff502da18d1a P 7a6a447332234369b798026c6132c069: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260812 08:03:00.771513 24963 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6: default.test_alter_table_sync_renamed [id=79e270e2dc774da9bab82a2613842545] alter complete (version 1)
I20260812 08:03:00.777352 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 25300
I20260812 08:03:00.780018 25136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.780099 25134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.780326 25134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351"
I20260812 08:03:00.780481 25134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351"
I20260812 08:03:00.780609 25134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351"
I20260812 08:03:00.780727 25134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.780860 25134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.780966 25134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.781078 25134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.781392 25134 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:03:00.780019 25131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.781445 25134 raft_consensus.cc:740] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 722e472e30714999b0d21f40b6335351, State: Running, Role: LEADER
I20260812 08:03:00.780066 25123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.781608 25134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } }
I20260812 08:03:00.781725 25134 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 1 FOLLOWER]: Advancing to term 3
I20260812 08:03:00.782050 25132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351"
I20260812 08:03:00.782277 25122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.782658 25126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.782861 25135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351"
I20260812 08:03:00.782934 25134 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 3 FOLLOWER]: Refusing update from remote peer 3eb08e3c3e6549f8972fd86af3c059f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
I20260812 08:03:00.783025 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.783151 25127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351" is_pre_election: true
I20260812 08:03:00.783226 25127 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae9ca593d2cf4016abe9e61d29a445a7 in term 3.
I20260812 08:03:00.780324 25136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "722e472e30714999b0d21f40b6335351"
I20260812 08:03:00.783514 25136 raft_consensus.cc:2368] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3eb08e3c3e6549f8972fd86af3c059f6 for earlier term 2. Current term is 3.
I20260812 08:03:00.784719 24833 raft_consensus.cc:1240] T 00000000000000000000000000000000 P ae9ca593d2cf4016abe9e61d29a445a7 [term 3 FOLLOWER]: Rejecting Update request from peer 722e472e30714999b0d21f40b6335351 for earlier term 1. Current term is 3. Ops: []
I20260812 08:03:00.789590 26228 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:03:00.801625 24988 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 3eb08e3c3e6549f8972fd86af3c059f6 [term 3 LEADER]: Rejecting Update request from peer 722e472e30714999b0d21f40b6335351 for earlier term 1. Current term is 3. Ops: []
I20260812 08:03:00.821189 26084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eb08e3c3e6549f8972fd86af3c059f6. Latest consensus state: current_term: 3 leader_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:03:00.821309 26084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:00.821390 26084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae9ca593d2cf4016abe9e61d29a445a7" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 40335 } } peers { permanent_uuid: "3eb08e3c3e6549f8972fd86af3c059f6" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 45717 } } peers { permanent_uuid: "722e472e30714999b0d21f40b6335351" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 41197 } } }
I20260812 08:03:00.821446 26084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 722e472e30714999b0d21f40b6335351 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:00.823315 26257 mvcc.cc:204] Tried to move back new op lower bound from 7317593214031032320 to 7317593182074241024. Current Snapshot: MvccSnapshot[applied={T|T < 7317593214031032320}]
W20260812 08:03:00.828053 25079 connection.cc:573] server connection from 127.22.169.65:36589 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:03:00.828748 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 25563
I20260812 08:03:00.841328 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 25817
I20260812 08:03:00.848991 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 24755
I20260812 08:03:00.858616 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 24895
I20260812 08:03:00.870886 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 25046
2026-08-12T08:03:00Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestRenameTableSync/0 (11870 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestMasterUUIDResolution/0
2026-08-12T08:03:00Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:03:00Z Disabled control of system clock
I20260812 08:03:00.907619 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:42843
--webserver_interface=127.22.169.126
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:03:01.006150 26267 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:01.006328 26267 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:01.006364 26267 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:01.009443 26267 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:01.009486 26267 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:01.009505 26267 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:01.009519 26267 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:01.013088 26267 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:42843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.169.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.26267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:01.013968 26267 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:01.014933 26267 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:01.019675 26278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.019701 26279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.019726 26283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:01.020022 26267 server_base.cc:1061] running on GCE node
I20260812 08:03:01.020486 26267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:01.021275 26267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:01.022418 26267 hybrid_clock.cc:648] HybridClock initialized: now 1786521781022406 us; error 25 us; skew 500 ppm
I20260812 08:03:01.023918 26267 webserver.cc:533] Webserver started at http://127.22.169.126:36203/ using document root <none> and password file <none>
I20260812 08:03:01.024420 26267 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:01.024475 26267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:01.024641 26267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:01.026078 26267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/instance:
uuid: "09b23638403f4954814dd3dfe51c9e5f"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.026494 26267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal/instance:
uuid: "09b23638403f4954814dd3dfe51c9e5f"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.029405 26267 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:01.031379 26292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.032246 26267 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:01.032347 26267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
uuid: "09b23638403f4954814dd3dfe51c9e5f"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.032425 26267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:01.042853 26267 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:01.043391 26267 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:01.043541 26267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:01.050401 26267 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.126:42843
I20260812 08:03:01.050398 26391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.126:42843 every 8 connection(s)
I20260812 08:03:01.051347 26267 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:01.051508 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 26267
I20260812 08:03:01.051596 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal/instance
I20260812 08:03:01.052222 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:38175
--webserver_interface=127.22.169.125
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:01.054136 26393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:01.057363 26393 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:01.066646 26393 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:01.067343 26296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.169.125:38175: connect: Connection refused (error 111)
W20260812 08:03:01.068100 26393 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:38175: Network error: Client connection negotiation failed: client connection to 127.22.169.125:38175: connect: Connection refused (error 111)
I20260812 08:03:01.117285 26393 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } attempt: 1
W20260812 08:03:01.118630 26393 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:38175: Network error: Client connection negotiation failed: client connection to 127.22.169.125:38175: connect: Connection refused (error 111)
W20260812 08:03:01.153188 26399 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:01.153368 26399 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:01.153424 26399 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:01.156571 26399 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:01.156621 26399 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:01.156647 26399 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:01.156672 26399 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:01.160355 26399 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:38175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.169.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.26399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:01.161254 26399 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:01.162247 26399 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:01.166994 26423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.166999 26421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:01.167187 26399 server_base.cc:1061] running on GCE node
W20260812 08:03:01.167191 26419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:01.167665 26399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:01.168417 26399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:01.169559 26399 hybrid_clock.cc:648] HybridClock initialized: now 1786521781169545 us; error 28 us; skew 500 ppm
I20260812 08:03:01.171064 26399 webserver.cc:533] Webserver started at http://127.22.169.125:42627/ using document root <none> and password file <none>
I20260812 08:03:01.171564 26399 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:01.171617 26399 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:01.171793 26399 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:01.173177 26399 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/instance:
uuid: "41a354d3bbe5421fb6d33292f5444986"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.173614 26399 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal/instance:
uuid: "41a354d3bbe5421fb6d33292f5444986"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.176599 26399 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:01.178493 26436 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.179355 26399 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:01.179466 26399 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
uuid: "41a354d3bbe5421fb6d33292f5444986"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.179540 26399 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:01.186770 26393 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } attempt: 2
W20260812 08:03:01.188027 26393 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:38175: Network error: Client connection negotiation failed: client connection to 127.22.169.125:38175: connect: Connection refused (error 111)
I20260812 08:03:01.195724 26399 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:01.196233 26399 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:01.196370 26399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:01.203078 26525 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.125:38175 every 8 connection(s)
I20260812 08:03:01.203084 26399 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.125:38175
I20260812 08:03:01.203994 26399 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
I20260812 08:03:01.206669 26526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:01.207723 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 26399
I20260812 08:03:01.207808 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal/instance
I20260812 08:03:01.208352 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:33147
--webserver_interface=127.22.169.124
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:01.209872 26526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:01.218385 26526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:01.224047 26526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:01.224685 26445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.169.124:33147: connect: Connection refused (error 111)
W20260812 08:03:01.225449 26526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:33147: Network error: Client connection negotiation failed: client connection to 127.22.169.124:33147: connect: Connection refused (error 111)
I20260812 08:03:01.274679 26526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } attempt: 1
W20260812 08:03:01.276042 26526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:33147: Network error: Client connection negotiation failed: client connection to 127.22.169.124:33147: connect: Connection refused (error 111)
I20260812 08:03:01.279196 26393 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } attempt: 3
I20260812 08:03:01.283229 26393 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:01.284400 26393 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:33147: Network error: Client connection negotiation failed: client connection to 127.22.169.124:33147: connect: Connection refused (error 111)
W20260812 08:03:01.312319 26530 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:01.312490 26530 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:01.312543 26530 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260812 08:03:01.315547 26393 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } attempt: 1
W20260812 08:03:01.315718 26530 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:01.315774 26530 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:01.315809 26530 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:01.315840 26530 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
W20260812 08:03:01.316671 26393 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:33147: Network error: Client connection negotiation failed: client connection to 127.22.169.124:33147: connect: Connection refused (error 111)
I20260812 08:03:01.319509 26530 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:33147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.169.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.26530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:01.320415 26530 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:01.321396 26530 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:01.326128 26543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.326122 26546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.326120 26544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:01.326331 26530 server_base.cc:1061] running on GCE node
I20260812 08:03:01.326844 26530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:01.327605 26530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:01.328749 26530 hybrid_clock.cc:648] HybridClock initialized: now 1786521781328732 us; error 27 us; skew 500 ppm
I20260812 08:03:01.330276 26530 webserver.cc:533] Webserver started at http://127.22.169.124:36431/ using document root <none> and password file <none>
I20260812 08:03:01.330763 26530 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:01.330818 26530 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:01.330992 26530 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:01.332412 26530 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/instance:
uuid: "0b7c0b0545cc4563abac84c5c62e1e77"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.332825 26530 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal/instance:
uuid: "0b7c0b0545cc4563abac84c5c62e1e77"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.335822 26530 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:01.337719 26555 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.338608 26530 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:01.338718 26530 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
uuid: "0b7c0b0545cc4563abac84c5c62e1e77"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.338792 26530 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:01.344208 26526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } attempt: 2
W20260812 08:03:01.345359 26526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:33147: Network error: Client connection negotiation failed: client connection to 127.22.169.124:33147: connect: Connection refused (error 111)
I20260812 08:03:01.351531 26530 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:01.352056 26530 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:01.352201 26530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:01.358695 26660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.124:33147 every 8 connection(s)
I20260812 08:03:01.358700 26530 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.124:33147
I20260812 08:03:01.359587 26530 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
I20260812 08:03:01.362438 26661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:01.363965 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 26530
I20260812 08:03:01.364065 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal/instance
I20260812 08:03:01.367270 26661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:01.374459 26661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:01.378216 26661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:01.383054 26661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: Bootstrap starting.
I20260812 08:03:01.385054 26661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:01.385676 26661 log.cc:826] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:01.387259 26661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: No bootstrap required, opened a new log
I20260812 08:03:01.389856 26661 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.390053 26661 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:01.390093 26661 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b7c0b0545cc4563abac84c5c62e1e77, State: Initialized, Role: FOLLOWER
I20260812 08:03:01.390462 26661 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.390861 26674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.390960 26674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:01.391377 26661 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:01.391829 26393 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } attempt: 2
W20260812 08:03:01.395969 26702 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:01.396104 26702 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:01.397723 26393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Bootstrap starting.
I20260812 08:03:01.395988 26530 master_runner.cc:187] Error getting master registration for 127.22.169.126:42843: OK, instance_id { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" instance_seqno: 1786521781048480 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:03:01.398088 26530 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:03:01.399667 26393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:01.400331 26393 log.cc:826] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:01.401692 26393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: No bootstrap required, opened a new log
I20260812 08:03:01.405403 26393 raft_consensus.cc:359] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.405616 26393 raft_consensus.cc:385] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:01.405701 26393 raft_consensus.cc:740] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b23638403f4954814dd3dfe51c9e5f, State: Initialized, Role: FOLLOWER
I20260812 08:03:01.406220 26393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.407380 26393 sys_catalog.cc:565] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:01.407686 26706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.407857 26706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:01.414333 26267 master_runner.cc:187] Error getting master registration for 127.22.169.125:38175: OK, instance_id { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" instance_seqno: 1786521781201216 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:03:01.415995 26267 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:01.414318 26722 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:01.416087 26722 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:01.436498 26526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } attempt: 3
I20260812 08:03:01.442373 26526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: Bootstrap starting.
I20260812 08:03:01.445048 26526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:01.445958 26526 log.cc:826] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:01.447822 26526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: No bootstrap required, opened a new log
I20260812 08:03:01.451629 26526 raft_consensus.cc:359] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.451802 26526 raft_consensus.cc:385] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:01.451884 26526 raft_consensus.cc:740] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41a354d3bbe5421fb6d33292f5444986, State: Initialized, Role: FOLLOWER
I20260812 08:03:01.452332 26526 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.452800 26729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.452963 26729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:01.453513 26526 sys_catalog.cc:565] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:03:01.459899 26749 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:01.460023 26749 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:01.462275 26399 master_runner.cc:264] No leader master found from master 41a354d3bbe5421fb6d33292f5444986
I20260812 08:03:01.462337 26399 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:03:01.514964 26706 raft_consensus.cc:493] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:01.515189 26706 raft_consensus.cc:515] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.516281 26706 leader_election.cc:290] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41a354d3bbe5421fb6d33292f5444986 (127.22.169.125:38175), 0b7c0b0545cc4563abac84c5c62e1e77 (127.22.169.124:33147)
I20260812 08:03:01.517014 26491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09b23638403f4954814dd3dfe51c9e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41a354d3bbe5421fb6d33292f5444986" is_pre_election: true
I20260812 08:03:01.517304 26491 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09b23638403f4954814dd3dfe51c9e5f in term 0.
I20260812 08:03:01.517855 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09b23638403f4954814dd3dfe51c9e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" is_pre_election: true
I20260812 08:03:01.518165 26614 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09b23638403f4954814dd3dfe51c9e5f in term 0.
I20260812 08:03:01.518599 26297 leader_election.cc:304] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b23638403f4954814dd3dfe51c9e5f, 0b7c0b0545cc4563abac84c5c62e1e77; no voters: 
I20260812 08:03:01.518947 26706 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:03:01.519016 26706 raft_consensus.cc:493] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:01.519055 26706 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:01.520222 26706 raft_consensus.cc:515] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.520602 26706 leader_election.cc:290] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [CANDIDATE]: Term 1 election: Requested vote from peers 41a354d3bbe5421fb6d33292f5444986 (127.22.169.125:38175), 0b7c0b0545cc4563abac84c5c62e1e77 (127.22.169.124:33147)
I20260812 08:03:01.521505 26491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09b23638403f4954814dd3dfe51c9e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41a354d3bbe5421fb6d33292f5444986"
I20260812 08:03:01.521618 26491 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:01.522818 26491 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09b23638403f4954814dd3dfe51c9e5f in term 1.
I20260812 08:03:01.523198 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09b23638403f4954814dd3dfe51c9e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b7c0b0545cc4563abac84c5c62e1e77"
I20260812 08:03:01.523308 26614 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:01.524296 26614 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09b23638403f4954814dd3dfe51c9e5f in term 1.
I20260812 08:03:01.524691 26297 leader_election.cc:304] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b23638403f4954814dd3dfe51c9e5f, 0b7c0b0545cc4563abac84c5c62e1e77; no voters: 
I20260812 08:03:01.525403 26706 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:01.525655 26706 raft_consensus.cc:697] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 LEADER]: Becoming Leader. State: Replica: 09b23638403f4954814dd3dfe51c9e5f, State: Running, Role: LEADER
I20260812 08:03:01.526000 26706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:01.527726 26706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09b23638403f4954814dd3dfe51c9e5f. Latest consensus state: current_term: 1 leader_uuid: "09b23638403f4954814dd3dfe51c9e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.527818 26706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:01.528769 26754 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:01.531158 26754 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:01.536242 26491 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Refusing update from remote peer 09b23638403f4954814dd3dfe51c9e5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:01.536239 26614 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 1 FOLLOWER]: Refusing update from remote peer 09b23638403f4954814dd3dfe51c9e5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:01.536866 26751 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:01.537082 26706 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:01.540433 26729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09b23638403f4954814dd3dfe51c9e5f. Latest consensus state: current_term: 1 leader_uuid: "09b23638403f4954814dd3dfe51c9e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.540539 26729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:01.540783 26674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09b23638403f4954814dd3dfe51c9e5f. Latest consensus state: current_term: 1 leader_uuid: "09b23638403f4954814dd3dfe51c9e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.540896 26674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:01.542819 26751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "09b23638403f4954814dd3dfe51c9e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.542974 26751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:01.543776 26729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "09b23638403f4954814dd3dfe51c9e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.543905 26729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:01.544296 26755 mvcc.cc:204] Tried to move back new op lower bound from 7317593217165582336 to 7317593217133453312. Current Snapshot: MvccSnapshot[applied={T|T < 7317593217165582336}]
I20260812 08:03:01.550851 26761 mvcc.cc:204] Tried to move back new op lower bound from 7317593217165582336 to 7317593217133453312. Current Snapshot: MvccSnapshot[applied={T|T < 7317593217165582336}]
I20260812 08:03:01.551560 26751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "09b23638403f4954814dd3dfe51c9e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.551657 26751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:01.552459 26674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "09b23638403f4954814dd3dfe51c9e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:01.552572 26674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:01.552984 26757 mvcc.cc:204] Tried to move back new op lower bound from 7317593217165582336 to 7317593217133453312. Current Snapshot: MvccSnapshot[applied={T|T < 7317593217165582336}]
I20260812 08:03:01.554629 26754 catalog_manager.cc:1383] Generated new cluster ID: 4351186977624dd7a89509df61e0088f
I20260812 08:03:01.554697 26754 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:01.592519 26754 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:01.593686 26754 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:01.625056 26754 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Generated new TSK 0
I20260812 08:03:01.625713 26754 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:01.628808 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.65:0
--local_ip_for_outbound_sockets=127.22.169.65
--webserver_interface=127.22.169.65
--webserver_port=0
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:03:01.732152 26773 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:01.732329 26773 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:01.732378 26773 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:01.735620 26773 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:01.735719 26773 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.65
I20260812 08:03:01.739404 26773 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.169.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--never_fsync=true
--heap_profile_path=/tmp/kudu.26773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:01.740295 26773 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:01.741305 26773 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:01.747380 26780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.747457 26781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.747383 26788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:01.747589 26773 server_base.cc:1061] running on GCE node
I20260812 08:03:01.748008 26773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:01.748500 26773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:01.749675 26773 hybrid_clock.cc:648] HybridClock initialized: now 1786521781749656 us; error 30 us; skew 500 ppm
I20260812 08:03:01.751281 26773 webserver.cc:533] Webserver started at http://127.22.169.65:42215/ using document root <none> and password file <none>
I20260812 08:03:01.751780 26773 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:01.751837 26773 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:01.752010 26773 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:01.753392 26773 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/instance:
uuid: "5df6fab0651540aa84a4c6c2b6c01f55"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.753813 26773 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal/instance:
uuid: "5df6fab0651540aa84a4c6c2b6c01f55"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.756843 26773 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:01.758723 26798 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.759552 26773 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:01.759647 26773 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
uuid: "5df6fab0651540aa84a4c6c2b6c01f55"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.759721 26773 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:01.771569 26773 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:01.772074 26773 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:01.772219 26773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:01.772676 26773 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:01.773561 26773 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:01.773608 26773 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.773655 26773 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:01.773681 26773 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.781818 26773 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.65:43713
I20260812 08:03:01.781847 27020 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.65:43713 every 8 connection(s)
I20260812 08:03:01.782650 26773 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:01.784731 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 26773
I20260812 08:03:01.784837 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal/instance
I20260812 08:03:01.787474 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.66:0
--local_ip_for_outbound_sockets=127.22.169.66
--webserver_interface=127.22.169.66
--webserver_port=0
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:01.792845 27023 heartbeater.cc:344] Connected to a master server at 127.22.169.125:38175
I20260812 08:03:01.792989 27021 heartbeater.cc:344] Connected to a master server at 127.22.169.124:33147
I20260812 08:03:01.793076 27023 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:01.793078 27021 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:01.793561 27022 heartbeater.cc:344] Connected to a master server at 127.22.169.126:42843
I20260812 08:03:01.793632 27022 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:01.793644 27021 heartbeater.cc:507] Master 127.22.169.124:33147 requested a full tablet report, sending...
I20260812 08:03:01.793648 27023 heartbeater.cc:507] Master 127.22.169.125:38175 requested a full tablet report, sending...
I20260812 08:03:01.793778 27022 heartbeater.cc:507] Master 127.22.169.126:42843 requested a full tablet report, sending...
I20260812 08:03:01.795070 26325 ts_manager.cc:194] Registered new tserver with Master: 5df6fab0651540aa84a4c6c2b6c01f55 (127.22.169.65:43713)
I20260812 08:03:01.795070 26470 ts_manager.cc:194] Registered new tserver with Master: 5df6fab0651540aa84a4c6c2b6c01f55 (127.22.169.65:43713)
I20260812 08:03:01.795135 26591 ts_manager.cc:194] Registered new tserver with Master: 5df6fab0651540aa84a4c6c2b6c01f55 (127.22.169.65:43713)
I20260812 08:03:01.796411 26325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.65:60979
W20260812 08:03:01.888206 27034 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:01.888357 27034 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:01.888401 27034 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:01.891507 27034 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:01.891602 27034 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.66
I20260812 08:03:01.895205 27034 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.169.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--never_fsync=true
--heap_profile_path=/tmp/kudu.27034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:01.896078 27034 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:01.896991 27034 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:01.902573 27039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.902591 27044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:01.902552 27041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:01.902932 27034 server_base.cc:1061] running on GCE node
I20260812 08:03:01.903249 27034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:01.903734 27034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:01.904884 27034 hybrid_clock.cc:648] HybridClock initialized: now 1786521781904862 us; error 31 us; skew 500 ppm
I20260812 08:03:01.906447 27034 webserver.cc:533] Webserver started at http://127.22.169.66:34473/ using document root <none> and password file <none>
I20260812 08:03:01.906944 27034 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:01.906994 27034 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:01.907168 27034 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:01.908507 27034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/instance:
uuid: "7d213f14d4ea45888bc94de46896e394"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.908941 27034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal/instance:
uuid: "7d213f14d4ea45888bc94de46896e394"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.911898 27034 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:01.913729 27057 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.914619 27034 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:01.914707 27034 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
uuid: "7d213f14d4ea45888bc94de46896e394"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:01.914789 27034 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:01.940035 27034 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:01.940557 27034 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:01.940704 27034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:01.941185 27034 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:01.942130 27034 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:01.942178 27034 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.942219 27034 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:01.942247 27034 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:01.950788 27034 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.66:43607
I20260812 08:03:01.950817 27271 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.66:43607 every 8 connection(s)
I20260812 08:03:01.951617 27034 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:01.954010 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 27034
I20260812 08:03:01.954102 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal/instance
I20260812 08:03:01.956691 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.67:0
--local_ip_for_outbound_sockets=127.22.169.67
--webserver_interface=127.22.169.67
--webserver_port=0
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:01.961329 27274 heartbeater.cc:344] Connected to a master server at 127.22.169.125:38175
I20260812 08:03:01.961339 27273 heartbeater.cc:344] Connected to a master server at 127.22.169.126:42843
I20260812 08:03:01.961417 27272 heartbeater.cc:344] Connected to a master server at 127.22.169.124:33147
I20260812 08:03:01.961552 27273 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:01.961555 27274 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:01.961553 27272 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:01.962142 27272 heartbeater.cc:507] Master 127.22.169.124:33147 requested a full tablet report, sending...
I20260812 08:03:01.962122 27273 heartbeater.cc:507] Master 127.22.169.126:42843 requested a full tablet report, sending...
I20260812 08:03:01.962131 27274 heartbeater.cc:507] Master 127.22.169.125:38175 requested a full tablet report, sending...
I20260812 08:03:01.963112 26325 ts_manager.cc:194] Registered new tserver with Master: 7d213f14d4ea45888bc94de46896e394 (127.22.169.66:43607)
I20260812 08:03:01.963322 26470 ts_manager.cc:194] Registered new tserver with Master: 7d213f14d4ea45888bc94de46896e394 (127.22.169.66:43607)
I20260812 08:03:01.963630 26325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.66:53341
I20260812 08:03:01.964097 26591 ts_manager.cc:194] Registered new tserver with Master: 7d213f14d4ea45888bc94de46896e394 (127.22.169.66:43607)
W20260812 08:03:02.058071 27287 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:02.058240 27287 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:02.058302 27287 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:02.061407 27287 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:02.061525 27287 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.67
I20260812 08:03:02.065129 27287 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.169.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--never_fsync=true
--heap_profile_path=/tmp/kudu.27287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:02.066028 27287 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:02.066965 27287 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:02.072525 27302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:02.072613 27307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:02.072530 27299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:02.072925 27287 server_base.cc:1061] running on GCE node
I20260812 08:03:02.073240 27287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:02.073710 27287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:02.074843 27287 hybrid_clock.cc:648] HybridClock initialized: now 1786521782074826 us; error 34 us; skew 500 ppm
I20260812 08:03:02.076339 27287 webserver.cc:533] Webserver started at http://127.22.169.67:32863/ using document root <none> and password file <none>
I20260812 08:03:02.076848 27287 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:02.076903 27287 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:02.077067 27287 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:02.078452 27287 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/instance:
uuid: "fec726e32798400eb591c58f0b41ffde"
format_stamp: "Formatted at 2026-08-12 08:03:02 on dist-test-slave-tc2s"
I20260812 08:03:02.078859 27287 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/instance:
uuid: "fec726e32798400eb591c58f0b41ffde"
format_stamp: "Formatted at 2026-08-12 08:03:02 on dist-test-slave-tc2s"
I20260812 08:03:02.081717 27287 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:02.083637 27321 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.084542 27287 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:02.084631 27287 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
uuid: "fec726e32798400eb591c58f0b41ffde"
format_stamp: "Formatted at 2026-08-12 08:03:02 on dist-test-slave-tc2s"
I20260812 08:03:02.084717 27287 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:02.093597 27287 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:02.094127 27287 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:02.094272 27287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:02.094720 27287 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:02.095609 27287 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:02.095654 27287 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.095693 27287 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:02.095722 27287 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.103646 27287 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.67:37071
I20260812 08:03:02.103694 27531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.67:37071 every 8 connection(s)
I20260812 08:03:02.104440 27287 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:02.112669 27536 heartbeater.cc:344] Connected to a master server at 127.22.169.125:38175
I20260812 08:03:02.112783 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 27287
I20260812 08:03:02.112872 27536 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:02.112900 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/instance
I20260812 08:03:02.113297 27536 heartbeater.cc:507] Master 127.22.169.125:38175 requested a full tablet report, sending...
I20260812 08:03:02.113431 27535 heartbeater.cc:344] Connected to a master server at 127.22.169.126:42843
I20260812 08:03:02.113511 27535 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:02.113521 27534 heartbeater.cc:344] Connected to a master server at 127.22.169.124:33147
I20260812 08:03:02.113700 27535 heartbeater.cc:507] Master 127.22.169.126:42843 requested a full tablet report, sending...
I20260812 08:03:02.113739 27534 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:02.113930 27534 heartbeater.cc:507] Master 127.22.169.124:33147 requested a full tablet report, sending...
I20260812 08:03:02.114372 26470 ts_manager.cc:194] Registered new tserver with Master: fec726e32798400eb591c58f0b41ffde (127.22.169.67:37071)
I20260812 08:03:02.114372 26325 ts_manager.cc:194] Registered new tserver with Master: fec726e32798400eb591c58f0b41ffde (127.22.169.67:37071)
I20260812 08:03:02.114693 26591 ts_manager.cc:194] Registered new tserver with Master: fec726e32798400eb591c58f0b41ffde (127.22.169.67:37071)
I20260812 08:03:02.115026 26325 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.67:44677
I20260812 08:03:02.118777 23205 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:02.126226 27554 raft_consensus.cc:493] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 09b23638403f4954814dd3dfe51c9e5f)
I20260812 08:03:02.126335 27554 raft_consensus.cc:515] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.127187 27554 leader_election.cc:290] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09b23638403f4954814dd3dfe51c9e5f (127.22.169.126:42843), 0b7c0b0545cc4563abac84c5c62e1e77 (127.22.169.124:33147)
I20260812 08:03:02.127571 26614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41a354d3bbe5421fb6d33292f5444986" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" is_pre_election: true
I20260812 08:03:02.127637 26343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41a354d3bbe5421fb6d33292f5444986" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "09b23638403f4954814dd3dfe51c9e5f" is_pre_election: true
I20260812 08:03:02.128070 26445 leader_election.cc:304] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41a354d3bbe5421fb6d33292f5444986; no voters: 09b23638403f4954814dd3dfe51c9e5f, 0b7c0b0545cc4563abac84c5c62e1e77
I20260812 08:03:02.128286 27554 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:03:02.139139 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 26773
I20260812 08:03:02.170521 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 27034
I20260812 08:03:02.186678 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 27287
I20260812 08:03:02.203651 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 26267
I20260812 08:03:02.213542 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 26399
I20260812 08:03:02.224464 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 26530
I20260812 08:03:02.232980 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:42843
--webserver_interface=127.22.169.126
--webserver_port=36203
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:03:02.330971 27561 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:02.331140 27561 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:02.331178 27561 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:02.334534 27561 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:02.334587 27561 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:02.334606 27561 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:02.334622 27561 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:02.338274 27561 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:42843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.169.126
--webserver_port=36203
--never_fsync=true
--heap_profile_path=/tmp/kudu.27561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:02.339145 27561 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:02.340118 27561 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:02.345072 27580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:02.345078 27578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:02.345078 27570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:02.345400 27561 server_base.cc:1061] running on GCE node
I20260812 08:03:02.345845 27561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:02.346637 27561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:02.347782 27561 hybrid_clock.cc:648] HybridClock initialized: now 1786521782347756 us; error 43 us; skew 500 ppm
I20260812 08:03:02.349274 27561 webserver.cc:533] Webserver started at http://127.22.169.126:36203/ using document root <none> and password file <none>
I20260812 08:03:02.349781 27561 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:02.349856 27561 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:02.352897 27561 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:02.354606 27592 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.355463 27561 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:02.355571 27561 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
uuid: "09b23638403f4954814dd3dfe51c9e5f"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:02.355886 27561 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:02.381560 27561 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:02.382148 27561 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:02.382300 27561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:02.389011 27701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.126:42843 every 8 connection(s)
I20260812 08:03:02.389015 27561 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.126:42843
I20260812 08:03:02.390013 27561 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:02.393606 27703 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:03:02.395108 27703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Bootstrap starting.
I20260812 08:03:02.397579 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 27561
I20260812 08:03:02.398030 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:38175
--webserver_interface=127.22.169.125
--webserver_port=42627
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:02.409283 27703 log.cc:826] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:02.414937 27703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:02.415236 27703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Bootstrap complete.
I20260812 08:03:02.418424 27703 raft_consensus.cc:359] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.418715 27703 raft_consensus.cc:740] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b23638403f4954814dd3dfe51c9e5f, State: Initialized, Role: FOLLOWER
I20260812 08:03:02.419198 27703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.419615 27709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:02.419744 27709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:02.420190 27703 sys_catalog.cc:565] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:02.425968 27731 catalog_manager.cc:1295] Loaded cluster ID: 4351186977624dd7a89509df61e0088f
I20260812 08:03:02.426025 27731 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: loading cluster ID for follower catalog manager: success
I20260812 08:03:02.428328 27731 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: acquiring CA information for follower catalog manager: success
I20260812 08:03:02.429512 27731 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:02.436429 27561 master_runner.cc:187] Error getting master registration for 127.22.169.125:38175: Network error: Client connection negotiation failed: client connection to 127.22.169.125:38175: connect: Connection refused (error 111), 
I20260812 08:03:02.438882 27561 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:02.499965 27706 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:02.500134 27706 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:02.500171 27706 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:02.503310 27706 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:02.503357 27706 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:02.503376 27706 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:02.503391 27706 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:02.507017 27706 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:38175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.169.125
--webserver_port=42627
--never_fsync=true
--heap_profile_path=/tmp/kudu.27706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:02.507951 27706 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:02.509107 27706 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:02.514097 27747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:02.514062 27743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:02.514202 27706 server_base.cc:1061] running on GCE node
W20260812 08:03:02.514072 27741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:02.514742 27706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:02.515532 27706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:02.516696 27706 hybrid_clock.cc:648] HybridClock initialized: now 1786521782516682 us; error 30 us; skew 500 ppm
I20260812 08:03:02.518258 27706 webserver.cc:533] Webserver started at http://127.22.169.125:42627/ using document root <none> and password file <none>
I20260812 08:03:02.518757 27706 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:02.518824 27706 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:02.522048 27706 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:02.523893 27758 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.524853 27706 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:02.524953 27706 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
uuid: "41a354d3bbe5421fb6d33292f5444986"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:02.525287 27706 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:02.540839 27706 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:02.541369 27706 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:02.541529 27706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:02.549022 27706 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.125:38175
I20260812 08:03:02.549032 27853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.125:38175 every 8 connection(s)
I20260812 08:03:02.550068 27706 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
I20260812 08:03:02.553553 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 27706
I20260812 08:03:02.553947 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:33147
--webserver_interface=127.22.169.124
--webserver_port=36431
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:02.554800 27854 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:03:02.556795 27854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: Bootstrap starting.
I20260812 08:03:02.574404 27854 log.cc:826] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:02.581728 27854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:02.582147 27854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: Bootstrap complete.
I20260812 08:03:02.586615 27854 raft_consensus.cc:359] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.586997 27854 raft_consensus.cc:740] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41a354d3bbe5421fb6d33292f5444986, State: Initialized, Role: FOLLOWER
I20260812 08:03:02.587514 27854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.587953 27863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:02.588151 27863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:02.588581 27854 sys_catalog.cc:565] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:02.593413 27886 catalog_manager.cc:1295] Loaded cluster ID: 4351186977624dd7a89509df61e0088f
I20260812 08:03:02.593524 27886 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: loading cluster ID for follower catalog manager: success
I20260812 08:03:02.596096 27886 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: acquiring CA information for follower catalog manager: success
I20260812 08:03:02.597668 27886 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:02.612329 27706 master_runner.cc:187] Error getting master registration for 127.22.169.124:33147: Network error: Client connection negotiation failed: client connection to 127.22.169.124:33147: connect: Connection refused (error 111), 
I20260812 08:03:02.614359 27706 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:02.661790 27856 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:02.661995 27856 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:02.662045 27856 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:02.665230 27856 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:02.665277 27856 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:02.665295 27856 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:02.665311 27856 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:02.669032 27856 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:33147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.169.124
--webserver_port=36431
--never_fsync=true
--heap_profile_path=/tmp/kudu.27856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:02.670006 27856 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:02.671059 27856 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:02.676196 27900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:02.676239 27856 server_base.cc:1061] running on GCE node
W20260812 08:03:02.676419 27903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:02.676226 27897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:02.676911 27856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:02.677711 27856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:02.678859 27856 hybrid_clock.cc:648] HybridClock initialized: now 1786521782678845 us; error 30 us; skew 500 ppm
I20260812 08:03:02.680444 27856 webserver.cc:533] Webserver started at http://127.22.169.124:36431/ using document root <none> and password file <none>
I20260812 08:03:02.680961 27856 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:02.681041 27856 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:02.684267 27856 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:02.686095 27916 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.687057 27856 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:02.687158 27856 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
uuid: "0b7c0b0545cc4563abac84c5c62e1e77"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:02.687503 27856 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:02.727993 27856 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:02.728623 27856 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:02.728814 27856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:02.736297 27856 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.124:33147
I20260812 08:03:02.736325 28010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.124:33147 every 8 connection(s)
I20260812 08:03:02.737314 27856 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
I20260812 08:03:02.739794 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 27856
I20260812 08:03:02.740211 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.65:43713
--local_ip_for_outbound_sockets=127.22.169.65
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--webserver_port=42215
--webserver_interface=127.22.169.65
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:02.741231 28011 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:03:02.743036 28011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: Bootstrap starting.
I20260812 08:03:02.760485 28011 log.cc:826] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:02.767706 28011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:02.768081 28011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: Bootstrap complete.
I20260812 08:03:02.772500 28011 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.772904 28011 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b7c0b0545cc4563abac84c5c62e1e77, State: Initialized, Role: FOLLOWER
I20260812 08:03:02.773473 28011 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.773932 28024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:02.774040 28024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:02.774641 28011 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:02.779559 28044 catalog_manager.cc:1295] Loaded cluster ID: 4351186977624dd7a89509df61e0088f
I20260812 08:03:02.779621 28044 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: loading cluster ID for follower catalog manager: success
I20260812 08:03:02.781958 28044 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: acquiring CA information for follower catalog manager: success
I20260812 08:03:02.783142 28044 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:02.802798 27856 master_runner.cc:264] No leader master found from master 0b7c0b0545cc4563abac84c5c62e1e77
I20260812 08:03:02.802872 27856 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:02.863220 28015 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:02.863406 28015 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:02.863457 28015 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:02.866737 28015 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:02.866844 28015 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.65
I20260812 08:03:02.870524 28015 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.65:43713
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.169.65
--webserver_port=42215
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--never_fsync=true
--heap_profile_path=/tmp/kudu.28015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:02.871538 28015 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:02.872694 28015 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:02.879390 28062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:02.879447 28058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:02.879704 28015 server_base.cc:1061] running on GCE node
W20260812 08:03:02.879706 28066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:02.880060 28015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:02.880579 28015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:02.881731 28015 hybrid_clock.cc:648] HybridClock initialized: now 1786521782881714 us; error 39 us; skew 500 ppm
I20260812 08:03:02.883335 28015 webserver.cc:533] Webserver started at http://127.22.169.65:42215/ using document root <none> and password file <none>
I20260812 08:03:02.883880 28015 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:02.883957 28015 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:02.887259 28015 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 08:03:02.889074 28078 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.890173 28015 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260812 08:03:02.890273 28015 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
uuid: "5df6fab0651540aa84a4c6c2b6c01f55"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:02.890637 28015 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:02.907226 28015 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:02.907802 28015 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:02.907963 28015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:02.908526 28015 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:02.909533 28015 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:02.909582 28015 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.909632 28015 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:02.909658 28015 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:02.919934 28015 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.65:43713
I20260812 08:03:02.919956 28313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.65:43713 every 8 connection(s)
I20260812 08:03:02.921033 28015 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:02.930425 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 28015
I20260812 08:03:02.930847 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.66:43607
--local_ip_for_outbound_sockets=127.22.169.66
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--webserver_port=34473
--webserver_interface=127.22.169.66
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:02.931818 28315 heartbeater.cc:344] Connected to a master server at 127.22.169.126:42843
I20260812 08:03:02.932039 28315 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:02.932505 28315 heartbeater.cc:507] Master 127.22.169.126:42843 requested a full tablet report, sending...
I20260812 08:03:02.933491 28316 heartbeater.cc:344] Connected to a master server at 127.22.169.125:38175
I20260812 08:03:02.933570 28316 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:02.933972 28316 heartbeater.cc:507] Master 127.22.169.125:38175 requested a full tablet report, sending...
I20260812 08:03:02.934470 27634 ts_manager.cc:194] Registered new tserver with Master: 5df6fab0651540aa84a4c6c2b6c01f55 (127.22.169.65:43713)
I20260812 08:03:02.935016 27781 ts_manager.cc:194] Registered new tserver with Master: 5df6fab0651540aa84a4c6c2b6c01f55 (127.22.169.65:43713)
I20260812 08:03:02.935153 28314 heartbeater.cc:344] Connected to a master server at 127.22.169.124:33147
I20260812 08:03:02.935220 28314 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:02.935379 28314 heartbeater.cc:507] Master 127.22.169.124:33147 requested a full tablet report, sending...
I20260812 08:03:02.936357 27948 ts_manager.cc:194] Registered new tserver with Master: 5df6fab0651540aa84a4c6c2b6c01f55 (127.22.169.65:43713)
I20260812 08:03:02.938927 28329 raft_consensus.cc:493] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:02.939100 28329 raft_consensus.cc:515] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.940490 28329 leader_election.cc:290] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 41a354d3bbe5421fb6d33292f5444986 (127.22.169.125:38175), 0b7c0b0545cc4563abac84c5c62e1e77 (127.22.169.124:33147)
I20260812 08:03:02.945052 27962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09b23638403f4954814dd3dfe51c9e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" is_pre_election: true
I20260812 08:03:02.945346 27962 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09b23638403f4954814dd3dfe51c9e5f in term 1.
I20260812 08:03:02.945772 27601 leader_election.cc:304] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b23638403f4954814dd3dfe51c9e5f, 0b7c0b0545cc4563abac84c5c62e1e77; no voters: 
I20260812 08:03:02.946118 28329 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:03:02.946185 28329 raft_consensus.cc:493] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:02.946224 28329 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:02.948253 28329 raft_consensus.cc:515] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.948655 28329 leader_election.cc:290] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [CANDIDATE]: Term 2 election: Requested vote from peers 41a354d3bbe5421fb6d33292f5444986 (127.22.169.125:38175), 0b7c0b0545cc4563abac84c5c62e1e77 (127.22.169.124:33147)
I20260812 08:03:02.948609 27797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09b23638403f4954814dd3dfe51c9e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "41a354d3bbe5421fb6d33292f5444986" is_pre_election: true
I20260812 08:03:02.948907 27797 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09b23638403f4954814dd3dfe51c9e5f in term 1.
I20260812 08:03:02.948976 27796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09b23638403f4954814dd3dfe51c9e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "41a354d3bbe5421fb6d33292f5444986"
I20260812 08:03:02.949060 27796 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:02.950606 27796 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 41a354d3bbe5421fb6d33292f5444986 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09b23638403f4954814dd3dfe51c9e5f in term 2.
I20260812 08:03:02.950834 27962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "09b23638403f4954814dd3dfe51c9e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0b7c0b0545cc4563abac84c5c62e1e77"
I20260812 08:03:02.950876 27600 leader_election.cc:304] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b23638403f4954814dd3dfe51c9e5f, 41a354d3bbe5421fb6d33292f5444986; no voters: 
I20260812 08:03:02.950964 27962 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:02.951087 28329 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:03:02.951258 28329 raft_consensus.cc:697] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [term 2 LEADER]: Becoming Leader. State: Replica: 09b23638403f4954814dd3dfe51c9e5f, State: Running, Role: LEADER
I20260812 08:03:02.951557 28329 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } }
I20260812 08:03:02.952636 27962 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0b7c0b0545cc4563abac84c5c62e1e77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09b23638403f4954814dd3dfe51c9e5f in term 2.
I20260812 08:03:02.953327 28332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09b23638403f4954814dd3dfe51c9e5f. Latest consensus state: current_term: 2 leader_uuid: "09b23638403f4954814dd3dfe51c9e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b23638403f4954814dd3dfe51c9e5f" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 42843 } } peers { permanent_uuid: "41a354d3bbe5421fb6d33292f5444986" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 38175 } } peers { permanent_uuid: "0b7c0b0545cc4563abac84c5c62e1e77" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 33147 } } }
I20260812 08:03:02.953442 28332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:02.953750 28335 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:02.954911 28335 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:02.955324 28335 catalog_manager.cc:1295] Loaded cluster ID: 4351186977624dd7a89509df61e0088f
I20260812 08:03:02.955384 28335 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:02.955943 28335 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:02.956368 28335 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 09b23638403f4954814dd3dfe51c9e5f: Loaded TSK: 0
I20260812 08:03:02.956954 28335 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 08:03:03.038082 28323 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:03.038241 28323 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:03.038290 28323 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:03.041397 28323 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:03.041492 28323 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.66
I20260812 08:03:03.045109 28323 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.66:43607
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.169.66
--webserver_port=34473
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--never_fsync=true
--heap_profile_path=/tmp/kudu.28323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:03.046000 28323 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:03.046957 28323 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:03.052759 28345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.052739 28347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.052783 28344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:03.053149 28323 server_base.cc:1061] running on GCE node
I20260812 08:03:03.053468 28323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:03.054000 28323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:03.055137 28323 hybrid_clock.cc:648] HybridClock initialized: now 1786521783055126 us; error 27 us; skew 500 ppm
I20260812 08:03:03.056589 28323 webserver.cc:533] Webserver started at http://127.22.169.66:34473/ using document root <none> and password file <none>
I20260812 08:03:03.057123 28323 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:03.057196 28323 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:03.060271 28323 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:03.061885 28354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.062791 28323 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:03.062896 28323 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
uuid: "7d213f14d4ea45888bc94de46896e394"
format_stamp: "Formatted at 2026-08-12 08:03:01 on dist-test-slave-tc2s"
I20260812 08:03:03.063218 28323 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:03.075026 28323 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:03.075515 28323 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:03.075662 28323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:03.076175 28323 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:03.077114 28323 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:03.077162 28323 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.077207 28323 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:03.077236 28323 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.085305 28323 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.66:43607
I20260812 08:03:03.085362 28605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.66:43607 every 8 connection(s)
I20260812 08:03:03.086222 28323 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:03.087553 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 28323
I20260812 08:03:03.087985 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.67:37071
--local_ip_for_outbound_sockets=127.22.169.67
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--webserver_port=32863
--webserver_interface=127.22.169.67
--builtin_ntp_servers=127.22.169.84:45515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:03.095466 28608 heartbeater.cc:344] Connected to a master server at 127.22.169.124:33147
I20260812 08:03:03.095530 28609 heartbeater.cc:344] Connected to a master server at 127.22.169.126:42843
I20260812 08:03:03.095680 28609 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:03.095713 28611 heartbeater.cc:344] Connected to a master server at 127.22.169.125:38175
I20260812 08:03:03.095680 28608 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:03.095796 28611 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:03.096253 28611 heartbeater.cc:507] Master 127.22.169.125:38175 requested a full tablet report, sending...
I20260812 08:03:03.096268 28609 heartbeater.cc:507] Master 127.22.169.126:42843 requested a full tablet report, sending...
I20260812 08:03:03.096243 28608 heartbeater.cc:507] Master 127.22.169.124:33147 requested a full tablet report, sending...
I20260812 08:03:03.097378 27781 ts_manager.cc:194] Registered new tserver with Master: 7d213f14d4ea45888bc94de46896e394 (127.22.169.66:43607)
I20260812 08:03:03.097404 27634 ts_manager.cc:194] Registered new tserver with Master: 7d213f14d4ea45888bc94de46896e394 (127.22.169.66:43607)
I20260812 08:03:03.097442 27948 ts_manager.cc:194] Registered new tserver with Master: 7d213f14d4ea45888bc94de46896e394 (127.22.169.66:43607)
I20260812 08:03:03.098915 27634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.66:37239
W20260812 08:03:03.192238 28619 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:03.192438 28619 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:03.192489 28619 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:03.195677 28619 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:03.195778 28619 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.67
I20260812 08:03:03.199326 28619 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:45515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.67:37071
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.169.67
--webserver_port=32863
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:42843,127.22.169.125:38175,127.22.169.124:33147
--never_fsync=true
--heap_profile_path=/tmp/kudu.28619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:03.200191 28619 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:03.201187 28619 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:03.207000 28639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.207041 28637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.207073 28630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:03.207151 28619 server_base.cc:1061] running on GCE node
I20260812 08:03:03.207582 28619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:03.208055 28619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:03.209188 28619 hybrid_clock.cc:648] HybridClock initialized: now 1786521783209176 us; error 28 us; skew 500 ppm
I20260812 08:03:03.210654 28619 webserver.cc:533] Webserver started at http://127.22.169.67:32863/ using document root <none> and password file <none>
I20260812 08:03:03.211143 28619 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:03.211211 28619 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:03.214162 28619 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:03:03.215766 28653 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.216678 28619 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:03.216773 28619 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
uuid: "fec726e32798400eb591c58f0b41ffde"
format_stamp: "Formatted at 2026-08-12 08:03:02 on dist-test-slave-tc2s"
I20260812 08:03:03.217097 28619 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:03.236073 28619 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:03.236632 28619 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:03.236783 28619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:03.237267 28619 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:03.238221 28619 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:03.238268 28619 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.238317 28619 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:03.238345 28619 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.246537 28619 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.67:37071
I20260812 08:03:03.246572 28881 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.67:37071 every 8 connection(s)
I20260812 08:03:03.247423 28619 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:03.255182 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 28619
I20260812 08:03:03.256291 28882 heartbeater.cc:344] Connected to a master server at 127.22.169.124:33147
I20260812 08:03:03.256292 28886 heartbeater.cc:344] Connected to a master server at 127.22.169.125:38175
I20260812 08:03:03.256325 28884 heartbeater.cc:344] Connected to a master server at 127.22.169.126:42843
I20260812 08:03:03.256531 28882 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:03.256528 28886 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:03.256529 28884 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:03.257090 28886 heartbeater.cc:507] Master 127.22.169.125:38175 requested a full tablet report, sending...
I20260812 08:03:03.257090 28882 heartbeater.cc:507] Master 127.22.169.124:33147 requested a full tablet report, sending...
I20260812 08:03:03.257815 28884 heartbeater.cc:507] Master 127.22.169.126:42843 requested a full tablet report, sending...
I20260812 08:03:03.258219 27781 ts_manager.cc:194] Registered new tserver with Master: fec726e32798400eb591c58f0b41ffde (127.22.169.67:37071)
I20260812 08:03:03.258508 27948 ts_manager.cc:194] Registered new tserver with Master: fec726e32798400eb591c58f0b41ffde (127.22.169.67:37071)
I20260812 08:03:03.258509 27634 ts_manager.cc:194] Registered new tserver with Master: fec726e32798400eb591c58f0b41ffde (127.22.169.67:37071)
I20260812 08:03:03.259178 27634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.67:44789
I20260812 08:03:03.268965 23205 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:03.279212 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 28015
I20260812 08:03:03.294400 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 28323
I20260812 08:03:03.307744 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 28619
I20260812 08:03:03.320214 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 27561
I20260812 08:03:03.330086 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 27706
I20260812 08:03:03.342469 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 27856
2026-08-12T08:03:03Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestMasterUUIDResolution/0 (2469 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestClusterIdOnFailover/0
2026-08-12T08:03:03Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:03:03Z Disabled control of system clock
I20260812 08:03:03.377336 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:41493
--webserver_interface=127.22.169.126
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:03:03.477983 28905 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:03.478153 28905 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:03.478188 28905 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:03.481329 28905 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:03.481382 28905 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:03.481401 28905 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:03.481431 28905 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:03.485029 28905 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.126:41493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.169.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.28905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:03.485917 28905 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:03.486898 28905 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:03.491634 28914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.491652 28919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.491724 28915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:03.491762 28905 server_base.cc:1061] running on GCE node
I20260812 08:03:03.492275 28905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:03.493047 28905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:03.494189 28905 hybrid_clock.cc:648] HybridClock initialized: now 1786521783494178 us; error 23 us; skew 500 ppm
I20260812 08:03:03.495724 28905 webserver.cc:533] Webserver started at http://127.22.169.126:37813/ using document root <none> and password file <none>
I20260812 08:03:03.496222 28905 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:03.496279 28905 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:03.496436 28905 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:03.497795 28905 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/data/instance:
uuid: "542977576a2d41949e7370da243ffb15"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.498242 28905 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/wal/instance:
uuid: "542977576a2d41949e7370da243ffb15"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.501211 28905 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:03.503161 28932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.504058 28905 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:03:03.504156 28905 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/wal
uuid: "542977576a2d41949e7370da243ffb15"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.504230 28905 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:03.527024 28905 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:03.527591 28905 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:03.527746 28905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:03.534493 28905 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.126:41493
I20260812 08:03:03.534498 29030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.126:41493 every 8 connection(s)
I20260812 08:03:03.535418 28905 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:03.538058 29031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:03.541145 29031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:03.541766 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 28905
I20260812 08:03:03.541872 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-0/wal/instance
I20260812 08:03:03.542572 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:41675
--webserver_interface=127.22.169.125
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:03.550179 29031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:03.550885 28939 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.169.125:41675: connect: Connection refused (error 111)
W20260812 08:03:03.551632 29031 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:41675: Network error: Client connection negotiation failed: client connection to 127.22.169.125:41675: connect: Connection refused (error 111)
I20260812 08:03:03.600816 29031 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } attempt: 1
W20260812 08:03:03.602151 29031 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:41675: Network error: Client connection negotiation failed: client connection to 127.22.169.125:41675: connect: Connection refused (error 111)
W20260812 08:03:03.642012 29036 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:03.642179 29036 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:03.642221 29036 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:03.645323 29036 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:03.645376 29036 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:03.645395 29036 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:03.645426 29036 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:03.649047 29036 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.125:41675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.169.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.29036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:03.649883 29036 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:03.650859 29036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:03.655462 29047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.655514 29049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.655478 29046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:03.655882 29036 server_base.cc:1061] running on GCE node
I20260812 08:03:03.656282 29036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:03.657016 29036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:03.658151 29036 hybrid_clock.cc:648] HybridClock initialized: now 1786521783658140 us; error 24 us; skew 500 ppm
I20260812 08:03:03.659648 29036 webserver.cc:533] Webserver started at http://127.22.169.125:43369/ using document root <none> and password file <none>
I20260812 08:03:03.660128 29036 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:03.660180 29036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:03.660378 29036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:03.661710 29036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/data/instance:
uuid: "c7a6fe24973c4606a59652c22f1f00d9"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.662142 29036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/wal/instance:
uuid: "c7a6fe24973c4606a59652c22f1f00d9"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.664984 29036 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:03.666834 29069 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.667737 29036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:03.667831 29036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/wal
uuid: "c7a6fe24973c4606a59652c22f1f00d9"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.667905 29036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:03.670290 29031 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } attempt: 2
W20260812 08:03:03.671533 29031 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.125:41675: Network error: Client connection negotiation failed: client connection to 127.22.169.125:41675: connect: Connection refused (error 111)
I20260812 08:03:03.677743 29036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:03.678287 29036 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:03.678440 29036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:03.684916 29036 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.125:41675
I20260812 08:03:03.684917 29175 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.125:41675 every 8 connection(s)
I20260812 08:03:03.685781 29036 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/data/info.pb
I20260812 08:03:03.687985 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 29036
I20260812 08:03:03.688078 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-1/wal/instance
I20260812 08:03:03.688359 29176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:03.688658 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:45609
--webserver_interface=127.22.169.124
--webserver_port=0
--builtin_ntp_servers=127.22.169.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:03.691838 29176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:03.700227 29176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:03.705238 29176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:03.705864 29077 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
W20260812 08:03:03.706707 29176 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:45609: Network error: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
I20260812 08:03:03.755893 29176 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } attempt: 1
W20260812 08:03:03.757133 29176 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:45609: Network error: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
I20260812 08:03:03.762691 29031 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } attempt: 3
I20260812 08:03:03.766520 29031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:03.767699 29031 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:45609: Network error: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
W20260812 08:03:03.790848 29182 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:03.791002 29182 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:03.791043 29182 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:03.794135 29182 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:03.794178 29182 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:03.794196 29182 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:03.794216 29182 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:03.797775 29182 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.169.124:45609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.169.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.29182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:03.798597 29182 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:03.798867 29031 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } attempt: 1
I20260812 08:03:03.799671 29182 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:03.799942 29031 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:45609: Network error: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
W20260812 08:03:03.804263 29204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.804280 29196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:03.804265 29197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:03.804625 29182 server_base.cc:1061] running on GCE node
I20260812 08:03:03.805045 29182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:03.805759 29182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:03.806908 29182 hybrid_clock.cc:648] HybridClock initialized: now 1786521783806899 us; error 38 us; skew 500 ppm
I20260812 08:03:03.808287 29182 webserver.cc:533] Webserver started at http://127.22.169.124:40959/ using document root <none> and password file <none>
I20260812 08:03:03.808749 29182 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:03.808796 29182 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:03.808949 29182 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:03.810249 29182 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/data/instance:
uuid: "cb4b19786ec54f7a8213721a494b3d38"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.810623 29182 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/wal/instance:
uuid: "cb4b19786ec54f7a8213721a494b3d38"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.813392 29182 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:03.815205 29211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:03.816076 29182 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:03.816164 29182 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/wal
uuid: "cb4b19786ec54f7a8213721a494b3d38"
format_stamp: "Formatted at 2026-08-12 08:03:03 on dist-test-slave-tc2s"
I20260812 08:03:03.816228 29182 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:03.825281 29176 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } attempt: 2
W20260812 08:03:03.826355 29176 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.169.124:45609: Network error: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
I20260812 08:03:03.830163 29182 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:03.830644 29182 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:03.830790 29182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:03.837296 29182 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.124:45609
I20260812 08:03:03.837301 29317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.124:45609 every 8 connection(s)
I20260812 08:03:03.838176 29182 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/data/info.pb
I20260812 08:03:03.840677 29318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:03.843611 29318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:03.845206 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 29182
I20260812 08:03:03.845314 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/master-2/wal/instance
I20260812 08:03:03.851806 29318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:03.855460 29318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:03.860518 29318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38: Bootstrap starting.
I20260812 08:03:03.862600 29318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:03.863233 29318 log.cc:826] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:03.864543 29318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38: No bootstrap required, opened a new log
I20260812 08:03:03.866853 29318 raft_consensus.cc:359] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:03.866984 29318 raft_consensus.cc:385] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:03.867033 29318 raft_consensus.cc:740] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb4b19786ec54f7a8213721a494b3d38, State: Initialized, Role: FOLLOWER
I20260812 08:03:03.867388 29318 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:03.867749 29343 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:03.867843 29343 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:03.868255 29318 sys_catalog.cc:565] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:03:03.873020 29362 catalog_manager.cc:1594] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:03.873092 29362 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:03.871251 29182 master_runner.cc:187] Error getting master registration for 127.22.169.126:41493: OK, instance_id { permanent_uuid: "542977576a2d41949e7370da243ffb15" instance_seqno: 1786521783532700 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:03:03.873238 29182 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:03:03.875108 29031 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } attempt: 2
I20260812 08:03:03.880386 29031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: Bootstrap starting.
I20260812 08:03:03.882218 29031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:03.883018 29031 log.cc:826] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:03.884387 29031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: No bootstrap required, opened a new log
I20260812 08:03:03.886850 29031 raft_consensus.cc:359] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:03.886979 29031 raft_consensus.cc:385] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:03.887027 29031 raft_consensus.cc:740] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 542977576a2d41949e7370da243ffb15, State: Initialized, Role: FOLLOWER
I20260812 08:03:03.887372 29031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:03.887809 29368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:03.887935 29368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:03.888254 29031 sys_catalog.cc:565] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:03:03.892364 29392 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:03.892432 29392 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:03.893044 28905 master_runner.cc:187] Error getting master registration for 127.22.169.125:41675: OK, instance_id { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" instance_seqno: 1786521783683179 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:03:03.895185 28905 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:03:03.917514 29176 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } attempt: 3
I20260812 08:03:03.923715 29176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: Bootstrap starting.
I20260812 08:03:03.926128 29176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:03.927145 29176 log.cc:826] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:03.929420 29176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: No bootstrap required, opened a new log
I20260812 08:03:03.932448 29176 raft_consensus.cc:359] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:03.932616 29176 raft_consensus.cc:385] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:03.932668 29176 raft_consensus.cc:740] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a6fe24973c4606a59652c22f1f00d9, State: Initialized, Role: FOLLOWER
I20260812 08:03:03.933089 29176 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:03.933544 29399 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:03.933718 29399 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:03.934228 29176 sys_catalog.cc:565] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:03:03.939507 29423 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:03.939625 29423 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:03.942027 29036 master_runner.cc:264] No leader master found from master c7a6fe24973c4606a59652c22f1f00d9
I20260812 08:03:03.942086 29036 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:04.028993 28944 tablet.cc:2406] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:03:04.081759 29221 tablet.cc:2406] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:04.134155 29343 raft_consensus.cc:493] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:04.134377 29343 raft_consensus.cc:515] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:04.135486 29343 leader_election.cc:290] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 542977576a2d41949e7370da243ffb15 (127.22.169.126:41493), c7a6fe24973c4606a59652c22f1f00d9 (127.22.169.125:41675)
I20260812 08:03:04.135933 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb4b19786ec54f7a8213721a494b3d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542977576a2d41949e7370da243ffb15" is_pre_election: true
I20260812 08:03:04.135932 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb4b19786ec54f7a8213721a494b3d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a6fe24973c4606a59652c22f1f00d9" is_pre_election: true
I20260812 08:03:04.136209 28988 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb4b19786ec54f7a8213721a494b3d38 in term 0.
I20260812 08:03:04.136210 29116 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb4b19786ec54f7a8213721a494b3d38 in term 0.
I20260812 08:03:04.136663 29218 leader_election.cc:304] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 542977576a2d41949e7370da243ffb15, cb4b19786ec54f7a8213721a494b3d38; no voters: 
I20260812 08:03:04.136924 29343 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:03:04.136991 29343 raft_consensus.cc:493] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:04.137033 29343 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:04.137981 29343 raft_consensus.cc:515] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:04.138296 29343 leader_election.cc:290] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [CANDIDATE]: Term 1 election: Requested vote from peers 542977576a2d41949e7370da243ffb15 (127.22.169.126:41493), c7a6fe24973c4606a59652c22f1f00d9 (127.22.169.125:41675)
I20260812 08:03:04.138624 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb4b19786ec54f7a8213721a494b3d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a6fe24973c4606a59652c22f1f00d9"
I20260812 08:03:04.138751 29116 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:04.139537 29116 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb4b19786ec54f7a8213721a494b3d38 in term 1.
I20260812 08:03:04.139755 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb4b19786ec54f7a8213721a494b3d38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542977576a2d41949e7370da243ffb15"
I20260812 08:03:04.139883 28988 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:04.139919 29214 leader_election.cc:304] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7a6fe24973c4606a59652c22f1f00d9, cb4b19786ec54f7a8213721a494b3d38; no voters: 
I20260812 08:03:04.140110 29343 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:04.140305 29343 raft_consensus.cc:697] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [term 1 LEADER]: Becoming Leader. State: Replica: cb4b19786ec54f7a8213721a494b3d38, State: Running, Role: LEADER
I20260812 08:03:04.140617 29343 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:04.141110 28988 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb4b19786ec54f7a8213721a494b3d38 in term 1.
I20260812 08:03:04.142270 29343 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4b19786ec54f7a8213721a494b3d38. Latest consensus state: current_term: 1 leader_uuid: "cb4b19786ec54f7a8213721a494b3d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:04.142362 29343 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:04.142938 29431 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:04.143899 29431 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:04.148188 28988 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 1 FOLLOWER]: Refusing update from remote peer cb4b19786ec54f7a8213721a494b3d38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:04.148226 29116 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 1 FOLLOWER]: Refusing update from remote peer cb4b19786ec54f7a8213721a494b3d38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:04.148720 29343 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:04.148859 29427 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:04.152050 29368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4b19786ec54f7a8213721a494b3d38. Latest consensus state: current_term: 1 leader_uuid: "cb4b19786ec54f7a8213721a494b3d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:04.152170 29368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:04.152315 29399 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4b19786ec54f7a8213721a494b3d38. Latest consensus state: current_term: 1 leader_uuid: "cb4b19786ec54f7a8213721a494b3d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:04.152417 29399 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:04.154276 29343 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb4b19786ec54f7a8213721a494b3d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:04.154385 29343 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:04.155246 29368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb4b19786ec54f7a8213721a494b3d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:04.155344 29368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:04.155561 29399 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb4b19786ec54f7a8213721a494b3d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:04.155656 29399 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:04.155799 29431 catalog_manager.cc:1383] Generated new cluster ID: ec94d91df95346819c5ad572a66e53f9
I20260812 08:03:04.155893 29431 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:04.156095 29453 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb4b19786ec54f7a8213721a494b3d38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:04.156116 29437 mvcc.cc:204] Tried to move back new op lower bound from 7317593227865186304 to 7317593227842920448. Current Snapshot: MvccSnapshot[applied={T|T < 7317593227865186304}]
I20260812 08:03:04.156186 29453 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:04.178521 29431 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:04.179286 29431 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:04.185642 29431 catalog_manager.cc:6092] T 00000000000000000000000000000000 P cb4b19786ec54f7a8213721a494b3d38: Generated new TSK 0
I20260812 08:03:04.186269 29431 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:04.197355 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.65:0
--local_ip_for_outbound_sockets=127.22.169.65
--webserver_interface=127.22.169.65
--webserver_port=0
--tserver_master_addrs=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--builtin_ntp_servers=127.22.169.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:03:04.296607 29454 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:04.296766 29454 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:04.296811 29454 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:04.299980 29454 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:04.300076 29454 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.65
I20260812 08:03:04.303622 29454 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.169.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--never_fsync=true
--heap_profile_path=/tmp/kudu.29454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:04.304419 29454 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:04.305297 29454 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:04.310794 29465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:04.310789 29462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:04.310786 29470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:04.311105 29454 server_base.cc:1061] running on GCE node
I20260812 08:03:04.311409 29454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:04.311910 29454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:04.313047 29454 hybrid_clock.cc:648] HybridClock initialized: now 1786521784313036 us; error 28 us; skew 500 ppm
I20260812 08:03:04.314563 29454 webserver.cc:533] Webserver started at http://127.22.169.65:38849/ using document root <none> and password file <none>
I20260812 08:03:04.315095 29454 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:04.315150 29454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:04.315312 29454 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:04.316650 29454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/data/instance:
uuid: "5101a3a78afb49caaa1a9b9b3de2bc12"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.317073 29454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/wal/instance:
uuid: "5101a3a78afb49caaa1a9b9b3de2bc12"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.320024 29454 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 08:03:04.321943 29481 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.322767 29454 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:04.322863 29454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
uuid: "5101a3a78afb49caaa1a9b9b3de2bc12"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.322937 29454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:04.356400 29454 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:04.356956 29454 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:04.357108 29454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:04.357569 29454 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:04.358507 29454 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:04.358551 29454 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.358589 29454 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:04.358618 29454 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.366752 29454 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.65:45975
I20260812 08:03:04.366801 29728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.65:45975 every 8 connection(s)
I20260812 08:03:04.367568 29454 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:04.372715 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 29454
I20260812 08:03:04.372843 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-0/wal/instance
I20260812 08:03:04.376139 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.66:0
--local_ip_for_outbound_sockets=127.22.169.66
--webserver_interface=127.22.169.66
--webserver_port=0
--tserver_master_addrs=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--builtin_ntp_servers=127.22.169.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:04.377427 29729 heartbeater.cc:344] Connected to a master server at 127.22.169.124:45609
I20260812 08:03:04.377640 29729 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.377848 29731 heartbeater.cc:344] Connected to a master server at 127.22.169.125:41675
I20260812 08:03:04.377959 29731 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.378154 29729 heartbeater.cc:507] Master 127.22.169.124:45609 requested a full tablet report, sending...
I20260812 08:03:04.378158 29731 heartbeater.cc:507] Master 127.22.169.125:41675 requested a full tablet report, sending...
I20260812 08:03:04.379112 29730 heartbeater.cc:344] Connected to a master server at 127.22.169.126:41493
I20260812 08:03:04.379185 29730 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.379343 29730 heartbeater.cc:507] Master 127.22.169.126:41493 requested a full tablet report, sending...
I20260812 08:03:04.379503 29241 ts_manager.cc:194] Registered new tserver with Master: 5101a3a78afb49caaa1a9b9b3de2bc12 (127.22.169.65:45975)
I20260812 08:03:04.379501 29100 ts_manager.cc:194] Registered new tserver with Master: 5101a3a78afb49caaa1a9b9b3de2bc12 (127.22.169.65:45975)
I20260812 08:03:04.380246 28965 ts_manager.cc:194] Registered new tserver with Master: 5101a3a78afb49caaa1a9b9b3de2bc12 (127.22.169.65:45975)
I20260812 08:03:04.380901 29241 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.65:58011
W20260812 08:03:04.476313 29749 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:04.476469 29749 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:04.476521 29749 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:04.479647 29749 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:04.479754 29749 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.66
I20260812 08:03:04.483338 29749 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.169.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--never_fsync=true
--heap_profile_path=/tmp/kudu.29749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:04.484131 29749 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:04.485049 29749 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:04.490490 29767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:04.490440 29770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:04.490496 29765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:04.490684 29749 server_base.cc:1061] running on GCE node
I20260812 08:03:04.491052 29749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:04.491513 29749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:04.492677 29749 hybrid_clock.cc:648] HybridClock initialized: now 1786521784492670 us; error 24 us; skew 500 ppm
I20260812 08:03:04.494141 29749 webserver.cc:533] Webserver started at http://127.22.169.66:41037/ using document root <none> and password file <none>
I20260812 08:03:04.494616 29749 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:04.494668 29749 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:04.494832 29749 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:04.496134 29749 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/data/instance:
uuid: "cc5d3b1bd52e4dcf808ad01947ee486a"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.496539 29749 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/wal/instance:
uuid: "cc5d3b1bd52e4dcf808ad01947ee486a"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.499408 29749 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:04.501197 29796 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.502094 29749 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:04.502182 29749 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
uuid: "cc5d3b1bd52e4dcf808ad01947ee486a"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.502262 29749 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:04.520670 29749 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:04.521147 29749 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:04.521287 29749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:04.521747 29749 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:04.522679 29749 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:04.522724 29749 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.522763 29749 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:04.522792 29749 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.531158 29749 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.66:35923
I20260812 08:03:04.531206 30020 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.66:35923 every 8 connection(s)
I20260812 08:03:04.531972 29749 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:04.532203 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 29749
I20260812 08:03:04.532322 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-1/wal/instance
I20260812 08:03:04.535774 23205 external_mini_cluster.cc:1372] Running /tmp/dist-test-task8r_clb/build/debug/bin/kudu
/tmp/dist-test-task8r_clb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.169.67:0
--local_ip_for_outbound_sockets=127.22.169.67
--webserver_interface=127.22.169.67
--webserver_port=0
--tserver_master_addrs=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--builtin_ntp_servers=127.22.169.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:04.542480 30025 heartbeater.cc:344] Connected to a master server at 127.22.169.126:41493
I20260812 08:03:04.542557 30022 heartbeater.cc:344] Connected to a master server at 127.22.169.124:45609
I20260812 08:03:04.542680 30025 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.542708 30028 heartbeater.cc:344] Connected to a master server at 127.22.169.125:41675
I20260812 08:03:04.542681 30022 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.542769 30028 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.543215 30025 heartbeater.cc:507] Master 127.22.169.126:41493 requested a full tablet report, sending...
I20260812 08:03:04.543208 30022 heartbeater.cc:507] Master 127.22.169.124:45609 requested a full tablet report, sending...
I20260812 08:03:04.543208 30028 heartbeater.cc:507] Master 127.22.169.125:41675 requested a full tablet report, sending...
I20260812 08:03:04.544175 29241 ts_manager.cc:194] Registered new tserver with Master: cc5d3b1bd52e4dcf808ad01947ee486a (127.22.169.66:35923)
I20260812 08:03:04.544818 29241 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.66:44625
I20260812 08:03:04.545320 29100 ts_manager.cc:194] Registered new tserver with Master: cc5d3b1bd52e4dcf808ad01947ee486a (127.22.169.66:35923)
I20260812 08:03:04.545881 28965 ts_manager.cc:194] Registered new tserver with Master: cc5d3b1bd52e4dcf808ad01947ee486a (127.22.169.66:35923)
W20260812 08:03:04.641619 30033 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:04.641770 30033 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:04.641819 30033 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:04.644919 30033 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:04.645038 30033 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.169.67
I20260812 08:03:04.648556 30033 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.169.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.169.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.169.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.22.169.126:41493,127.22.169.125:41675,127.22.169.124:45609
--never_fsync=true
--heap_profile_path=/tmp/kudu.30033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.169.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:04.649366 30033 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:04.650315 30033 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:04.655701 30039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:04.655748 30040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:04.655771 30043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:04.656057 30033 server_base.cc:1061] running on GCE node
I20260812 08:03:04.656397 30033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:04.656842 30033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:04.657940 30033 hybrid_clock.cc:648] HybridClock initialized: now 1786521784657929 us; error 35 us; skew 500 ppm
I20260812 08:03:04.659327 30033 webserver.cc:533] Webserver started at http://127.22.169.67:41769/ using document root <none> and password file <none>
I20260812 08:03:04.659806 30033 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:04.659860 30033 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:04.660022 30033 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:04.661353 30033 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/data/instance:
uuid: "b2fd668246e1417b960e8f137f8c9ffb"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.661759 30033 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/instance:
uuid: "b2fd668246e1417b960e8f137f8c9ffb"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.664618 30033 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:04.666501 30060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.667325 30033 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:04.667418 30033 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/data,/tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
uuid: "b2fd668246e1417b960e8f137f8c9ffb"
format_stamp: "Formatted at 2026-08-12 08:03:04 on dist-test-slave-tc2s"
I20260812 08:03:04.667490 30033 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:04.676151 30033 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:04.676600 30033 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:04.676730 30033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:04.677173 30033 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:04.678081 30033 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:04.678128 30033 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.678175 30033 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:04.678205 30033 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:04.686769 30287 raft_consensus.cc:493] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb4b19786ec54f7a8213721a494b3d38)
I20260812 08:03:04.686955 30033 rpc_server.cc:307] RPC server started. Bound to: 127.22.169.67:37181
I20260812 08:03:04.687009 30291 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.169.67:37181 every 8 connection(s)
I20260812 08:03:04.687089 30287 raft_consensus.cc:515] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:04.687860 30033 server_base.cc:1193] Dumped server information to /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:04.688184 23205 external_mini_cluster.cc:1434] Started /tmp/dist-test-task8r_clb/build/debug/bin/kudu as pid 30033
I20260812 08:03:04.688287 23205 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task8r_clb/test-tmp/master_failover-itest.2.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_0.1786521757542422-23205-0/minicluster-data/ts-2/wal/instance
I20260812 08:03:04.688233 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "542977576a2d41949e7370da243ffb15" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c7a6fe24973c4606a59652c22f1f00d9" is_pre_election: true
I20260812 08:03:04.689239 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "542977576a2d41949e7370da243ffb15" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb4b19786ec54f7a8213721a494b3d38" is_pre_election: true
I20260812 08:03:04.690738 28940 leader_election.cc:304] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 542977576a2d41949e7370da243ffb15; no voters: c7a6fe24973c4606a59652c22f1f00d9, cb4b19786ec54f7a8213721a494b3d38
I20260812 08:03:04.691085 30298 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:03:04.691458 30287 leader_election.cc:290] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7a6fe24973c4606a59652c22f1f00d9 (127.22.169.125:41675), cb4b19786ec54f7a8213721a494b3d38 (127.22.169.124:45609)
I20260812 08:03:04.698089 30292 heartbeater.cc:344] Connected to a master server at 127.22.169.124:45609
I20260812 08:03:04.698331 30292 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.698845 30292 heartbeater.cc:507] Master 127.22.169.124:45609 requested a full tablet report, sending...
I20260812 08:03:04.698948 30294 heartbeater.cc:344] Connected to a master server at 127.22.169.125:41675
I20260812 08:03:04.699374 30294 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.699538 30294 heartbeater.cc:507] Master 127.22.169.125:41675 requested a full tablet report, sending...
I20260812 08:03:04.700251 30293 heartbeater.cc:344] Connected to a master server at 127.22.169.126:41493
I20260812 08:03:04.700346 30293 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:04.700474 29241 ts_manager.cc:194] Registered new tserver with Master: b2fd668246e1417b960e8f137f8c9ffb (127.22.169.67:37181)
I20260812 08:03:04.700474 29100 ts_manager.cc:194] Registered new tserver with Master: b2fd668246e1417b960e8f137f8c9ffb (127.22.169.67:37181)
I20260812 08:03:04.700513 30293 heartbeater.cc:507] Master 127.22.169.126:41493 requested a full tablet report, sending...
I20260812 08:03:04.701103 29241 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.169.67:38299
I20260812 08:03:04.701138 28965 ts_manager.cc:194] Registered new tserver with Master: b2fd668246e1417b960e8f137f8c9ffb (127.22.169.67:37181)
I20260812 08:03:04.708925 23205 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:04.718194 23205 master_failover-itest.cc:507] Shutdown the leader master
I20260812 08:03:04.718253 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 29182
I20260812 08:03:04.882332 29729 heartbeater.cc:499] Master 127.22.169.124:45609 was elected leader, sending a full tablet report...
W20260812 08:03:04.883124 29729 heartbeater.cc:646] Failed to heartbeat to 127.22.169.124:45609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
I20260812 08:03:04.893460 29392 catalog_manager.cc:1295] Loaded cluster ID: ec94d91df95346819c5ad572a66e53f9
I20260812 08:03:04.893517 29392 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: loading cluster ID for follower catalog manager: success
I20260812 08:03:04.895211 29392 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: acquiring CA information for follower catalog manager: success
I20260812 08:03:04.896219 29392 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:04.940722 29423 catalog_manager.cc:1295] Loaded cluster ID: ec94d91df95346819c5ad572a66e53f9
I20260812 08:03:04.940781 29423 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: loading cluster ID for follower catalog manager: success
I20260812 08:03:04.942358 29423 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: acquiring CA information for follower catalog manager: success
I20260812 08:03:04.943490 29423 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:05.046521 30022 heartbeater.cc:499] Master 127.22.169.124:45609 was elected leader, sending a full tablet report...
W20260812 08:03:05.047448 30022 heartbeater.cc:646] Failed to heartbeat to 127.22.169.124:45609 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
I20260812 08:03:05.085202 30323 raft_consensus.cc:493] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb4b19786ec54f7a8213721a494b3d38)
I20260812 08:03:05.085337 30323 raft_consensus.cc:515] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:05.086314 30323 leader_election.cc:290] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 542977576a2d41949e7370da243ffb15 (127.22.169.126:41493), cb4b19786ec54f7a8213721a494b3d38 (127.22.169.124:45609)
I20260812 08:03:05.086608 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c7a6fe24973c4606a59652c22f1f00d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "542977576a2d41949e7370da243ffb15" is_pre_election: true
I20260812 08:03:05.086776 28988 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7a6fe24973c4606a59652c22f1f00d9 in term 1.
I20260812 08:03:05.087121 29079 leader_election.cc:304] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 542977576a2d41949e7370da243ffb15, c7a6fe24973c4606a59652c22f1f00d9; no voters: 
I20260812 08:03:05.087332 30323 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:03:05.087399 30323 raft_consensus.cc:493] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb4b19786ec54f7a8213721a494b3d38)
I20260812 08:03:05.087427 30323 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 1 FOLLOWER]: Advancing to term 2
W20260812 08:03:05.087539 29077 leader_election.cc:336] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cb4b19786ec54f7a8213721a494b3d38 (127.22.169.124:45609): Network error: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
I20260812 08:03:05.088353 30323 raft_consensus.cc:515] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:05.088635 30323 leader_election.cc:290] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [CANDIDATE]: Term 2 election: Requested vote from peers 542977576a2d41949e7370da243ffb15 (127.22.169.126:41493), cb4b19786ec54f7a8213721a494b3d38 (127.22.169.124:45609)
I20260812 08:03:05.088910 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c7a6fe24973c4606a59652c22f1f00d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "542977576a2d41949e7370da243ffb15"
I20260812 08:03:05.089027 28988 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 1 FOLLOWER]: Advancing to term 2
W20260812 08:03:05.089474 29077 leader_election.cc:336] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cb4b19786ec54f7a8213721a494b3d38 (127.22.169.124:45609): Network error: Client connection negotiation failed: client connection to 127.22.169.124:45609: connect: Connection refused (error 111)
I20260812 08:03:05.089849 28988 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 542977576a2d41949e7370da243ffb15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7a6fe24973c4606a59652c22f1f00d9 in term 2.
I20260812 08:03:05.090147 29079 leader_election.cc:304] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 542977576a2d41949e7370da243ffb15, c7a6fe24973c4606a59652c22f1f00d9; no voters: cb4b19786ec54f7a8213721a494b3d38
I20260812 08:03:05.090312 30323 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:03:05.090478 30323 raft_consensus.cc:697] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [term 2 LEADER]: Becoming Leader. State: Replica: c7a6fe24973c4606a59652c22f1f00d9, State: Running, Role: LEADER
I20260812 08:03:05.090750 30323 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } }
I20260812 08:03:05.091576 30329 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7a6fe24973c4606a59652c22f1f00d9. Latest consensus state: current_term: 2 leader_uuid: "c7a6fe24973c4606a59652c22f1f00d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "542977576a2d41949e7370da243ffb15" member_type: VOTER last_known_addr { host: "127.22.169.126" port: 41493 } } peers { permanent_uuid: "c7a6fe24973c4606a59652c22f1f00d9" member_type: VOTER last_known_addr { host: "127.22.169.125" port: 41675 } } peers { permanent_uuid: "cb4b19786ec54f7a8213721a494b3d38" member_type: VOTER last_known_addr { host: "127.22.169.124" port: 45609 } } }
I20260812 08:03:05.091658 30329 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:05.091943 30330 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:05.092815 30330 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:05.093195 30330 catalog_manager.cc:1295] Loaded cluster ID: ec94d91df95346819c5ad572a66e53f9
I20260812 08:03:05.093240 30330 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:05.093741 30330 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:05.094139 30330 catalog_manager.cc:6103] T 00000000000000000000000000000000 P c7a6fe24973c4606a59652c22f1f00d9: Loaded TSK: 0
I20260812 08:03:05.094698 30330 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:05.113562 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 29454
I20260812 08:03:05.130684 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 29749
I20260812 08:03:05.142081 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 30033
I20260812 08:03:05.163033 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 28905
I20260812 08:03:05.173168 23205 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task8r_clb/build/debug/bin/kudu with pid 29036
2026-08-12T08:03:05Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestClusterIdOnFailover/0 (1829 ms)
[----------] 4 tests from HmsConfigurations/MasterFailoverTest (27646 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (27646 ms total)
[  PASSED  ] 4 tests.
