Note: This is test shard 4 of 4.
[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from HmsConfigurations/MasterFailoverTest
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestPauseAfterCreateTableIssued/1
2026-08-12T08:01:27Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:27Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:	 jdbc:derby:/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/metadb;create=true
Metastore Connection Driver :	 org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User:	 APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 

 
 
 
 

 
 
 
 


 
 
 

 
 
 


 
 
 
 
 
 
 


 
 
 

 
 
 

 
 

 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 


 
 
 
 
 
 



 
 
 
 
 


 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 


Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/security.properties
2026-08-12 08:01:35: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 08:01:43.988675  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:43965
--webserver_interface=127.4.108.62
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--hive_metastore_uris=thrift://127.0.0.1:35049
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:01:44.097502  4870 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:44.097797  4870 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:44.097879  4870 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:44.101195  4870 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:44.101295  4870 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:44.101331  4870 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:44.101372  4870 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:44.105259  4870 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35049
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:43965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.108.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.4870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:44.106520  4870 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:44.107769  4870 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:44.113637  4875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:44.113675  4879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:44.113870  4881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:44.114009  4870 server_base.cc:1061] running on GCE node
I20260812 08:01:44.114532  4870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:44.115545  4870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:44.116716  4870 hybrid_clock.cc:648] HybridClock initialized: now 1786521704116710 us; error 33 us; skew 500 ppm
I20260812 08:01:44.118638  4870 webserver.cc:533] Webserver started at http://127.4.108.62:40221/ using document root <none> and password file <none>
I20260812 08:01:44.119227  4870 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:44.119285  4870 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:44.119493  4870 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:44.121196  4870 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/data/instance:
uuid: "820525fb312a42aebba0a1494babf4eb"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.121824  4870 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/wal/instance:
uuid: "820525fb312a42aebba0a1494babf4eb"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.125387  4870 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.003s
I20260812 08:01:44.127916  4887 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:44.129048  4870 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:44.129218  4870 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/wal
uuid: "820525fb312a42aebba0a1494babf4eb"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.129330  4870 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:44.149855  4870 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:44.150609  4870 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:44.150828  4870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:44.159492  4870 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.62:43965
I20260812 08:01:44.159466  4949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.62:43965 every 8 connection(s)
I20260812 08:01:44.160578  4870 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:44.163730  4950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:44.165643  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 4870
I20260812 08:01:44.165800  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-0/wal/instance
I20260812 08:01:44.167493  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:44381
--webserver_interface=127.4.108.61
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--hive_metastore_uris=thrift://127.0.0.1:35049
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:44.167379  4950 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:44.184754  4950 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:44.185710  4890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.61:44381: connect: Connection refused (error 111)
W20260812 08:01:44.186735  4950 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:44381: Network error: Client connection negotiation failed: client connection to 127.4.108.61:44381: connect: Connection refused (error 111)
I20260812 08:01:44.235991  4950 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } attempt: 1
W20260812 08:01:44.237826  4950 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:44381: Network error: Client connection negotiation failed: client connection to 127.4.108.61:44381: connect: Connection refused (error 111)
W20260812 08:01:44.277725  4951 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:44.277981  4951 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:44.278020  4951 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:44.281436  4951 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:44.281520  4951 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:44.281541  4951 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:44.281559  4951 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:44.285544  4951 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35049
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:44381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.108.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.4951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:44.286747  4951 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:44.287890  4951 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:44.293325  4960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:44.293325  4963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:44.293360  4959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:44.293598  4951 server_base.cc:1061] running on GCE node
I20260812 08:01:44.294157  4951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:44.295048  4951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:44.296234  4951 hybrid_clock.cc:648] HybridClock initialized: now 1786521704296219 us; error 27 us; skew 500 ppm
I20260812 08:01:44.298084  4951 webserver.cc:533] Webserver started at http://127.4.108.61:33989/ using document root <none> and password file <none>
I20260812 08:01:44.298738  4951 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:44.298802  4951 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:44.299063  4951 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:44.300611  4951 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/data/instance:
uuid: "b988f364c96347d4bec8bfb790f01aa2"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.301183  4951 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/wal/instance:
uuid: "b988f364c96347d4bec8bfb790f01aa2"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.304605  4951 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 08:01:44.306082  4950 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } attempt: 2
I20260812 08:01:44.306911  4973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260812 08:01:44.307651  4950 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:44381: Network error: Client connection negotiation failed: client connection to 127.4.108.61:44381: connect: Connection refused (error 111)
I20260812 08:01:44.308130  4951 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:44.308265  4951 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/wal
uuid: "b988f364c96347d4bec8bfb790f01aa2"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.308384  4951 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:44.321718  4951 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:44.322425  4951 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:44.322661  4951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:44.330926  5028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.61:44381 every 8 connection(s)
I20260812 08:01:44.330937  4951 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.61:44381
I20260812 08:01:44.332036  4951 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
I20260812 08:01:44.334760  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 4951
I20260812 08:01:44.334883  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-1/wal/instance
I20260812 08:01:44.335103  5030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:44.335690  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:42215
--webserver_interface=127.4.108.60
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--hive_metastore_uris=thrift://127.0.0.1:35049
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:44.338408  5030 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:44.347823  5030 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:44.353693  5030 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:44.354524  4977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.60:42215: connect: Connection refused (error 111)
W20260812 08:01:44.355396  5030 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:42215: Network error: Client connection negotiation failed: client connection to 127.4.108.60:42215: connect: Connection refused (error 111)
I20260812 08:01:44.398864  4950 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } attempt: 3
I20260812 08:01:44.403864  4950 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:44.404616  5030 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } attempt: 1
W20260812 08:01:44.405422  4950 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:42215: Network error: Client connection negotiation failed: client connection to 127.4.108.60:42215: connect: Connection refused (error 111)
W20260812 08:01:44.405916  5030 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:42215: Network error: Client connection negotiation failed: client connection to 127.4.108.60:42215: connect: Connection refused (error 111)
I20260812 08:01:44.436614  4950 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } attempt: 1
W20260812 08:01:44.438287  4950 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:42215: Network error: Client connection negotiation failed: client connection to 127.4.108.60:42215: connect: Connection refused (error 111)
W20260812 08:01:44.449100  5031 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:44.449339  5031 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:44.449378  5031 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:44.452771  5031 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:44.452834  5031 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:44.452855  5031 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:44.452873  5031 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:44.456892  5031 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35049
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:42215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.108.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.5031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:44.457993  5031 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:44.459197  5031 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:44.465190  5043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:44.465261  5041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:44.465242  5039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:44.465517  5031 server_base.cc:1061] running on GCE node
I20260812 08:01:44.465965  5031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:44.466926  5031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:44.468089  5031 hybrid_clock.cc:648] HybridClock initialized: now 1786521704468069 us; error 45 us; skew 500 ppm
I20260812 08:01:44.469921  5031 webserver.cc:533] Webserver started at http://127.4.108.60:41139/ using document root <none> and password file <none>
I20260812 08:01:44.470574  5031 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:44.470635  5031 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:44.470839  5031 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:44.472404  5031 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/data/instance:
uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.472990  5031 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/wal/instance:
uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.474083  5030 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } attempt: 2
W20260812 08:01:44.475570  5030 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:42215: Network error: Client connection negotiation failed: client connection to 127.4.108.60:42215: connect: Connection refused (error 111)
I20260812 08:01:44.476715  5031 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:44.478835  5051 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:44.479843  5031 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:44.479964  5031 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/wal
uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db"
format_stamp: "Formatted at 2026-08-12 08:01:44 on dist-test-slave-5l3k"
I20260812 08:01:44.480058  5031 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:44.494313  5031 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:44.495025  5031 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:44.495250  5031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:44.503163  5115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.60:42215 every 8 connection(s)
I20260812 08:01:44.503173  5031 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.60:42215
I20260812 08:01:44.504319  5031 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
I20260812 08:01:44.507356  5116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:44.510303  5116 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:44.512974  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 5031
I20260812 08:01:44.513134  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/master-2/wal/instance
I20260812 08:01:44.513463  4950 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } attempt: 2
I20260812 08:01:44.521104  5116 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:44.524624  4950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: Bootstrap starting.
I20260812 08:01:44.527940  4950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:44.528200  5116 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:44.529232  4950 log.cc:826] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:44.531661  4950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: No bootstrap required, opened a new log
I20260812 08:01:44.535245  5116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: Bootstrap starting.
I20260812 08:01:44.535611  4950 raft_consensus.cc:359] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.535797  4950 raft_consensus.cc:385] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:44.535847  4950 raft_consensus.cc:740] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 820525fb312a42aebba0a1494babf4eb, State: Initialized, Role: FOLLOWER
I20260812 08:01:44.536351  4950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.537335  5127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.537461  5127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:44.537719  4950 sys_catalog.cc:565] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:44.538017  5116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:44.538964  5116 log.cc:826] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:44.540994  5116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: No bootstrap required, opened a new log
W20260812 08:01:44.543412  5144 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:44.543515  5144 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:44.545763  5116 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.545972  5116 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:44.546096  5116 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bda8cd0e0874deb8030bd5ccaf9a9db, State: Initialized, Role: FOLLOWER
I20260812 08:01:44.546628  5116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.548202  5116 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:44.548615  4870 master_runner.cc:187] Error getting master registration for 127.4.108.61:44381: OK, instance_id { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" instance_seqno: 1786521704328755 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:44.551602  4870 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:44.555531  5031 master_runner.cc:187] Error getting master registration for 127.4.108.61:44381: OK, instance_id { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" instance_seqno: 1786521704328755 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:44.557819  5031 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:44.561256  5146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.562923  5146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:44.566722  5030 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } attempt: 3
W20260812 08:01:44.568055  5160 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:44.568200  5160 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:44.576546  5030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: Bootstrap starting.
I20260812 08:01:44.582424  5030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:44.583981  5030 log.cc:826] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:44.586644  5030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: No bootstrap required, opened a new log
I20260812 08:01:44.591460  5030 raft_consensus.cc:359] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.591735  5030 raft_consensus.cc:385] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:44.591849  5030 raft_consensus.cc:740] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b988f364c96347d4bec8bfb790f01aa2, State: Initialized, Role: FOLLOWER
I20260812 08:01:44.592453  5030 consensus_queue.cc:260] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.593952  5030 sys_catalog.cc:565] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:44.608830  4951 master_runner.cc:264] No leader master found from master b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:44.608920  4951 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:01:44.622604  5181 catalog_manager.cc:1594] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 08:01:44.622956  5166 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.624570  5166 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:01:44.624724  5181 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 08:01:44.652475  4893 tablet.cc:2406] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:44.746546  5057 tablet.cc:2406] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:44.824180  4980 tablet.cc:2406] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:44.872329  5166 raft_consensus.cc:493] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:44.872570  5166 raft_consensus.cc:515] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.873781  5166 leader_election.cc:290] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:44.874835  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b988f364c96347d4bec8bfb790f01aa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
I20260812 08:01:44.875190  5083 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b988f364c96347d4bec8bfb790f01aa2 in term 0.
I20260812 08:01:44.875828  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b988f364c96347d4bec8bfb790f01aa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb" is_pre_election: true
I20260812 08:01:44.876098  4919 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b988f364c96347d4bec8bfb790f01aa2 in term 0.
I20260812 08:01:44.876833  4977 leader_election.cc:304] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2; no voters: 
I20260812 08:01:44.877462  5166 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:44.877552  5166 raft_consensus.cc:493] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:44.877600  5166 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:44.878930  5166 raft_consensus.cc:515] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.879359  5166 leader_election.cc:290] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [CANDIDATE]: Term 1 election: Requested vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:44.880187  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b988f364c96347d4bec8bfb790f01aa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb"
I20260812 08:01:44.880316  4919 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:44.881464  4919 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b988f364c96347d4bec8bfb790f01aa2 in term 1.
I20260812 08:01:44.881928  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b988f364c96347d4bec8bfb790f01aa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db"
I20260812 08:01:44.882088  5083 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:44.882671  4977 leader_election.cc:304] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb, b988f364c96347d4bec8bfb790f01aa2; no voters: 
I20260812 08:01:44.883703  5083 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b988f364c96347d4bec8bfb790f01aa2 in term 1.
I20260812 08:01:44.886798  5166 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:44.887048  5166 raft_consensus.cc:697] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 1 LEADER]: Becoming Leader. State: Replica: b988f364c96347d4bec8bfb790f01aa2, State: Running, Role: LEADER
I20260812 08:01:44.887413  5166 consensus_queue.cc:237] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:44.889262  5166 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b988f364c96347d4bec8bfb790f01aa2. Latest consensus state: current_term: 1 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.889412  5166 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:44.889820  5189 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:44.891249  5189 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:44.898986  5083 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 1 FOLLOWER]: Refusing update from remote peer b988f364c96347d4bec8bfb790f01aa2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:44.899029  4919 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 1 FOLLOWER]: Refusing update from remote peer b988f364c96347d4bec8bfb790f01aa2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:44.899765  5185 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:44.899906  5166 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:44.903899  5146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: SysCatalogTable state changed. Reason: New leader b988f364c96347d4bec8bfb790f01aa2. Latest consensus state: current_term: 1 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.904028  5146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:44.904484  5127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b988f364c96347d4bec8bfb790f01aa2. Latest consensus state: current_term: 1 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.904627  5127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:44.908298  5185 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.908442  5185 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:44.908584  5185 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.908666  5185 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:44.908771  5191 mvcc.cc:204] Tried to move back new op lower bound from 7317592903258861568 to 7317592903222587392. Current Snapshot: MvccSnapshot[applied={T|T < 7317592903258861568}]
I20260812 08:01:44.908748  5127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.908852  5127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:44.909785  5146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:44.909924  5146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:44.910696  5189 catalog_manager.cc:1383] Generated new cluster ID: faa1ac88f02a46a88574e69fc006b62b
I20260812 08:01:44.910754  5189 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:44.914031  5194 mvcc.cc:204] Tried to move back new op lower bound from 7317592903258861568 to 7317592903222587392. Current Snapshot: MvccSnapshot[applied={T|T < 7317592903258861568 or (T in {7317592903258861568})}]
I20260812 08:01:44.914271  5193 mvcc.cc:204] Tried to move back new op lower bound from 7317592903258861568 to 7317592903222587392. Current Snapshot: MvccSnapshot[applied={T|T < 7317592903258861568 or (T in {7317592903258861568})}]
I20260812 08:01:44.938778  5189 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:44.940021  5189 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:44.955818  5189 catalog_manager.cc:6092] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: Generated new TSK 0
I20260812 08:01:44.956688  5189 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:44.957170  5189 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:01:44.957473  5189 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:01:44.975281  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.1:0
--local_ip_for_outbound_sockets=127.4.108.1
--webserver_interface=127.4.108.1
--webserver_port=0
--tserver_master_addrs=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--builtin_ntp_servers=127.4.108.20:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:01:45.115077  5203 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:45.115342  5203 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:45.115424  5203 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:45.119244  5203 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:45.119419  5203 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.1
I20260812 08:01:45.123829  5203 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.108.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--never_fsync=true
--heap_profile_path=/tmp/kudu.5203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:45.125073  5203 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:45.126259  5203 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:45.133450  5210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:45.133441  5212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:45.133610  5203 server_base.cc:1061] running on GCE node
W20260812 08:01:45.133476  5214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:45.134199  5203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:45.134905  5203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:45.136125  5203 hybrid_clock.cc:648] HybridClock initialized: now 1786521705136095 us; error 40 us; skew 500 ppm
I20260812 08:01:45.137982  5203 webserver.cc:533] Webserver started at http://127.4.108.1:34119/ using document root <none> and password file <none>
I20260812 08:01:45.138653  5203 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:45.138739  5203 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:45.138959  5203 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:45.140663  5203 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/data/instance:
uuid: "e5c3cb56b30e46f0afbe2a606b6fd357"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.141178  5203 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/wal/instance:
uuid: "e5c3cb56b30e46f0afbe2a606b6fd357"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.144825  5203 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.002s
I20260812 08:01:45.147217  5221 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.148370  5203 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:01:45.148507  5203 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
uuid: "e5c3cb56b30e46f0afbe2a606b6fd357"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.148625  5203 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:45.158906  5203 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:45.159691  5203 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:45.159886  5203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:45.160554  5203 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:45.161875  5203 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:45.161932  5203 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.161983  5203 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:45.162077  5203 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.176749  5203 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.1:43359
I20260812 08:01:45.176788  5360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.1:43359 every 8 connection(s)
I20260812 08:01:45.178117  5203 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:45.182647  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 5203
I20260812 08:01:45.182782  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:45.185431  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.2:0
--local_ip_for_outbound_sockets=127.4.108.2
--webserver_interface=127.4.108.2
--webserver_port=0
--tserver_master_addrs=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--builtin_ntp_servers=127.4.108.20:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:45.188690  5362 heartbeater.cc:344] Connected to a master server at 127.4.108.60:42215
I20260812 08:01:45.188733  5361 heartbeater.cc:344] Connected to a master server at 127.4.108.62:43965
I20260812 08:01:45.188956  5361 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.188956  5362 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.189541  5361 heartbeater.cc:507] Master 127.4.108.62:43965 requested a full tablet report, sending...
I20260812 08:01:45.189539  5362 heartbeater.cc:507] Master 127.4.108.60:42215 requested a full tablet report, sending...
I20260812 08:01:45.191218  5072 ts_manager.cc:194] Registered new tserver with Master: e5c3cb56b30e46f0afbe2a606b6fd357 (127.4.108.1:43359)
I20260812 08:01:45.191218  4906 ts_manager.cc:194] Registered new tserver with Master: e5c3cb56b30e46f0afbe2a606b6fd357 (127.4.108.1:43359)
I20260812 08:01:45.192114  5363 heartbeater.cc:344] Connected to a master server at 127.4.108.61:44381
I20260812 08:01:45.192207  5363 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.192412  5363 heartbeater.cc:507] Master 127.4.108.61:44381 requested a full tablet report, sending...
I20260812 08:01:45.193460  4992 ts_manager.cc:194] Registered new tserver with Master: e5c3cb56b30e46f0afbe2a606b6fd357 (127.4.108.1:43359)
I20260812 08:01:45.194694  4992 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.1:57439
W20260812 08:01:45.315900  5372 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:45.316121  5372 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:45.316175  5372 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:45.319607  5372 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:45.319736  5372 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.2
I20260812 08:01:45.323803  5372 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.108.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--never_fsync=true
--heap_profile_path=/tmp/kudu.5372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:45.324973  5372 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:45.326261  5372 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:45.333163  5380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:45.333295  5381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:45.333498  5383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:45.333812  5372 server_base.cc:1061] running on GCE node
I20260812 08:01:45.334242  5372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:45.334972  5372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:45.336155  5372 hybrid_clock.cc:648] HybridClock initialized: now 1786521705336125 us; error 46 us; skew 500 ppm
I20260812 08:01:45.338173  5372 webserver.cc:533] Webserver started at http://127.4.108.2:36329/ using document root <none> and password file <none>
I20260812 08:01:45.338847  5372 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:45.338935  5372 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:45.339166  5372 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:45.340852  5372 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/data/instance:
uuid: "bd534ded0f3e4e998f9c4a78735bed31"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.341470  5372 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/wal/instance:
uuid: "bd534ded0f3e4e998f9c4a78735bed31"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.345230  5372 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.006s
I20260812 08:01:45.347536  5390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.348639  5372 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:45.348786  5372 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
uuid: "bd534ded0f3e4e998f9c4a78735bed31"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.348894  5372 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:45.372814  5372 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:45.373899  5372 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:45.374118  5372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:45.374827  5372 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:45.375972  5372 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:45.376048  5372 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.376122  5372 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:45.376178  5372 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.387862  5372 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.2:35479
I20260812 08:01:45.387997  5521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.2:35479 every 8 connection(s)
I20260812 08:01:45.388953  5372 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:45.395967  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 5372
I20260812 08:01:45.396106  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:45.399480  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.3:0
--local_ip_for_outbound_sockets=127.4.108.3
--webserver_interface=127.4.108.3
--webserver_port=0
--tserver_master_addrs=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--builtin_ntp_servers=127.4.108.20:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:45.399824  5525 heartbeater.cc:344] Connected to a master server at 127.4.108.61:44381
I20260812 08:01:45.399834  5524 heartbeater.cc:344] Connected to a master server at 127.4.108.60:42215
I20260812 08:01:45.400089  5524 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.400091  5525 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.400660  5524 heartbeater.cc:507] Master 127.4.108.60:42215 requested a full tablet report, sending...
I20260812 08:01:45.400660  5525 heartbeater.cc:507] Master 127.4.108.61:44381 requested a full tablet report, sending...
I20260812 08:01:45.401909  5072 ts_manager.cc:194] Registered new tserver with Master: bd534ded0f3e4e998f9c4a78735bed31 (127.4.108.2:35479)
I20260812 08:01:45.401922  4992 ts_manager.cc:194] Registered new tserver with Master: bd534ded0f3e4e998f9c4a78735bed31 (127.4.108.2:35479)
I20260812 08:01:45.402725  4992 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.2:46903
I20260812 08:01:45.403936  5523 heartbeater.cc:344] Connected to a master server at 127.4.108.62:43965
I20260812 08:01:45.404034  5523 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.404179  5523 heartbeater.cc:507] Master 127.4.108.62:43965 requested a full tablet report, sending...
I20260812 08:01:45.404853  4906 ts_manager.cc:194] Registered new tserver with Master: bd534ded0f3e4e998f9c4a78735bed31 (127.4.108.2:35479)
I20260812 08:01:45.456831  5532 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b988f364c96347d4bec8bfb790f01aa2)
I20260812 08:01:45.456874  5533 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b988f364c96347d4bec8bfb790f01aa2)
I20260812 08:01:45.457019  5533 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:45.457099  5532 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:45.458071  5533 leader_election.cc:290] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381)
I20260812 08:01:45.458639  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb" is_pre_election: true
I20260812 08:01:45.458642  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:01:45.458789  4919 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in term 1.
I20260812 08:01:45.459057  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
I20260812 08:01:45.459087  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:01:45.459197  5083 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 1.
I20260812 08:01:45.459245  5054 leader_election.cc:304] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, 820525fb312a42aebba0a1494babf4eb; no voters: 
I20260812 08:01:45.459583  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, 820525fb312a42aebba0a1494babf4eb; no voters: 
I20260812 08:01:45.459834  5533 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:45.459893  5533 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 1 FOLLOWER]: Starting leader election (detected failure of leader b988f364c96347d4bec8bfb790f01aa2)
I20260812 08:01:45.459930  5533 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:45.460091  5536 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:45.460209  5536 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b988f364c96347d4bec8bfb790f01aa2)
I20260812 08:01:45.460320  5536 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:45.460494  5532 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:45.461174  5533 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:45.461287  5536 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:45.461614  5533 leader_election.cc:290] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 2 election: Requested vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381)
I20260812 08:01:45.461972  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb"
I20260812 08:01:45.462174  5536 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 2 election: Requested vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:45.462138  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2"
I20260812 08:01:45.462147  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2"
I20260812 08:01:45.462579  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db"
I20260812 08:01:45.462752  5083 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 820525fb312a42aebba0a1494babf4eb in current term 2: Already voted for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in this term.
I20260812 08:01:45.462803  5054 leader_election.cc:304] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db; no voters: 820525fb312a42aebba0a1494babf4eb, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:45.463048  5533 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 08:01:45.463025  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:45.463222  5536 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 08:01:45.488628  5083 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 2 FOLLOWER]: Rejecting Update request from peer b988f364c96347d4bec8bfb790f01aa2 for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:45.489229  5535 consensus_queue.cc:1059] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:01:45.489609  5538 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:01:45.489681  5538 raft_consensus.cc:740] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b988f364c96347d4bec8bfb790f01aa2, State: Running, Role: LEADER
I20260812 08:01:45.489899  5538 consensus_queue.cc:260] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:45.490190  5538 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 1 FOLLOWER]: Advancing to term 2
W20260812 08:01:45.532771  5531 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:45.533026  5531 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:45.533113  5531 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:45.536801  5531 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:45.537009  5531 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.3
I20260812 08:01:45.541567  5531 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.108.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:43965,127.4.108.61:44381,127.4.108.60:42215
--never_fsync=true
--heap_profile_path=/tmp/kudu.5531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:45.542898  5531 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:45.544080  5531 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 08:01:45.544776  5144 catalog_manager.cc:1295] Loaded cluster ID: faa1ac88f02a46a88574e69fc006b62b
I20260812 08:01:45.544833  5144 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: loading cluster ID for follower catalog manager: success
I20260812 08:01:45.546419  5144 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: acquiring CA information for follower catalog manager: success
I20260812 08:01:45.547420  5144 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 08:01:45.551101  5546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:45.551110  5543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:45.551112  5544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:45.551426  5531 server_base.cc:1061] running on GCE node
I20260812 08:01:45.551806  5531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:45.552378  5531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:45.553526  5531 hybrid_clock.cc:648] HybridClock initialized: now 1786521705553510 us; error 31 us; skew 500 ppm
I20260812 08:01:45.555424  5531 webserver.cc:533] Webserver started at http://127.4.108.3:34689/ using document root <none> and password file <none>
I20260812 08:01:45.555982  5531 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:45.556035  5531 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:45.556255  5531 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:45.558503  5531 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/data/instance:
uuid: "bccc6ed3f2ca41489a714b1a5624055f"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.559224  5531 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/wal/instance:
uuid: "bccc6ed3f2ca41489a714b1a5624055f"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.564500  5531 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:01:45.567515  5554 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.568760  5531 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:45.568909  5531 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
uuid: "bccc6ed3f2ca41489a714b1a5624055f"
format_stamp: "Formatted at 2026-08-12 08:01:45 on dist-test-slave-5l3k"
I20260812 08:01:45.569018  5531 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:45.569643  5160 catalog_manager.cc:1295] Loaded cluster ID: faa1ac88f02a46a88574e69fc006b62b
I20260812 08:01:45.569703  5160 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: loading cluster ID for follower catalog manager: success
I20260812 08:01:45.571372  5160 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: acquiring CA information for follower catalog manager: success
I20260812 08:01:45.572474  5160 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:45.604183  5531 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:45.605010  5531 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:45.605254  5531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:45.605906  5531 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:45.607153  5531 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:45.607236  5531 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.607326  5531 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:45.607383  5531 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:45.619804  5531 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.3:40357
I20260812 08:01:45.619840  5692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.3:40357 every 8 connection(s)
I20260812 08:01:45.620970  5531 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:45.626220  5181 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:45.630409  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 5531
I20260812 08:01:45.630571  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestPauseAfterCreateTableIssued_1.1786521687308489-4528-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:45.631188  5695 heartbeater.cc:344] Connected to a master server at 127.4.108.61:44381
I20260812 08:01:45.631321  5693 heartbeater.cc:344] Connected to a master server at 127.4.108.62:43965
I20260812 08:01:45.631448  5693 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.631449  5695 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.632107  5695 heartbeater.cc:507] Master 127.4.108.61:44381 requested a full tablet report, sending...
I20260812 08:01:45.632737  5694 heartbeater.cc:344] Connected to a master server at 127.4.108.60:42215
I20260812 08:01:45.632809  5694 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:45.633013  5694 heartbeater.cc:507] Master 127.4.108.60:42215 requested a full tablet report, sending...
I20260812 08:01:45.632107  5693 heartbeater.cc:507] Master 127.4.108.62:43965 requested a full tablet report, sending...
I20260812 08:01:45.633431  4991 ts_manager.cc:194] Registered new tserver with Master: bccc6ed3f2ca41489a714b1a5624055f (127.4.108.3:40357)
I20260812 08:01:45.633899  5072 ts_manager.cc:194] Registered new tserver with Master: bccc6ed3f2ca41489a714b1a5624055f (127.4.108.3:40357)
I20260812 08:01:45.634372  4906 ts_manager.cc:194] Registered new tserver with Master: bccc6ed3f2ca41489a714b1a5624055f (127.4.108.3:40357)
I20260812 08:01:45.637923  4528 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:45.696997  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:45.904728  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:45.946265  5538 raft_consensus.cc:493] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:45.946523  5538 raft_consensus.cc:515] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:45.947166  5538 leader_election.cc:290] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:45.947811  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b988f364c96347d4bec8bfb790f01aa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb" is_pre_election: true
I20260812 08:01:45.947810  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b988f364c96347d4bec8bfb790f01aa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
I20260812 08:01:45.947981  5083 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b988f364c96347d4bec8bfb790f01aa2 in term 2.
I20260812 08:01:45.948439  4977 leader_election.cc:304] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2; no voters: 820525fb312a42aebba0a1494babf4eb
I20260812 08:01:45.948642  5538 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:01:45.948709  5538 raft_consensus.cc:493] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:45.948747  5538 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:45.949940  5538 raft_consensus.cc:515] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:45.950549  5538 leader_election.cc:290] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [CANDIDATE]: Term 3 election: Requested vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:45.950963  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b988f364c96347d4bec8bfb790f01aa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb"
I20260812 08:01:45.951261  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b988f364c96347d4bec8bfb790f01aa2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db"
I20260812 08:01:45.951414  5083 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:45.952409  5083 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b988f364c96347d4bec8bfb790f01aa2 in term 3.
I20260812 08:01:45.952780  4977 leader_election.cc:304] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2; no voters: 820525fb312a42aebba0a1494babf4eb
I20260812 08:01:45.952966  5538 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:01:45.953073  5538 raft_consensus.cc:697] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 3 LEADER]: Becoming Leader. State: Replica: b988f364c96347d4bec8bfb790f01aa2, State: Running, Role: LEADER
I20260812 08:01:45.953253  5538 consensus_queue.cc:237] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:45.953955  5535 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b988f364c96347d4bec8bfb790f01aa2. Latest consensus state: current_term: 3 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:45.954082  5535 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:45.954382  5711 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:45.955207  5711 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:45.955688  5711 catalog_manager.cc:1295] Loaded cluster ID: faa1ac88f02a46a88574e69fc006b62b
I20260812 08:01:45.955736  5711 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:45.956533  5711 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:45.956954  5711 catalog_manager.cc:6103] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2: Loaded TSK: 0
I20260812 08:01:45.957343  5711 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:45.957665  5711 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:01:45.957960  5711 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:01:45.969702  4991 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49006:
name: "default.test_pause_after_create_table_issued"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:46.012936  4991 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_pause_after_create_table_issued in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:46.104122  5712 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:46.104287  5712 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:46.105365  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:01:46.105798  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
I20260812 08:01:46.105979  5083 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 820525fb312a42aebba0a1494babf4eb in current term 3: Already voted for candidate b988f364c96347d4bec8bfb790f01aa2 in this term.
I20260812 08:01:46.106405  5712 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:46.106595  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:46.106807  5712 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:46.108000  5712 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:01:46.137255  4992 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.3:36437
I20260812 08:01:46.478374  4991 catalog_manager.cc:2200] created HMS catalog entry for table  [id=719147087ed84e70887390bde25ba704]
I20260812 08:01:46.481552  5083 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Refusing update from remote peer b988f364c96347d4bec8bfb790f01aa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260812 08:01:46.481600  4919 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 3 FOLLOWER]: Refusing update from remote peer b988f364c96347d4bec8bfb790f01aa2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260812 08:01:46.482188  5717 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:01:46.482448  5719 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:01:46.484102  5712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b988f364c96347d4bec8bfb790f01aa2. Latest consensus state: current_term: 3 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:46.484233  5712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:46.484452  5720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: SysCatalogTable state changed. Reason: New leader b988f364c96347d4bec8bfb790f01aa2. Latest consensus state: current_term: 3 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:46.484571  5720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:46.485841  5719 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:46.485984  5719 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:46.486402  5720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:46.486557  5720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:46.488729  4528 master_failover-itest.cc:212] Pausing leader master
I20260812 08:01:46.491972  5712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:46.492138  5712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:46.494325  5719 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b988f364c96347d4bec8bfb790f01aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:46.494465  5719 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:46.639611  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:46.700242  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:46.908617  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:46.997328  5735 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b988f364c96347d4bec8bfb790f01aa2)
I20260812 08:01:46.997478  5735 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:46.997650  5737 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b988f364c96347d4bec8bfb790f01aa2)
I20260812 08:01:46.997838  5737 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:46.998366  5735 leader_election.cc:290] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381)
I20260812 08:01:46.998425  5737 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:46.998867  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb" is_pre_election: true
I20260812 08:01:46.999037  4919 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in term 3.
I20260812 08:01:46.998981  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
I20260812 08:01:46.999162  5083 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 3.
I20260812 08:01:46.999480  5054 leader_election.cc:304] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, 820525fb312a42aebba0a1494babf4eb; no voters: 
I20260812 08:01:46.999567  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, 820525fb312a42aebba0a1494babf4eb; no voters: 
I20260812 08:01:46.999747  5735 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:01:46.999787  5737 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:01:46.999818  5735 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Starting leader election (detected failure of leader b988f364c96347d4bec8bfb790f01aa2)
I20260812 08:01:46.999842  5737 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 3 FOLLOWER]: Starting leader election (detected failure of leader b988f364c96347d4bec8bfb790f01aa2)
I20260812 08:01:46.999868  5735 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:46.999891  5737 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:47.001046  5737 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:47.001049  5735 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:47.001454  5735 leader_election.cc:290] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 4 election: Requested vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381)
I20260812 08:01:47.001775  5737 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 4 election: Requested vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:47.001868  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb"
I20260812 08:01:47.002096  4919 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in current term 4: Already voted for candidate 820525fb312a42aebba0a1494babf4eb in this term.
I20260812 08:01:47.002170  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db"
I20260812 08:01:47.002312  5083 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 820525fb312a42aebba0a1494babf4eb in current term 4: Already voted for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in this term.
W20260812 08:01:47.555181  5054 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.555s (SENT)
W20260812 08:01:47.641131  5695 heartbeater.cc:646] Failed to heartbeat to 127.4.108.61:44381 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.108.61:44381 timed out after 1.000s (SENT)
W20260812 08:01:47.702144  5363 heartbeater.cc:646] Failed to heartbeat to 127.4.108.61:44381 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.108.61:44381 timed out after 1.000s (SENT)
W20260812 08:01:47.910521  5525 heartbeater.cc:646] Failed to heartbeat to 127.4.108.61:44381 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.108.61:44381 timed out after 1.000s (SENT)
W20260812 08:01:48.012254  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.505s (SENT)
W20260812 08:01:48.112756  5054 leader_election.cc:336] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.555s (SENT)
I20260812 08:01:48.141530  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
W20260812 08:01:48.185415  5054 leader_election.cc:336] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.591s (SENT)
I20260812 08:01:48.185525  5054 leader_election.cc:304] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db; no voters: 820525fb312a42aebba0a1494babf4eb, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:48.185942  5741 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 08:01:48.202462  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:48.410950  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
W20260812 08:01:48.500032  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.748s (SENT)
I20260812 08:01:48.500169  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:48.500557  5742 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 08:01:48.799379  5743 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:48.799546  5743 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:48.799996  5743 leader_election.cc:290] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381)
I20260812 08:01:48.800663  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 5 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb" is_pre_election: true
I20260812 08:01:48.800834  4919 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in term 4.
I20260812 08:01:48.801211  5054 leader_election.cc:304] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, 820525fb312a42aebba0a1494babf4eb; no voters: 
I20260812 08:01:48.801460  5743 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 08:01:48.801522  5743 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:48.801550  5743 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:01:48.802619  5743 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:48.803025  5743 leader_election.cc:290] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 5 election: Requested vote from peers 820525fb312a42aebba0a1494babf4eb (127.4.108.62:43965), b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381)
I20260812 08:01:48.803540  4919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 5 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "820525fb312a42aebba0a1494babf4eb"
I20260812 08:01:48.803658  4919 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:01:48.804451  4919 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in term 5.
I20260812 08:01:48.804833  5054 leader_election.cc:304] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, 820525fb312a42aebba0a1494babf4eb; no voters: 
I20260812 08:01:48.805073  5743 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 5 FOLLOWER]: Leader election won for term 5
I20260812 08:01:48.805303  5743 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [term 5 LEADER]: Becoming Leader. State: Replica: 6bda8cd0e0874deb8030bd5ccaf9a9db, State: Running, Role: LEADER
I20260812 08:01:48.805627  5743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:48.807011  5745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bda8cd0e0874deb8030bd5ccaf9a9db. Latest consensus state: current_term: 5 leader_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:48.807149  5745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:49.253604  4919 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Refusing update from remote peer 6bda8cd0e0874deb8030bd5ccaf9a9db: Log matching property violated. Preceding OpId in replica: term: 3 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260812 08:01:49.254374  5745 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [LEADER]: Connected to new peer: Peer: permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:49.255810  5749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bda8cd0e0874deb8030bd5ccaf9a9db. Latest consensus state: current_term: 5 leader_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:49.255954  5749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:49.257500  5743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:49.257637  5743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:49.257680  5749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:01:49.257826  5749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:49.323876  5747 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:49.325644  5747 catalog_manager.cc:679] Loaded metadata for table default.test_pause_after_create_table_issued [id=719147087ed84e70887390bde25ba704]
I20260812 08:01:49.326777  5747 tablet_loader.cc:96] loaded metadata for tablet 5638a737001f4ac5b22bf063c244162a (table default.test_pause_after_create_table_issued [id=719147087ed84e70887390bde25ba704])
I20260812 08:01:49.326947  5747 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:49.327382  5747 catalog_manager.cc:1295] Loaded cluster ID: faa1ac88f02a46a88574e69fc006b62b
I20260812 08:01:49.327431  5747 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:49.328056  5747 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:49.328478  5747 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: Loaded TSK: 0
I20260812 08:01:49.329098  5747 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:49.329519  5747 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:01:49.329880  5747 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:01:49.643558  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:49.704571  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:49.758049  5749 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:01:49.758242  5749 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:49.758893  5749 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:49.759505  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
I20260812 08:01:49.912568  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:49.917240  5524 heartbeater.cc:499] Master 127.4.108.60:42215 was elected leader, sending a full tablet report...
I20260812 08:01:50.148543  5694 heartbeater.cc:499] Master 127.4.108.60:42215 was elected leader, sending a full tablet report...
I20260812 08:01:50.208735  5362 heartbeater.cc:499] Master 127.4.108.60:42215 was elected leader, sending a full tablet report...
W20260812 08:01:50.373507  4890 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.613s (SENT) [suppressed 6 similar messages]
W20260812 08:01:50.448632  5054 leader_election.cc:336] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.823s (SENT)
W20260812 08:01:50.506362  5054 leader_election.cc:336] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.850s (SENT)
W20260812 08:01:50.988869  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.613s (SENT)
I20260812 08:01:50.989055  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:50.989557  5760 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:51.145890  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:51.206928  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:51.414069  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:52.647519  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:52.681885  5766 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:01:52.682133  5766 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:52.682746  5766 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:52.683360  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
I20260812 08:01:52.708650  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:52.915549  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
W20260812 08:01:54.020973  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.668s (SENT)
I20260812 08:01:54.021102  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:54.021592  5772 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:54.149643  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:54.210294  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:54.417343  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:54.699734  5773 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:01:54.699883  5773 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:54.700459  5773 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:54.701100  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:01:55.391032  4890 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.689s (SENT) [suppressed 1 similar messages]
I20260812 08:01:55.651892  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:55.711824  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:55.919269  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
W20260812 08:01:56.081514  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.689s (SENT)
I20260812 08:01:56.081641  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:56.082118  5778 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 08:01:56.510349  5704 master_proxy_rpc.cc:203] Re-attempting IsCreateTableDone request to leader Master (127.4.108.61:44381)
I20260812 08:01:57.153508  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:57.214025  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:57.421129  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:57.872812  5779 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:01:57.872961  5779 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:01:57.873616  5779 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:01:57.874321  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
I20260812 08:01:58.655444  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:58.715881  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:01:58.923252  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
W20260812 08:01:59.190850  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.657s (SENT)
I20260812 08:01:59.190960  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:01:59.191394  5784 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:00.157634  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:02:00.218093  5363 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:02:00.425581  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:02:00.481446  5793 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:00.481606  5793 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:00.482267  5793 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:00.482924  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:01.028879  4890 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.545s (SENT) [suppressed 1 similar messages]
W20260812 08:02:01.576508  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.545s (SENT)
I20260812 08:02:01.576632  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:01.577064  5797 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:02.305748  5798 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:02.305966  5798 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:02.306564  5798 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:02.307142  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:03.719867  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.705s (SENT)
I20260812 08:02:03.720075  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:03.720518  5804 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:04.952450  5806 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:04.952630  5806 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:04.953136  5806 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:04.953900  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:06.271311  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.658s (SENT)
I20260812 08:02:06.271428  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:06.271757  5811 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:07.411298  5812 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:07.411501  5812 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:07.412112  5812 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:07.412783  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:08.100260  4890 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.687s (SENT) [suppressed 2 similar messages]
W20260812 08:02:08.788823  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.687s (SENT)
I20260812 08:02:08.788970  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:08.789466  5816 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:09.450476  5818 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:09.450718  5818 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:09.451193  5818 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:09.451778  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:10.848377  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.697s (SENT)
I20260812 08:02:10.848531  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:10.849046  5824 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:11.583323  5827 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:11.583464  5827 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:11.583997  5827 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:11.584627  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:12.837975  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.626s (SENT)
I20260812 08:02:12.838114  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:12.838593  5832 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:14.265105  5834 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:14.265354  5834 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:14.265906  5834 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:14.266700  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:14.899696  4890 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.632s (SENT) [suppressed 2 similar messages]
W20260812 08:02:15.534063  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.632s (SENT)
I20260812 08:02:15.534191  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:15.534629  5838 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:17.198246  5839 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:17.198446  5839 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:17.199126  5839 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:17.199755  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:18.338833  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.568s (SENT)
I20260812 08:02:18.338961  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:18.339565  5843 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:19.106940  5844 raft_consensus.cc:493] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bda8cd0e0874deb8030bd5ccaf9a9db)
I20260812 08:02:19.107090  5844 raft_consensus.cc:515] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:19.107668  5844 leader_election.cc:290] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381), 6bda8cd0e0874deb8030bd5ccaf9a9db (127.4.108.60:42215)
I20260812 08:02:19.108397  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" is_pre_election: true
W20260812 08:02:19.258623  5054 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.4.108.61:44381 timed out after 30.000s (SENT) [suppressed 3 similar messages]
W20260812 08:02:19.586301  5160 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: Tablet 5638a737001f4ac5b22bf063c244162a (table default.test_pause_after_create_table_issued [id=719147087ed84e70887390bde25ba704]) was not created within the allowed timeout. Replacing with a new tablet 64ce93d7ca6a4d72a3c5554375a2d76c
I20260812 08:02:19.593006  5160 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db: Sending DeleteTablet for 3 replicas of tablet 5638a737001f4ac5b22bf063c244162a
I20260812 08:02:19.600508  5447 tablet_service.cc:1558] Processing DeleteTablet for tablet 5638a737001f4ac5b22bf063c244162a with delete_type TABLET_DATA_DELETED (Replaced by 64ce93d7ca6a4d72a3c5554375a2d76c at 2026-08-12 08:02:19 UTC) from {username='slave'} at 127.0.0.1:35784
I20260812 08:02:19.601004  5614 tablet_service.cc:1558] Processing DeleteTablet for tablet 5638a737001f4ac5b22bf063c244162a with delete_type TABLET_DATA_DELETED (Replaced by 64ce93d7ca6a4d72a3c5554375a2d76c at 2026-08-12 08:02:19 UTC) from {username='slave'} at 127.0.0.1:35052
I20260812 08:02:19.602815  5446 tablet_service.cc:1511] Processing CreateTablet for tablet 64ce93d7ca6a4d72a3c5554375a2d76c (DEFAULT_TABLE table=default.test_pause_after_create_table_issued [id=719147087ed84e70887390bde25ba704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:19.603318  5613 tablet_service.cc:1511] Processing CreateTablet for tablet 64ce93d7ca6a4d72a3c5554375a2d76c (DEFAULT_TABLE table=default.test_pause_after_create_table_issued [id=719147087ed84e70887390bde25ba704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:19.603896  5446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ce93d7ca6a4d72a3c5554375a2d76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:19.604195  5613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ce93d7ca6a4d72a3c5554375a2d76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:19.604750  5279 tablet_service.cc:1511] Processing CreateTablet for tablet 64ce93d7ca6a4d72a3c5554375a2d76c (DEFAULT_TABLE table=default.test_pause_after_create_table_issued [id=719147087ed84e70887390bde25ba704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:19.605522  5279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ce93d7ca6a4d72a3c5554375a2d76c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 08:02:19.606946  5055 catalog_manager.cc:5017] TS bd534ded0f3e4e998f9c4a78735bed31 (127.4.108.2:35479): delete failed for tablet 5638a737001f4ac5b22bf063c244162a because the tablet was not found. No further retry: Not found: Tablet not found: 5638a737001f4ac5b22bf063c244162a
W20260812 08:02:19.607210  5054 catalog_manager.cc:5017] TS bccc6ed3f2ca41489a714b1a5624055f (127.4.108.3:40357): delete failed for tablet 5638a737001f4ac5b22bf063c244162a because the tablet was not found. No further retry: Not found: Tablet not found: 5638a737001f4ac5b22bf063c244162a
I20260812 08:02:19.607366  5282 tablet_service.cc:1558] Processing DeleteTablet for tablet 5638a737001f4ac5b22bf063c244162a with delete_type TABLET_DATA_DELETED (Replaced by 64ce93d7ca6a4d72a3c5554375a2d76c at 2026-08-12 08:02:19 UTC) from {username='slave'} at 127.0.0.1:41500
I20260812 08:02:19.610596  5868 tablet_bootstrap.cc:492] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f: Bootstrap starting.
I20260812 08:02:19.611111  5870 tablet_bootstrap.cc:492] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31: Bootstrap starting.
W20260812 08:02:19.611279  5053 catalog_manager.cc:5017] TS e5c3cb56b30e46f0afbe2a606b6fd357 (127.4.108.1:43359): delete failed for tablet 5638a737001f4ac5b22bf063c244162a because the tablet was not found. No further retry: Not found: Tablet not found: 5638a737001f4ac5b22bf063c244162a
I20260812 08:02:19.611364  5871 tablet_bootstrap.cc:492] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357: Bootstrap starting.
I20260812 08:02:19.613313  5868 tablet_bootstrap.cc:654] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:19.613458  5870 tablet_bootstrap.cc:654] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:19.613458  5871 tablet_bootstrap.cc:654] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:19.614193  5868 log.cc:826] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:19.614265  5870 log.cc:826] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:19.614265  5871 log.cc:826] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:19.616071  5871 tablet_bootstrap.cc:492] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357: No bootstrap required, opened a new log
I20260812 08:02:19.616074  5868 tablet_bootstrap.cc:492] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f: No bootstrap required, opened a new log
I20260812 08:02:19.616074  5870 tablet_bootstrap.cc:492] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31: No bootstrap required, opened a new log
I20260812 08:02:19.616313  5870 ts_tablet_manager.cc:1403] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:19.616313  5868 ts_tablet_manager.cc:1403] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:19.616317  5871 ts_tablet_manager.cc:1403] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:19.619732  5871 raft_consensus.cc:359] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:19.619987  5871 raft_consensus.cc:385] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:19.619979  5868 raft_consensus.cc:359] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:19.620078  5871 raft_consensus.cc:740] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c3cb56b30e46f0afbe2a606b6fd357, State: Initialized, Role: FOLLOWER
I20260812 08:02:19.620151  5868 raft_consensus.cc:385] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:19.620342  5868 raft_consensus.cc:740] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bccc6ed3f2ca41489a714b1a5624055f, State: Initialized, Role: FOLLOWER
I20260812 08:02:19.620638  5871 consensus_queue.cc:260] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:19.620851  5868 consensus_queue.cc:260] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:19.621605  5871 ts_tablet_manager.cc:1434] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:02:19.621729  5868 ts_tablet_manager.cc:1434] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260812 08:02:19.621941  5870 raft_consensus.cc:359] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:19.622166  5870 raft_consensus.cc:385] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:19.622251  5870 raft_consensus.cc:740] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd534ded0f3e4e998f9c4a78735bed31, State: Initialized, Role: FOLLOWER
I20260812 08:02:19.622726  5870 consensus_queue.cc:260] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:19.623708  5870 ts_tablet_manager.cc:1434] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260812 08:02:19.653016  5696 tablet.cc:2406] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:19.673374  5526 tablet.cc:2406] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:19.712416  5364 tablet.cc:2406] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:20.031656  5877 raft_consensus.cc:493] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:20.031919  5877 raft_consensus.cc:515] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:20.033161  5877 leader_election.cc:290] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd534ded0f3e4e998f9c4a78735bed31 (127.4.108.2:35479), e5c3cb56b30e46f0afbe2a606b6fd357 (127.4.108.1:43359)
I20260812 08:02:20.037556  5471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ce93d7ca6a4d72a3c5554375a2d76c" candidate_uuid: "bccc6ed3f2ca41489a714b1a5624055f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd534ded0f3e4e998f9c4a78735bed31" is_pre_election: true
I20260812 08:02:20.037555  5308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ce93d7ca6a4d72a3c5554375a2d76c" candidate_uuid: "bccc6ed3f2ca41489a714b1a5624055f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" is_pre_election: true
I20260812 08:02:20.037884  5308 raft_consensus.cc:2468] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bccc6ed3f2ca41489a714b1a5624055f in term 0.
I20260812 08:02:20.037885  5471 raft_consensus.cc:2468] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bccc6ed3f2ca41489a714b1a5624055f in term 0.
I20260812 08:02:20.038455  5556 leader_election.cc:304] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: bccc6ed3f2ca41489a714b1a5624055f, bd534ded0f3e4e998f9c4a78735bed31, e5c3cb56b30e46f0afbe2a606b6fd357; no voters: 
I20260812 08:02:20.038868  5877 raft_consensus.cc:2804] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:20.038955  5877 raft_consensus.cc:493] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:20.039021  5877 raft_consensus.cc:3060] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:20.040069  5877 raft_consensus.cc:515] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:20.040525  5877 leader_election.cc:290] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [CANDIDATE]: Term 1 election: Requested vote from peers bd534ded0f3e4e998f9c4a78735bed31 (127.4.108.2:35479), e5c3cb56b30e46f0afbe2a606b6fd357 (127.4.108.1:43359)
I20260812 08:02:20.040917  5471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ce93d7ca6a4d72a3c5554375a2d76c" candidate_uuid: "bccc6ed3f2ca41489a714b1a5624055f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd534ded0f3e4e998f9c4a78735bed31"
I20260812 08:02:20.040987  5308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ce93d7ca6a4d72a3c5554375a2d76c" candidate_uuid: "bccc6ed3f2ca41489a714b1a5624055f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357"
I20260812 08:02:20.041050  5471 raft_consensus.cc:3060] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:20.041138  5308 raft_consensus.cc:3060] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:20.041980  5471 raft_consensus.cc:2468] T 64ce93d7ca6a4d72a3c5554375a2d76c P bd534ded0f3e4e998f9c4a78735bed31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bccc6ed3f2ca41489a714b1a5624055f in term 1.
I20260812 08:02:20.042124  5308 raft_consensus.cc:2468] T 64ce93d7ca6a4d72a3c5554375a2d76c P e5c3cb56b30e46f0afbe2a606b6fd357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bccc6ed3f2ca41489a714b1a5624055f in term 1.
I20260812 08:02:20.042320  5558 leader_election.cc:304] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bccc6ed3f2ca41489a714b1a5624055f, bd534ded0f3e4e998f9c4a78735bed31; no voters: 
I20260812 08:02:20.042512  5877 raft_consensus.cc:2804] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:20.042773  5877 raft_consensus.cc:697] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [term 1 LEADER]: Becoming Leader. State: Replica: bccc6ed3f2ca41489a714b1a5624055f, State: Running, Role: LEADER
I20260812 08:02:20.043141  5877 consensus_queue.cc:237] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } }
I20260812 08:02:20.046456  5072 catalog_manager.cc:5719] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f reported cstate change: term changed from 0 to 1, leader changed from <none> to bccc6ed3f2ca41489a714b1a5624055f (127.4.108.3). New cstate: current_term: 1 leader_uuid: "bccc6ed3f2ca41489a714b1a5624055f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bccc6ed3f2ca41489a714b1a5624055f" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40357 } health_report { overall_health: HEALTHY } } }
W20260812 08:02:20.144923  4890 leader_election.cc:336] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b988f364c96347d4bec8bfb790f01aa2 (127.4.108.61:44381): Timed out: RequestConsensusVote RPC to 127.4.108.61:44381 timed out after 0.515s (SENT)
I20260812 08:02:20.145047  4890 leader_election.cc:304] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 820525fb312a42aebba0a1494babf4eb; no voters: 6bda8cd0e0874deb8030bd5ccaf9a9db, b988f364c96347d4bec8bfb790f01aa2
I20260812 08:02:20.145458  5885 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 820525fb312a42aebba0a1494babf4eb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:20.540608  5877 consensus_queue.cc:1048] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5c3cb56b30e46f0afbe2a606b6fd357" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 43359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:20.547772  5888 consensus_queue.cc:1048] T 64ce93d7ca6a4d72a3c5554375a2d76c P bccc6ed3f2ca41489a714b1a5624055f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd534ded0f3e4e998f9c4a78735bed31" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 35479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:20.613652  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 5203
W20260812 08:02:20.616392  4977 connection.cc:256] RPC call timeout handler was delayed by -7.1219127170043066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 3s for a response
I20260812 08:02:20.620767  4994 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 08:02:20.620863  4994 raft_consensus.cc:740] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b988f364c96347d4bec8bfb790f01aa2, State: Running, Role: LEADER
I20260812 08:02:20.621011  4994 consensus_queue.cc:260] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 3.7, Last appended by leader: 7, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } }
I20260812 08:02:20.621222  4994 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 3 FOLLOWER]: Advancing to term 5
I20260812 08:02:20.621659  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.621932  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.622149  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.622376  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.622562  4994 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Refusing update from remote peer 6bda8cd0e0874deb8030bd5ccaf9a9db: Log matching property violated. Preceding OpId in replica: term: 3 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260812 08:02:20.622604  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.622764  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.622825  4994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.622879  5002 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.622985  4994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.623034  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2"
I20260812 08:02:20.623076  4994 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.623188  4994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.623325  4994 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.623360  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.623445  5001 raft_consensus.cc:2368] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bda8cd0e0874deb8030bd5ccaf9a9db for earlier term 4. Current term is 5.
I20260812 08:02:20.623459  4994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.623526  4994 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.623569  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.623637  5001 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.623790  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.623869  5001 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.624008  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.624085  5001 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.624203  4995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 5 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2"
I20260812 08:02:20.624294  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2"
I20260812 08:02:20.624470  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.624622  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.624754  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.624895  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.625025  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.625201  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.625398  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.625478  4995 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in term 5.
I20260812 08:02:20.625612  4995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.625589  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.625696  4995 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.625780  5000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2"
I20260812 08:02:20.625802  4995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 4 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2"
I20260812 08:02:20.625869  5000 raft_consensus.cc:2368] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 820525fb312a42aebba0a1494babf4eb for earlier term 4. Current term is 5.
I20260812 08:02:20.625999  4996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 5 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.626022  4999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 5 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.626101  4996 raft_consensus.cc:2376] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in term 5. Re-sending same reply.
I20260812 08:02:20.626415  4997 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Refusing update from remote peer 6bda8cd0e0874deb8030bd5ccaf9a9db: Log matching property violated. Preceding OpId in replica: term: 3 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260812 08:02:20.626645  4998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" candidate_term: 5 candidate_status { last_received { term: 3 index: 7 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2"
I20260812 08:02:20.626762  4998 raft_consensus.cc:2376] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6bda8cd0e0874deb8030bd5ccaf9a9db in term 5. Re-sending same reply.
I20260812 08:02:20.623229  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.627144  5003 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.624217  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.627506  5001 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.622987  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.627750  5002 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.627893  5001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.627980  5001 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.630931  5002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.631044  5002 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.631412  5003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 9 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.631516  5003 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.631534  5695 heartbeater.cc:344] Connected to a master server at 127.4.108.61:44381
I20260812 08:02:20.631650  5695 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
I20260812 08:02:20.623641  4994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "820525fb312a42aebba0a1494babf4eb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b988f364c96347d4bec8bfb790f01aa2" is_pre_election: true
I20260812 08:02:20.632848  4994 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 820525fb312a42aebba0a1494babf4eb in term 5.
I20260812 08:02:20.633828  5896 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6bda8cd0e0874deb8030bd5ccaf9a9db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260812 08:02:20.640328  5729 catalog_manager.cc:1445] Failed waiting for node to catch up after master election: Illegal state: Node b988f364c96347d4bec8bfb790f01aa2 not leader. Raft Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:02:20.642733  5731 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bda8cd0e0874deb8030bd5ccaf9a9db. Latest consensus state: current_term: 5 leader_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:02:20.642879  5731 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:20.642975  5731 sys_catalog.cc:455] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "820525fb312a42aebba0a1494babf4eb" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 43965 } } peers { permanent_uuid: "b988f364c96347d4bec8bfb790f01aa2" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 44381 } } peers { permanent_uuid: "6bda8cd0e0874deb8030bd5ccaf9a9db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 42215 } } }
I20260812 08:02:20.643043  5731 sys_catalog.cc:458] T 00000000000000000000000000000000 P b988f364c96347d4bec8bfb790f01aa2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:20.647188  5525 heartbeater.cc:344] Connected to a master server at 127.4.108.61:44381
I20260812 08:02:20.647382  5525 heartbeater.cc:499] Master 127.4.108.61:44381 was elected leader, sending a full tablet report...
W20260812 08:02:20.651235  5180 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events
W20260812 08:02:20.655588  4977 connection.cc:573] server connection from 127.4.108.1:57439 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:20.655803  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 5372
I20260812 08:02:20.663208  5613 tablet_service.cc:1511] Processing CreateTablet for tablet 5638a737001f4ac5b22bf063c244162a (DEFAULT_TABLE table=default.test_pause_after_create_table_issued [id=719147087ed84e70887390bde25ba704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:20.663641  5613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5638a737001f4ac5b22bf063c244162a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 08:02:20.663641  5907 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:02:20.645841 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.4.108.1:43359 (local address 127.0.0.1:41510)
0812 08:02:20.662963 (+ 17122us) negotiation.cc:107] Waiting for socket to connect
0812 08:02:20.663033 (+    70us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.108.1:43359: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":17019,"thread_start_us":135,"threads_started":1}
W20260812 08:02:20.663789  4976 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.1:43359: connect: Connection reset by peer (error 104) [suppressed 2 similar messages]
W20260812 08:02:20.667316  5903 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:02:20.639157 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.4.108.2:35479 (local address 127.0.0.1:35800)
0812 08:02:20.643902 (+  4745us) negotiation.cc:107] Waiting for socket to connect
0812 08:02:20.643925 (+    23us) client_negotiation.cc:175] Beginning negotiation
0812 08:02:20.644111 (+   186us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 08:02:20.658754 (+ 14643us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0812 08:02:20.658758 (+     4us) client_negotiation.cc:404] Received NEGOTIATE response from server
0812 08:02:20.658776 (+    18us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0812 08:02:20.658986 (+   210us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0812 08:02:20.658995 (+     9us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0812 08:02:20.667121 (+  8126us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.108.2:35479: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":4637,"thread_start_us":102,"threads_started":1}
W20260812 08:02:20.667727  4976 catalog_manager.cc:4777] TS e5c3cb56b30e46f0afbe2a606b6fd357 (127.4.108.1:43359): CreateTablet RPC failed for tablet 5638a737001f4ac5b22bf063c244162a: Network error: Client connection negotiation failed: client connection to 127.4.108.1:43359: connect: Connection refused (error 111)
I20260812 08:02:20.668793  5909 tablet_bootstrap.cc:492] T 5638a737001f4ac5b22bf063c244162a P bccc6ed3f2ca41489a714b1a5624055f: Bootstrap starting.
I20260812 08:02:20.669212  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 5531
I20260812 08:02:20.687597  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 4870
I20260812 08:02:20.698273  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 4951
I20260812 08:02:20.711189  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 5031
Shutting down hive metastore.
2026-08-12T08:02:21Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestPauseAfterCreateTableIssued/1 (53804 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestRenameTableSync/1
2026-08-12T08:02:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:21Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:	 jdbc:derby:/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/metadb;create=true
Metastore Connection Driver :	 org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User:	 APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 

 
 
 
 

 
 
 
 


 
 
 

 
 
 


 
 
 
 
 
 
 


 
 
 

 
 
 

 
 

 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 


 
 
 
 
 
 



 
 
 
 
 


 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 


Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/security.properties
2026-08-12 08:02:29: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260812 08:02:40.725909  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:34709
--webserver_interface=127.4.108.62
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:37429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--hive_metastore_uris=thrift://127.0.0.1:36629
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:02:40.836596  6241 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:40.836867  6241 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:40.836907  6241 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:40.840483  6241 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:40.840590  6241 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:40.840612  6241 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:40.840631  6241 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:40.844853  6241 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:36629
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:34709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.108.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.6241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:40.846055  6241 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:40.847208  6241 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:40.853835  6246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:40.853837  6247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:40.854003  6249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:40.854413  6241 server_base.cc:1061] running on GCE node
I20260812 08:02:40.855134  6241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:40.856470  6241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:40.857779  6241 hybrid_clock.cc:648] HybridClock initialized: now 1786521760857760 us; error 44 us; skew 500 ppm
I20260812 08:02:40.859979  6241 webserver.cc:533] Webserver started at http://127.4.108.62:38837/ using document root <none> and password file <none>
I20260812 08:02:40.860594  6241 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:40.860683  6241 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:40.860919  6241 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:40.862675  6241 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/data/instance:
uuid: "29daf8727d9843ff844ffaad635cf0e3"
format_stamp: "Formatted at 2026-08-12 08:02:40 on dist-test-slave-5l3k"
I20260812 08:02:40.863205  6241 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/wal/instance:
uuid: "29daf8727d9843ff844ffaad635cf0e3"
format_stamp: "Formatted at 2026-08-12 08:02:40 on dist-test-slave-5l3k"
I20260812 08:02:40.866885  6241 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:40.869180  6257 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:40.870325  6241 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:40.870528  6241 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/wal
uuid: "29daf8727d9843ff844ffaad635cf0e3"
format_stamp: "Formatted at 2026-08-12 08:02:40 on dist-test-slave-5l3k"
I20260812 08:02:40.870674  6241 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:40.885275  6241 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:40.886057  6241 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:40.886274  6241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:40.894047  6241 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.62:34709
I20260812 08:02:40.894063  6319 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.62:34709 every 8 connection(s)
I20260812 08:02:40.895349  6241 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
I20260812 08:02:40.898437  6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:40.902150  6320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:40.903191  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 6241
I20260812 08:02:40.903309  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-0/wal/instance
I20260812 08:02:40.904044  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:45241
--webserver_interface=127.4.108.61
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:37429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--hive_metastore_uris=thrift://127.0.0.1:36629
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:02:40.920084  6320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:40.921175  6261 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.61:45241: connect: Connection refused (error 111)
W20260812 08:02:40.922319  6320 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:45241: Network error: Client connection negotiation failed: client connection to 127.4.108.61:45241: connect: Connection refused (error 111)
I20260812 08:02:40.971589  6320 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } attempt: 1
W20260812 08:02:40.973295  6320 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:45241: Network error: Client connection negotiation failed: client connection to 127.4.108.61:45241: connect: Connection refused (error 111)
W20260812 08:02:41.019289  6323 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:41.019547  6323 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:41.019587  6323 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:41.023011  6323 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:41.023082  6323 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:41.023101  6323 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:41.023119  6323 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:41.027105  6323 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:36629
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:45241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.108.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.6323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:41.028271  6323 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:41.029444  6323 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:41.035480  6333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.035583  6329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.035486  6330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.035840  6323 server_base.cc:1061] running on GCE node
I20260812 08:02:41.036355  6323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:41.037379  6323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:41.038612  6323 hybrid_clock.cc:648] HybridClock initialized: now 1786521761038542 us; error 88 us; skew 500 ppm
I20260812 08:02:41.040748  6323 webserver.cc:533] Webserver started at http://127.4.108.61:43471/ using document root <none> and password file <none>
I20260812 08:02:41.041404  6323 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:41.041464  6323 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:41.041523  6320 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } attempt: 2
I20260812 08:02:41.041724  6323 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
W20260812 08:02:41.043026  6320 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:45241: Network error: Client connection negotiation failed: client connection to 127.4.108.61:45241: connect: Connection refused (error 111)
I20260812 08:02:41.043795  6323 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/data/instance:
uuid: "75c144b8728d47baa2d3b2eba77fd2b0"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.044330  6323 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/wal/instance:
uuid: "75c144b8728d47baa2d3b2eba77fd2b0"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.047998  6323 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260812 08:02:41.050650  6339 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.051879  6323 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:41.052013  6323 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/wal
uuid: "75c144b8728d47baa2d3b2eba77fd2b0"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.052126  6323 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:41.071237  6323 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:41.072046  6323 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:41.072233  6323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:41.081635  6323 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.61:45241
I20260812 08:02:41.081635  6394 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.61:45241 every 8 connection(s)
I20260812 08:02:41.082947  6323 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
I20260812 08:02:41.086359  6395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:41.090569  6395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:41.091831  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 6323
I20260812 08:02:41.091993  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-1/wal/instance
I20260812 08:02:41.092839  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:36955
--webserver_interface=127.4.108.60
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:37429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--hive_metastore_uris=thrift://127.0.0.1:36629
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:02:41.101815  6395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:41.108759  6395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:41.109688  6340 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.60:36955: connect: Connection refused (error 111)
W20260812 08:02:41.110678  6395 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:36955: Network error: Client connection negotiation failed: client connection to 127.4.108.60:36955: connect: Connection refused (error 111)
I20260812 08:02:41.134246  6320 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } attempt: 3
I20260812 08:02:41.139698  6320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:02:41.141309  6320 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:36955: Network error: Client connection negotiation failed: client connection to 127.4.108.60:36955: connect: Connection refused (error 111)
I20260812 08:02:41.159984  6395 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } attempt: 1
W20260812 08:02:41.161617  6395 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:36955: Network error: Client connection negotiation failed: client connection to 127.4.108.60:36955: connect: Connection refused (error 111)
I20260812 08:02:41.172559  6320 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } attempt: 1
W20260812 08:02:41.174269  6320 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:36955: Network error: Client connection negotiation failed: client connection to 127.4.108.60:36955: connect: Connection refused (error 111)
W20260812 08:02:41.210171  6398 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:41.210409  6398 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:41.210448  6398 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:41.213997  6398 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:41.214067  6398 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:41.214087  6398 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:41.214105  6398 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:41.217993  6398 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:36629
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:36955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.108.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.6398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:41.219216  6398 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:41.220391  6398 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:41.226409  6405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.226436  6409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.226414  6407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.226848  6398 server_base.cc:1061] running on GCE node
I20260812 08:02:41.227403  6398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:41.228441  6398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:41.229673  6398 hybrid_clock.cc:648] HybridClock initialized: now 1786521761229647 us; error 51 us; skew 500 ppm
I20260812 08:02:41.229815  6395 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } attempt: 2
W20260812 08:02:41.231387  6395 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:36955: Network error: Client connection negotiation failed: client connection to 127.4.108.60:36955: connect: Connection refused (error 111)
I20260812 08:02:41.232187  6398 webserver.cc:533] Webserver started at http://127.4.108.60:45733/ using document root <none> and password file <none>
I20260812 08:02:41.232800  6398 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:41.232865  6398 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:41.233053  6398 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:41.234843  6398 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/data/instance:
uuid: "4b74bca416e24bafae2f2840c9309c71"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.235343  6398 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/wal/instance:
uuid: "4b74bca416e24bafae2f2840c9309c71"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.239173  6398 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:41.241798  6417 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.243088  6398 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:41.243256  6398 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/wal
uuid: "4b74bca416e24bafae2f2840c9309c71"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.243382  6398 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:41.249481  6320 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } attempt: 2
W20260812 08:02:41.251298  6320 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:36955: Network error: Client connection negotiation failed: client connection to 127.4.108.60:36955: connect: Connection refused (error 111)
I20260812 08:02:41.265462  6398 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:41.266259  6398 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:41.266474  6398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:41.274322  6478 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.60:36955 every 8 connection(s)
I20260812 08:02:41.274328  6398 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.60:36955
I20260812 08:02:41.275611  6398 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
I20260812 08:02:41.278791  6479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:41.281519  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 6398
I20260812 08:02:41.281634  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/master-2/wal/instance
I20260812 08:02:41.282541  6479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:41.292846  6479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:41.297441  6479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:02:41.303728  6479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71: Bootstrap starting.
I20260812 08:02:41.306003  6479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.306855  6479 log.cc:826] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.308947  6479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71: No bootstrap required, opened a new log
I20260812 08:02:41.311539  6479 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.311757  6479 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.311853  6479 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b74bca416e24bafae2f2840c9309c71, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.312319  6479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.313112  6485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.313251  6485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:41.313577  6479 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:02:41.319972  6499 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:41.320077  6499 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:02:41.318261  6398 master_runner.cc:187] Error getting master registration for 127.4.108.62:34709: OK, instance_id { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" instance_seqno: 1786521760891914 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:02:41.320593  6398 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:41.322587  6395 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } attempt: 3
I20260812 08:02:41.330719  6395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: Bootstrap starting.
I20260812 08:02:41.333712  6395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.334757  6395 log.cc:826] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.337610  6395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: No bootstrap required, opened a new log
I20260812 08:02:41.343357  6395 raft_consensus.cc:359] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.343971  6395 raft_consensus.cc:385] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.350509  6320 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } attempt: 3
I20260812 08:02:41.358683  6320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: Bootstrap starting.
I20260812 08:02:41.361631  6320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.362963  6320 log.cc:826] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.370543  6395 raft_consensus.cc:740] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75c144b8728d47baa2d3b2eba77fd2b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.371325  6395 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.372968  6395 sys_catalog.cc:565] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:41.377493  6320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: No bootstrap required, opened a new log
I20260812 08:02:41.381385  6320 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.381625  6320 raft_consensus.cc:385] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.381711  6320 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29daf8727d9843ff844ffaad635cf0e3, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.382270  6320 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.380548  6323 master_runner.cc:187] Error getting master registration for 127.4.108.62:34709: OK, instance_id { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" instance_seqno: 1786521760891914 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:02:41.382925  6323 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:41.383260  6504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.383473  6504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:41.383745  6320 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:41.386117  6520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.386345  6520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:41.388163  6263 tablet.cc:2406] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:41.389770  6535 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:41.389850  6535 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 08:02:41.390825  6519 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:41.393433  6519 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:02:41.396126  6241 master_runner.cc:264] No leader master found from master 29daf8727d9843ff844ffaad635cf0e3
I20260812 08:02:41.396222  6241 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:41.472064  6485 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:41.472348  6485 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.473567  6485 leader_election.cc:290] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29daf8727d9843ff844ffaad635cf0e3 (127.4.108.62:34709), 75c144b8728d47baa2d3b2eba77fd2b0 (127.4.108.61:45241)
I20260812 08:02:41.474413  6287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4b74bca416e24bafae2f2840c9309c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29daf8727d9843ff844ffaad635cf0e3" is_pre_election: true
I20260812 08:02:41.474798  6287 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b74bca416e24bafae2f2840c9309c71 in term 0.
I20260812 08:02:41.475395  6420 leader_election.cc:304] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3, 4b74bca416e24bafae2f2840c9309c71; no voters: 
I20260812 08:02:41.476311  6367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4b74bca416e24bafae2f2840c9309c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" is_pre_election: true
I20260812 08:02:41.476635  6367 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b74bca416e24bafae2f2840c9309c71 in term 0.
I20260812 08:02:41.479447  6485 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:41.479562  6485 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:41.479622  6485 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.480844  6485 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.481282  6485 leader_election.cc:290] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [CANDIDATE]: Term 1 election: Requested vote from peers 29daf8727d9843ff844ffaad635cf0e3 (127.4.108.62:34709), 75c144b8728d47baa2d3b2eba77fd2b0 (127.4.108.61:45241)
I20260812 08:02:41.481782  6287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4b74bca416e24bafae2f2840c9309c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29daf8727d9843ff844ffaad635cf0e3"
I20260812 08:02:41.481930  6287 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.483302  6287 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b74bca416e24bafae2f2840c9309c71 in term 1.
I20260812 08:02:41.483724  6420 leader_election.cc:304] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3, 4b74bca416e24bafae2f2840c9309c71; no voters: 
I20260812 08:02:41.484301  6367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4b74bca416e24bafae2f2840c9309c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75c144b8728d47baa2d3b2eba77fd2b0"
I20260812 08:02:41.484448  6367 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.485708  6367 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b74bca416e24bafae2f2840c9309c71 in term 1.
I20260812 08:02:41.486243  6485 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:41.486595  6485 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 1 LEADER]: Becoming Leader. State: Replica: 4b74bca416e24bafae2f2840c9309c71, State: Running, Role: LEADER
I20260812 08:02:41.486943  6485 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:41.488883  6485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b74bca416e24bafae2f2840c9309c71. Latest consensus state: current_term: 1 leader_uuid: "4b74bca416e24bafae2f2840c9309c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.488998  6485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:41.489367  6542 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:41.490391  6542 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:41.500975  6367 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Refusing update from remote peer 4b74bca416e24bafae2f2840c9309c71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:41.501686  6485 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:41.506008  6504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b74bca416e24bafae2f2840c9309c71. Latest consensus state: current_term: 1 leader_uuid: "4b74bca416e24bafae2f2840c9309c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.506173  6504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:41.507345  6287 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 1 FOLLOWER]: Refusing update from remote peer 4b74bca416e24bafae2f2840c9309c71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:41.507975  6485 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:41.512053  6520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b74bca416e24bafae2f2840c9309c71. Latest consensus state: current_term: 1 leader_uuid: "4b74bca416e24bafae2f2840c9309c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.512207  6520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:41.517880  6424 tablet.cc:2406] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:41.521332  6540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4b74bca416e24bafae2f2840c9309c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.521517  6540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:41.523057  6520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4b74bca416e24bafae2f2840c9309c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.523192  6520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:41.523612  6543 mvcc.cc:204] Tried to move back new op lower bound from 7317593135099133952 to 7317593135054213120. Current Snapshot: MvccSnapshot[applied={T|T < 7317593135099133952}]
I20260812 08:02:41.526239  6485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4b74bca416e24bafae2f2840c9309c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.526358  6485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:41.527420  6504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4b74bca416e24bafae2f2840c9309c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:41.527565  6504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:41.528316  6546 mvcc.cc:204] Tried to move back new op lower bound from 7317593135099133952 to 7317593135054213120. Current Snapshot: MvccSnapshot[applied={T|T < 7317593135099133952}]
I20260812 08:02:41.528937  6544 mvcc.cc:204] Tried to move back new op lower bound from 7317593135099133952 to 7317593135054213120. Current Snapshot: MvccSnapshot[applied={T|T < 7317593135099133952}]
I20260812 08:02:41.532596  6542 catalog_manager.cc:1383] Generated new cluster ID: c16b5618ceb14fd59d5030c277348345
I20260812 08:02:41.532680  6542 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:41.561574  6542 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:41.562755  6542 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:41.600217  6542 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71: Generated new TSK 0
I20260812 08:02:41.601646  6542 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:41.602453  6542 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:02:41.602962  6542 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:02:41.617398  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.1:0
--local_ip_for_outbound_sockets=127.4.108.1
--webserver_interface=127.4.108.1
--webserver_port=0
--tserver_master_addrs=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--builtin_ntp_servers=127.4.108.20:37429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:02:41.743275  6554 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:41.743547  6554 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:41.743610  6554 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:41.747334  6554 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:41.747475  6554 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.1
I20260812 08:02:41.751962  6554 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.108.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--never_fsync=true
--heap_profile_path=/tmp/kudu.6554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:41.753340  6554 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:41.754861  6554 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:41.762688  6563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.762781  6562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.762768  6554 server_base.cc:1061] running on GCE node
W20260812 08:02:41.762794  6565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.763510  6554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:41.764209  6554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:41.765414  6554 hybrid_clock.cc:648] HybridClock initialized: now 1786521761765398 us; error 35 us; skew 500 ppm
I20260812 08:02:41.767601  6554 webserver.cc:533] Webserver started at http://127.4.108.1:44401/ using document root <none> and password file <none>
I20260812 08:02:41.768234  6554 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:41.768298  6554 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:41.768474  6554 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:41.770203  6554 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/data/instance:
uuid: "02b625421b0d48d18407fe1d7acb7ad3"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.770812  6554 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/wal/instance:
uuid: "02b625421b0d48d18407fe1d7acb7ad3"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.774956  6554 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260812 08:02:41.777611  6574 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.778899  6554 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:41.779055  6554 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
uuid: "02b625421b0d48d18407fe1d7acb7ad3"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.779178  6554 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:41.811105  6554 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:41.811872  6554 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:41.812088  6554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:41.812731  6554 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:41.813910  6554 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:41.813985  6554 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.814060  6554 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:41.814111  6554 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.824069  6554 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.1:32823
I20260812 08:02:41.824144  6708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.1:32823 every 8 connection(s)
I20260812 08:02:41.825264  6554 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
I20260812 08:02:41.825942  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 6554
I20260812 08:02:41.826048  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-0/wal/instance
I20260812 08:02:41.829957  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.2:0
--local_ip_for_outbound_sockets=127.4.108.2
--webserver_interface=127.4.108.2
--webserver_port=0
--tserver_master_addrs=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--builtin_ntp_servers=127.4.108.20:37429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:02:41.836971  6709 heartbeater.cc:344] Connected to a master server at 127.4.108.60:36955
I20260812 08:02:41.837093  6711 heartbeater.cc:344] Connected to a master server at 127.4.108.61:45241
I20260812 08:02:41.837286  6710 heartbeater.cc:344] Connected to a master server at 127.4.108.62:34709
I20260812 08:02:41.837371  6710 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:41.837265  6709 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:41.837262  6711 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:41.837970  6710 heartbeater.cc:507] Master 127.4.108.62:34709 requested a full tablet report, sending...
I20260812 08:02:41.837967  6709 heartbeater.cc:507] Master 127.4.108.60:36955 requested a full tablet report, sending...
I20260812 08:02:41.838165  6711 heartbeater.cc:507] Master 127.4.108.61:45241 requested a full tablet report, sending...
I20260812 08:02:41.839679  6276 ts_manager.cc:194] Registered new tserver with Master: 02b625421b0d48d18407fe1d7acb7ad3 (127.4.108.1:32823)
I20260812 08:02:41.839689  6436 ts_manager.cc:194] Registered new tserver with Master: 02b625421b0d48d18407fe1d7acb7ad3 (127.4.108.1:32823)
I20260812 08:02:41.839781  6356 ts_manager.cc:194] Registered new tserver with Master: 02b625421b0d48d18407fe1d7acb7ad3 (127.4.108.1:32823)
I20260812 08:02:41.841238  6436 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.1:51635
W20260812 08:02:41.948908  6719 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:41.949167  6719 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:41.949219  6719 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:41.952939  6719 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:41.953090  6719 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.2
I20260812 08:02:41.957508  6719 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.108.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--never_fsync=true
--heap_profile_path=/tmp/kudu.6719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:41.958722  6719 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:41.960155  6719 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:41.967239  6729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.967209  6732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.967222  6730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.967787  6719 server_base.cc:1061] running on GCE node
I20260812 08:02:41.969632  6719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:41.970563  6719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:41.971755  6719 hybrid_clock.cc:648] HybridClock initialized: now 1786521761971725 us; error 55 us; skew 500 ppm
I20260812 08:02:41.973934  6719 webserver.cc:533] Webserver started at http://127.4.108.2:33097/ using document root <none> and password file <none>
I20260812 08:02:41.974665  6719 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:41.974759  6719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:41.975080  6719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:41.976810  6719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/data/instance:
uuid: "97206367ae5949e2a7604741f69e7e81"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.977363  6719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/wal/instance:
uuid: "97206367ae5949e2a7604741f69e7e81"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.981297  6719 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:41.983991  6739 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.985333  6719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260812 08:02:41.985488  6719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
uuid: "97206367ae5949e2a7604741f69e7e81"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-5l3k"
I20260812 08:02:41.985606  6719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:42.021786  6719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:42.022650  6719 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:42.022871  6719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:42.023612  6719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:42.024758  6719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:42.024837  6719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:42.024905  6719 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:42.024952  6719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:42.034993  6719 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.2:40933
I20260812 08:02:42.035019  6866 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.2:40933 every 8 connection(s)
I20260812 08:02:42.036034  6719 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
I20260812 08:02:42.039165  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 6719
I20260812 08:02:42.039305  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-1/wal/instance
I20260812 08:02:42.042443  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.3:0
--local_ip_for_outbound_sockets=127.4.108.3
--webserver_interface=127.4.108.3
--webserver_port=0
--tserver_master_addrs=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--builtin_ntp_servers=127.4.108.20:37429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:02:42.047870  6868 heartbeater.cc:344] Connected to a master server at 127.4.108.62:34709
I20260812 08:02:42.048161  6868 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:42.048863  6868 heartbeater.cc:507] Master 127.4.108.62:34709 requested a full tablet report, sending...
I20260812 08:02:42.049410  6867 heartbeater.cc:344] Connected to a master server at 127.4.108.60:36955
I20260812 08:02:42.049499  6867 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:42.049710  6867 heartbeater.cc:507] Master 127.4.108.60:36955 requested a full tablet report, sending...
I20260812 08:02:42.049890  6869 heartbeater.cc:344] Connected to a master server at 127.4.108.61:45241
I20260812 08:02:42.049938  6869 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:42.050060  6869 heartbeater.cc:507] Master 127.4.108.61:45241 requested a full tablet report, sending...
I20260812 08:02:42.050210  6276 ts_manager.cc:194] Registered new tserver with Master: 97206367ae5949e2a7604741f69e7e81 (127.4.108.2:40933)
I20260812 08:02:42.050820  6356 ts_manager.cc:194] Registered new tserver with Master: 97206367ae5949e2a7604741f69e7e81 (127.4.108.2:40933)
I20260812 08:02:42.051159  6436 ts_manager.cc:194] Registered new tserver with Master: 97206367ae5949e2a7604741f69e7e81 (127.4.108.2:40933)
I20260812 08:02:42.051823  6436 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.2:51733
I20260812 08:02:42.101286  6876 raft_consensus.cc:493] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b74bca416e24bafae2f2840c9309c71)
I20260812 08:02:42.101428  6876 raft_consensus.cc:515] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:42.102620  6876 leader_election.cc:290] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29daf8727d9843ff844ffaad635cf0e3 (127.4.108.62:34709), 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955)
I20260812 08:02:42.103129  6287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "29daf8727d9843ff844ffaad635cf0e3" is_pre_election: true
I20260812 08:02:42.103241  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:42.103820  6340 leader_election.cc:304] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 75c144b8728d47baa2d3b2eba77fd2b0; no voters: 29daf8727d9843ff844ffaad635cf0e3, 4b74bca416e24bafae2f2840c9309c71
I20260812 08:02:42.104110  6876 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:02:42.166590  6875 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:42.166821  6875 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:42.166918  6875 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:42.170542  6875 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:42.170742  6875 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.3
I20260812 08:02:42.175259  6875 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.108.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:34709,127.4.108.61:45241,127.4.108.60:36955
--never_fsync=true
--heap_profile_path=/tmp/kudu.6875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:42.176532  6875 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:42.177650  6875 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:42.184907  6888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:42.184923  6886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:42.184926  6890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:42.185495  6875 server_base.cc:1061] running on GCE node
I20260812 08:02:42.185954  6875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:42.186625  6875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:42.187822  6875 hybrid_clock.cc:648] HybridClock initialized: now 1786521762187806 us; error 34 us; skew 500 ppm
I20260812 08:02:42.189956  6875 webserver.cc:533] Webserver started at http://127.4.108.3:35623/ using document root <none> and password file <none>
I20260812 08:02:42.190747  6875 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:42.190850  6875 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:42.191072  6875 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:42.192749  6875 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/data/instance:
uuid: "991db5176f694d21a84e4eb7a797ee70"
format_stamp: "Formatted at 2026-08-12 08:02:42 on dist-test-slave-5l3k"
I20260812 08:02:42.193336  6875 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/wal/instance:
uuid: "991db5176f694d21a84e4eb7a797ee70"
format_stamp: "Formatted at 2026-08-12 08:02:42 on dist-test-slave-5l3k"
I20260812 08:02:42.196918  6875 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.002s
I20260812 08:02:42.199322  6896 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:42.200333  6875 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:42.200475  6875 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
uuid: "991db5176f694d21a84e4eb7a797ee70"
format_stamp: "Formatted at 2026-08-12 08:02:42 on dist-test-slave-5l3k"
I20260812 08:02:42.200588  6875 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:42.238142  6875 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:42.238935  6875 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:42.239152  6875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:42.239813  6875 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:42.241025  6875 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:42.241106  6875 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:42.241183  6875 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:42.241235  6875 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:42.251353  6875 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.3:40449
I20260812 08:02:42.251376  7020 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.3:40449 every 8 connection(s)
I20260812 08:02:42.252398  6875 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
I20260812 08:02:42.252786  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 6875
I20260812 08:02:42.252926  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestRenameTableSync_1.1786521687308489-4528-0/minicluster-data/ts-2/wal/instance
I20260812 08:02:42.263456  7022 heartbeater.cc:344] Connected to a master server at 127.4.108.62:34709
I20260812 08:02:42.263698  7024 heartbeater.cc:344] Connected to a master server at 127.4.108.61:45241
I20260812 08:02:42.263774  7022 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:42.263829  7024 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:42.264356  7021 heartbeater.cc:344] Connected to a master server at 127.4.108.60:36955
I20260812 08:02:42.264400  7024 heartbeater.cc:507] Master 127.4.108.61:45241 requested a full tablet report, sending...
I20260812 08:02:42.264448  7021 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:42.264398  7022 heartbeater.cc:507] Master 127.4.108.62:34709 requested a full tablet report, sending...
I20260812 08:02:42.264699  7021 heartbeater.cc:507] Master 127.4.108.60:36955 requested a full tablet report, sending...
I20260812 08:02:42.265581  6436 ts_manager.cc:194] Registered new tserver with Master: 991db5176f694d21a84e4eb7a797ee70 (127.4.108.3:40449)
I20260812 08:02:42.265632  6276 ts_manager.cc:194] Registered new tserver with Master: 991db5176f694d21a84e4eb7a797ee70 (127.4.108.3:40449)
I20260812 08:02:42.266254  6436 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.3:54975
I20260812 08:02:42.266830  6356 ts_manager.cc:194] Registered new tserver with Master: 991db5176f694d21a84e4eb7a797ee70 (127.4.108.3:40449)
I20260812 08:02:42.277818  4528 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:42.289065  6436 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39432:
name: "default.test_alter_table_sync"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:42.326666  6436 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_alter_table_sync in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:42.343271  6709 heartbeater.cc:499] Master 127.4.108.60:36955 was elected leader, sending a full tablet report...
I20260812 08:02:42.391824  6535 catalog_manager.cc:1295] Loaded cluster ID: c16b5618ceb14fd59d5030c277348345
I20260812 08:02:42.391940  6535 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: loading cluster ID for follower catalog manager: success
I20260812 08:02:42.394536  6535 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: acquiring CA information for follower catalog manager: success
I20260812 08:02:42.394833  6519 catalog_manager.cc:1295] Loaded cluster ID: c16b5618ceb14fd59d5030c277348345
I20260812 08:02:42.394912  6519 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: loading cluster ID for follower catalog manager: success
I20260812 08:02:42.395969  6535 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:02:42.396899  6519 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: acquiring CA information for follower catalog manager: success
I20260812 08:02:42.398417  6519 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:02:42.553417  6867 heartbeater.cc:499] Master 127.4.108.60:36955 was elected leader, sending a full tablet report...
I20260812 08:02:42.767915  7021 heartbeater.cc:499] Master 127.4.108.60:36955 was elected leader, sending a full tablet report...
I20260812 08:02:42.773687  6436 catalog_manager.cc:2200] created HMS catalog entry for table  [id=07029ff525c548c7980f5d4b039c147e]
I20260812 08:02:42.798421  6630 tablet_service.cc:1511] Processing CreateTablet for tablet 598ee5ab89004fbeb9869f2164c0ce89 (DEFAULT_TABLE table=default.test_alter_table_sync [id=07029ff525c548c7980f5d4b039c147e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:42.799620  6630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598ee5ab89004fbeb9869f2164c0ce89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:42.799623  6792 tablet_service.cc:1511] Processing CreateTablet for tablet 598ee5ab89004fbeb9869f2164c0ce89 (DEFAULT_TABLE table=default.test_alter_table_sync [id=07029ff525c548c7980f5d4b039c147e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:42.800550  6792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598ee5ab89004fbeb9869f2164c0ce89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:42.803596  6947 tablet_service.cc:1511] Processing CreateTablet for tablet 598ee5ab89004fbeb9869f2164c0ce89 (DEFAULT_TABLE table=default.test_alter_table_sync [id=07029ff525c548c7980f5d4b039c147e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:42.804646  6947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598ee5ab89004fbeb9869f2164c0ce89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:42.806983  7056 tablet_bootstrap.cc:492] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3: Bootstrap starting.
I20260812 08:02:42.809410  7056 tablet_bootstrap.cc:654] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:42.810202  7056 log.cc:826] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:42.811875  7058 tablet_bootstrap.cc:492] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70: Bootstrap starting.
I20260812 08:02:42.812288  7056 tablet_bootstrap.cc:492] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3: No bootstrap required, opened a new log
I20260812 08:02:42.812614  7056 ts_tablet_manager.cc:1403] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:42.814154  7058 tablet_bootstrap.cc:654] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:42.815126  7058 log.cc:826] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:42.816123  7056 raft_consensus.cc:359] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.816386  7056 raft_consensus.cc:385] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:42.816453  7056 raft_consensus.cc:740] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02b625421b0d48d18407fe1d7acb7ad3, State: Initialized, Role: FOLLOWER
I20260812 08:02:42.816340  7060 tablet_bootstrap.cc:492] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81: Bootstrap starting.
I20260812 08:02:42.816885  7056 consensus_queue.cc:260] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.817124  7058 tablet_bootstrap.cc:492] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70: No bootstrap required, opened a new log
I20260812 08:02:42.817348  7058 ts_tablet_manager.cc:1403] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:42.817845  7056 ts_tablet_manager.cc:1434] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:02:42.820595  7058 raft_consensus.cc:359] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.820839  7058 raft_consensus.cc:385] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:42.820904  7058 raft_consensus.cc:740] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991db5176f694d21a84e4eb7a797ee70, State: Initialized, Role: FOLLOWER
I20260812 08:02:42.821442  7058 consensus_queue.cc:260] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.822520  7058 ts_tablet_manager.cc:1434] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:02:42.824677  7060 tablet_bootstrap.cc:654] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:42.825951  7060 log.cc:826] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81: Log is configured to *not* fsync() on all Append() calls
W20260812 08:02:42.827292  6713 tablet.cc:2406] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:42.828373  7060 tablet_bootstrap.cc:492] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81: No bootstrap required, opened a new log
I20260812 08:02:42.828625  7060 ts_tablet_manager.cc:1403] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.000s
I20260812 08:02:42.831610  7060 raft_consensus.cc:359] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.831811  7060 raft_consensus.cc:385] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:42.831888  7060 raft_consensus.cc:740] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97206367ae5949e2a7604741f69e7e81, State: Initialized, Role: FOLLOWER
I20260812 08:02:42.832365  7060 consensus_queue.cc:260] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.833346  7060 ts_tablet_manager.cc:1434] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:42.843044  7066 raft_consensus.cc:493] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:42.843302  7066 raft_consensus.cc:515] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.844457  7066 leader_election.cc:290] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02b625421b0d48d18407fe1d7acb7ad3 (127.4.108.1:32823), 991db5176f694d21a84e4eb7a797ee70 (127.4.108.3:40449)
I20260812 08:02:42.848987  6969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598ee5ab89004fbeb9869f2164c0ce89" candidate_uuid: "97206367ae5949e2a7604741f69e7e81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "991db5176f694d21a84e4eb7a797ee70" is_pre_election: true
I20260812 08:02:42.849069  6654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598ee5ab89004fbeb9869f2164c0ce89" candidate_uuid: "97206367ae5949e2a7604741f69e7e81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02b625421b0d48d18407fe1d7acb7ad3" is_pre_election: true
I20260812 08:02:42.849355  6969 raft_consensus.cc:2468] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97206367ae5949e2a7604741f69e7e81 in term 0.
I20260812 08:02:42.849355  6654 raft_consensus.cc:2468] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97206367ae5949e2a7604741f69e7e81 in term 0.
I20260812 08:02:42.850064  6741 leader_election.cc:304] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 02b625421b0d48d18407fe1d7acb7ad3, 97206367ae5949e2a7604741f69e7e81, 991db5176f694d21a84e4eb7a797ee70; no voters: 
I20260812 08:02:42.850606  7066 raft_consensus.cc:2804] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:42.850745  7066 raft_consensus.cc:493] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:42.850816  7066 raft_consensus.cc:3060] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:42.851779  7066 raft_consensus.cc:515] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.852293  7066 leader_election.cc:290] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [CANDIDATE]: Term 1 election: Requested vote from peers 02b625421b0d48d18407fe1d7acb7ad3 (127.4.108.1:32823), 991db5176f694d21a84e4eb7a797ee70 (127.4.108.3:40449)
I20260812 08:02:42.852757  6654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598ee5ab89004fbeb9869f2164c0ce89" candidate_uuid: "97206367ae5949e2a7604741f69e7e81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02b625421b0d48d18407fe1d7acb7ad3"
I20260812 08:02:42.852885  6969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598ee5ab89004fbeb9869f2164c0ce89" candidate_uuid: "97206367ae5949e2a7604741f69e7e81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "991db5176f694d21a84e4eb7a797ee70"
I20260812 08:02:42.852932  6654 raft_consensus.cc:3060] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:42.853046  6969 raft_consensus.cc:3060] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:42.853905  6654 raft_consensus.cc:2468] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97206367ae5949e2a7604741f69e7e81 in term 1.
I20260812 08:02:42.854338  6741 leader_election.cc:304] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02b625421b0d48d18407fe1d7acb7ad3, 97206367ae5949e2a7604741f69e7e81; no voters: 
I20260812 08:02:42.854669  7066 raft_consensus.cc:2804] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:42.854925  6969 raft_consensus.cc:2468] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97206367ae5949e2a7604741f69e7e81 in term 1.
I20260812 08:02:42.854992  7066 raft_consensus.cc:697] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [term 1 LEADER]: Becoming Leader. State: Replica: 97206367ae5949e2a7604741f69e7e81, State: Running, Role: LEADER
I20260812 08:02:42.855484  7066 consensus_queue.cc:237] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } }
I20260812 08:02:42.860229  6436 catalog_manager.cc:5719] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97206367ae5949e2a7604741f69e7e81 (127.4.108.2). New cstate: current_term: 1 leader_uuid: "97206367ae5949e2a7604741f69e7e81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97206367ae5949e2a7604741f69e7e81" member_type: VOTER last_known_addr { host: "127.4.108.2" port: 40933 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:42.873102  4528 master_failover-itest.cc:269] Pausing leader master
W20260812 08:02:43.004923  7025 tablet.cc:2406] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:43.038661  6870 tablet.cc:2406] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:43.298682  7066 consensus_queue.cc:1048] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02b625421b0d48d18407fe1d7acb7ad3" member_type: VOTER last_known_addr { host: "127.4.108.1" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:43.305596  7066 consensus_queue.cc:1048] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "991db5176f694d21a84e4eb7a797ee70" member_type: VOTER last_known_addr { host: "127.4.108.3" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:43.365254  7080 raft_consensus.cc:493] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b74bca416e24bafae2f2840c9309c71)
I20260812 08:02:43.365476  7080 raft_consensus.cc:515] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:43.365552  7081 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b74bca416e24bafae2f2840c9309c71)
I20260812 08:02:43.365718  7081 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:43.366076  7080 leader_election.cc:290] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29daf8727d9843ff844ffaad635cf0e3 (127.4.108.62:34709), 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955)
I20260812 08:02:43.366593  6287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "29daf8727d9843ff844ffaad635cf0e3" is_pre_election: true
I20260812 08:02:43.366745  6287 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75c144b8728d47baa2d3b2eba77fd2b0 in term 1.
I20260812 08:02:43.366884  7081 leader_election.cc:290] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75c144b8728d47baa2d3b2eba77fd2b0 (127.4.108.61:45241), 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955)
I20260812 08:02:43.367151  6342 leader_election.cc:304] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3, 75c144b8728d47baa2d3b2eba77fd2b0; no voters: 
I20260812 08:02:43.367353  7080 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:43.367380  6367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" is_pre_election: true
I20260812 08:02:43.367440  7080 raft_consensus.cc:493] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b74bca416e24bafae2f2840c9309c71)
I20260812 08:02:43.367499  7080 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:43.368444  7080 raft_consensus.cc:515] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:43.368723  6367 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29daf8727d9843ff844ffaad635cf0e3 in current term 2: Already voted for candidate 75c144b8728d47baa2d3b2eba77fd2b0 in this term.
I20260812 08:02:43.369071  7080 leader_election.cc:290] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [CANDIDATE]: Term 2 election: Requested vote from peers 29daf8727d9843ff844ffaad635cf0e3 (127.4.108.62:34709), 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955)
I20260812 08:02:43.369213  6287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "29daf8727d9843ff844ffaad635cf0e3"
I20260812 08:02:43.369333  6287 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:43.370297  6287 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75c144b8728d47baa2d3b2eba77fd2b0 in term 2.
I20260812 08:02:43.370676  6342 leader_election.cc:304] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3, 75c144b8728d47baa2d3b2eba77fd2b0; no voters: 
I20260812 08:02:43.370889  7080 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:43.371106  7080 raft_consensus.cc:697] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 2 LEADER]: Becoming Leader. State: Replica: 75c144b8728d47baa2d3b2eba77fd2b0, State: Running, Role: LEADER
I20260812 08:02:43.371438  7080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:43.372628  7082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75c144b8728d47baa2d3b2eba77fd2b0. Latest consensus state: current_term: 2 leader_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:43.372723  7082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:43.373020  7084 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:43.374650  7084 catalog_manager.cc:679] Loaded metadata for table default.test_alter_table_sync [id=07029ff525c548c7980f5d4b039c147e]
I20260812 08:02:43.375710  7084 tablet_loader.cc:96] loaded metadata for tablet 598ee5ab89004fbeb9869f2164c0ce89 (table default.test_alter_table_sync [id=07029ff525c548c7980f5d4b039c147e])
I20260812 08:02:43.375883  7084 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:43.376291  7084 catalog_manager.cc:1295] Loaded cluster ID: c16b5618ceb14fd59d5030c277348345
I20260812 08:02:43.376360  7084 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:43.377024  7084 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:43.377487  7084 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: Loaded TSK: 0
I20260812 08:02:43.378120  7084 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:43.378607  7084 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:02:43.378970  7084 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:02:43.848204  6869 heartbeater.cc:499] Master 127.4.108.61:45241 was elected leader, sending a full tablet report...
I20260812 08:02:43.902561  6287 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Refusing update from remote peer 75c144b8728d47baa2d3b2eba77fd2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260812 08:02:43.903275  7082 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:02:43.904699  7088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75c144b8728d47baa2d3b2eba77fd2b0. Latest consensus state: current_term: 2 leader_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:43.904815  7088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:43.906525  7090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:43.906658  7090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:43.906898  7088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:43.907030  7088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:44.302371  6709 heartbeater.cc:646] Failed to heartbeat to 127.4.108.60:36955 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.108.60:36955 timed out after 1.000s (SENT)
W20260812 08:02:44.306416  6867 heartbeater.cc:646] Failed to heartbeat to 127.4.108.60:36955 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.108.60:36955 timed out after 1.000s (SENT)
I20260812 08:02:44.309021  6711 heartbeater.cc:499] Master 127.4.108.61:45241 was elected leader, sending a full tablet report...
W20260812 08:02:44.309758  7021 heartbeater.cc:646] Failed to heartbeat to 127.4.108.60:36955 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.108.60:36955 timed out after 1.000s (SENT)
I20260812 08:02:44.313177  7024 heartbeater.cc:499] Master 127.4.108.61:45241 was elected leader, sending a full tablet report...
W20260812 08:02:44.588917  6258 leader_election.cc:336] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955): Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.610s (SENT)
I20260812 08:02:44.589067  6258 leader_election.cc:304] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3; no voters: 4b74bca416e24bafae2f2840c9309c71, 75c144b8728d47baa2d3b2eba77fd2b0
I20260812 08:02:44.589573  7100 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:02:44.688939  6340 leader_election.cc:336] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955): Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.660s (SENT)
W20260812 08:02:44.856737  6340 leader_election.cc:336] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955): Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.742s (SENT)
I20260812 08:02:45.527629  7102 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 75c144b8728d47baa2d3b2eba77fd2b0)
I20260812 08:02:45.527838  7102 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:45.528439  7102 leader_election.cc:290] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 75c144b8728d47baa2d3b2eba77fd2b0 (127.4.108.61:45241), 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955)
I20260812 08:02:45.529013  6367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" is_pre_election: true
W20260812 08:02:46.080060  6258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.551s (SENT) [suppressed 6 similar messages]
W20260812 08:02:46.633545  6258 leader_election.cc:336] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955): Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.551s (SENT)
I20260812 08:02:46.633739  6258 leader_election.cc:304] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3; no voters: 4b74bca416e24bafae2f2840c9309c71, 75c144b8728d47baa2d3b2eba77fd2b0
I20260812 08:02:46.634241  7107 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:02:47.532408  7110 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 75c144b8728d47baa2d3b2eba77fd2b0)
I20260812 08:02:47.532553  7110 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:47.533082  7110 leader_election.cc:290] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 75c144b8728d47baa2d3b2eba77fd2b0 (127.4.108.61:45241), 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955)
I20260812 08:02:47.533588  6367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" is_pre_election: true
W20260812 08:02:48.807430  6258 leader_election.cc:336] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955): Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.635s (SENT)
I20260812 08:02:48.807562  6258 leader_election.cc:304] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3; no voters: 4b74bca416e24bafae2f2840c9309c71, 75c144b8728d47baa2d3b2eba77fd2b0
I20260812 08:02:48.807948  7116 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:02:49.736403  7118 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 75c144b8728d47baa2d3b2eba77fd2b0)
I20260812 08:02:49.736563  7118 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:49.737247  7118 leader_election.cc:290] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 75c144b8728d47baa2d3b2eba77fd2b0 (127.4.108.61:45241), 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955)
I20260812 08:02:49.737921  6367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" is_pre_election: true
W20260812 08:02:50.833070  6258 leader_election.cc:336] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955): Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.546s (SENT)
I20260812 08:02:50.833252  6258 leader_election.cc:304] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3; no voters: 4b74bca416e24bafae2f2840c9309c71, 75c144b8728d47baa2d3b2eba77fd2b0
I20260812 08:02:50.833609  7122 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:02:51.351457  7123 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 75c144b8728d47baa2d3b2eba77fd2b0)
I20260812 08:02:51.351616  7123 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:51.352210  7123 leader_election.cc:290] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 75c144b8728d47baa2d3b2eba77fd2b0 (127.4.108.61:45241), 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955)
I20260812 08:02:51.352744  6367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" is_pre_election: true
W20260812 08:02:52.007169  6258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.653s (SENT) [suppressed 2 similar messages]
W20260812 08:02:52.662948  6258 leader_election.cc:336] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b74bca416e24bafae2f2840c9309c71 (127.4.108.60:36955): Timed out: RequestConsensusVote RPC to 127.4.108.60:36955 timed out after 0.653s (SENT)
I20260812 08:02:52.663123  6258 leader_election.cc:304] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29daf8727d9843ff844ffaad635cf0e3; no voters: 4b74bca416e24bafae2f2840c9309c71, 75c144b8728d47baa2d3b2eba77fd2b0
I20260812 08:02:52.663589  7128 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 08:02:52.887748  7029 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.4.108.60:36955)
I20260812 08:02:52.891086  6354 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43258:
table { table_name: "default.test_alter_table_sync" } new_table_name: "default.test_alter_table_sync_renamed" modify_external_catalogs: true
I20260812 08:02:53.196404  6354 catalog_manager.cc:3528] renamed table default.test_alter_table_sync [id=07029ff525c548c7980f5d4b039c147e] in HMS: new name default.test_alter_table_sync_renamed
I20260812 08:02:53.225227  7150 tablet.cc:1724] T 598ee5ab89004fbeb9869f2164c0ce89 P 02b625421b0d48d18407fe1d7acb7ad3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260812 08:02:53.226044  7149 tablet.cc:1724] T 598ee5ab89004fbeb9869f2164c0ce89 P 97206367ae5949e2a7604741f69e7e81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260812 08:02:53.235311  7151 tablet.cc:1724] T 598ee5ab89004fbeb9869f2164c0ce89 P 991db5176f694d21a84e4eb7a797ee70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 1
I20260812 08:02:53.236907  6354 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0: default.test_alter_table_sync_renamed [id=07029ff525c548c7980f5d4b039c147e] alter complete (version 1)
I20260812 08:02:53.247171  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 6554
I20260812 08:02:53.250799  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.251212  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.251471  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.251705  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71"
I20260812 08:02:53.251910  6448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71"
I20260812 08:02:53.252350  6448 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:53.252439  6448 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b74bca416e24bafae2f2840c9309c71, State: Running, Role: LEADER
I20260812 08:02:53.252671  6448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } }
I20260812 08:02:53.252871  6448 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:53.254626  6446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.255012  6445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.255332  6444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.255613  6443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.255914  6442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.256227  6441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.256544  6440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.256851  6439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.257176  6438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29daf8727d9843ff844ffaad635cf0e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 8 } } ignore_live_leader: false dest_uuid: "4b74bca416e24bafae2f2840c9309c71" is_pre_election: true
I20260812 08:02:53.260030  6448 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [term 2 FOLLOWER]: Refusing update from remote peer 75c144b8728d47baa2d3b2eba77fd2b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260812 08:02:53.276041  6367 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [term 2 LEADER]: Rejecting Update request from peer 4b74bca416e24bafae2f2840c9309c71 for earlier term 1. Current term is 2. Ops: []
I20260812 08:02:53.276401  7133 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 75c144b8728d47baa2d3b2eba77fd2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:02:53.278668  6287 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 29daf8727d9843ff844ffaad635cf0e3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b74bca416e24bafae2f2840c9309c71 for earlier term 1. Current term is 2. Ops: []
W20260812 08:02:53.281459  6418 connection.cc:573] server connection from 127.4.108.1:51635 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:53.281543  7045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75c144b8728d47baa2d3b2eba77fd2b0. Latest consensus state: current_term: 2 leader_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:53.281643  7045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:53.281754  6553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29daf8727d9843ff844ffaad635cf0e3" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 34709 } } peers { permanent_uuid: "75c144b8728d47baa2d3b2eba77fd2b0" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 45241 } } peers { permanent_uuid: "4b74bca416e24bafae2f2840c9309c71" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 36955 } } }
I20260812 08:02:53.281876  6553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b74bca416e24bafae2f2840c9309c71 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:53.282895  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 6719
W20260812 08:02:53.299237  6420 connection.cc:573] server connection from 127.4.108.2:51733 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:53.299652  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 6875
I20260812 08:02:53.310079  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 6241
I20260812 08:02:53.321786  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 6323
I20260812 08:02:53.332943  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 6398
Shutting down hive metastore.
2026-08-12T08:02:53Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestRenameTableSync/1 (32628 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestMasterUUIDResolution/1
2026-08-12T08:02:53Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:53Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:	 jdbc:derby:/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/metadb;create=true
Metastore Connection Driver :	 org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User:	 APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 

 
 
 
 

 
 
 
 


 
 
 

 
 
 


 
 
 
 
 
 
 


 
 
 

 
 
 

 
 

 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 


 
 
 
 
 
 



 
 
 
 
 


 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 


Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/security.properties
2026-08-12 08:03:02: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260812 08:03:11.059897  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:41147
--webserver_interface=127.4.108.62
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--hive_metastore_uris=thrift://127.0.0.1:34659
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:03:11.177349  7479 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:11.177632  7479 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:11.177711  7479 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:11.181139  7479 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:11.181281  7479 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:11.181320  7479 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:11.181360  7479 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:11.185492  7479 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:34659
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:41147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.108.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:11.186865  7479 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:11.188107  7479 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:11.194402  7489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:11.194418  7486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:11.194433  7487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:11.194566  7479 server_base.cc:1061] running on GCE node
I20260812 08:03:11.195238  7479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:11.196274  7479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:11.197490  7479 hybrid_clock.cc:648] HybridClock initialized: now 1786521791197480 us; error 40 us; skew 500 ppm
I20260812 08:03:11.199627  7479 webserver.cc:533] Webserver started at http://127.4.108.62:42179/ using document root <none> and password file <none>
I20260812 08:03:11.200291  7479 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:11.200384  7479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:11.200635  7479 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:11.202378  7479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/instance:
uuid: "8bd756b1bda04dd1945b975d9895b512"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.203034  7479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal/instance:
uuid: "8bd756b1bda04dd1945b975d9895b512"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.206889  7479 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:03:11.209443  7495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:11.210762  7479 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:11.210930  7479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
uuid: "8bd756b1bda04dd1945b975d9895b512"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.211057  7479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:11.240445  7479 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:11.241377  7479 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:11.241607  7479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:11.250152  7552 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.62:41147 every 8 connection(s)
I20260812 08:03:11.250160  7479 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.62:41147
I20260812 08:03:11.251564  7479 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:11.254976  7553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:11.257668  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 7479
I20260812 08:03:11.257855  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal/instance
I20260812 08:03:11.258658  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:33901
--webserver_interface=127.4.108.61
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--hive_metastore_uris=thrift://127.0.0.1:34659
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:11.259115  7553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:11.275066  7553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:11.276074  7498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.61:33901: connect: Connection refused (error 111)
W20260812 08:03:11.277071  7553 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:33901: Network error: Client connection negotiation failed: client connection to 127.4.108.61:33901: connect: Connection refused (error 111)
I20260812 08:03:11.326363  7553 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } attempt: 1
W20260812 08:03:11.328083  7553 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:33901: Network error: Client connection negotiation failed: client connection to 127.4.108.61:33901: connect: Connection refused (error 111)
W20260812 08:03:11.370703  7554 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:11.370959  7554 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:11.371002  7554 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:11.374383  7554 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:11.374457  7554 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:11.374541  7554 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:11.374579  7554 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:11.378661  7554 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:34659
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:33901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.108.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:11.379806  7554 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:11.380910  7554 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:11.386665  7568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:11.386726  7570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:11.386663  7567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:11.386958  7554 server_base.cc:1061] running on GCE node
I20260812 08:03:11.387480  7554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:11.388491  7554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:11.389700  7554 hybrid_clock.cc:648] HybridClock initialized: now 1786521791389674 us; error 49 us; skew 500 ppm
I20260812 08:03:11.391614  7554 webserver.cc:533] Webserver started at http://127.4.108.61:39751/ using document root <none> and password file <none>
I20260812 08:03:11.392246  7554 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:11.392333  7554 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:11.392583  7554 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:11.394359  7554 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/instance:
uuid: "43327489534f47818b2fe579dcd5fbfa"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.394963  7554 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal/instance:
uuid: "43327489534f47818b2fe579dcd5fbfa"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.396282  7553 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } attempt: 2
W20260812 08:03:11.397704  7553 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:33901: Network error: Client connection negotiation failed: client connection to 127.4.108.61:33901: connect: Connection refused (error 111)
I20260812 08:03:11.399081  7554 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:03:11.401355  7576 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:11.402576  7554 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:11.402719  7554 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
uuid: "43327489534f47818b2fe579dcd5fbfa"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.402846  7554 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:11.426108  7554 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:11.426930  7554 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:11.427148  7554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:11.434983  7554 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.61:33901
I20260812 08:03:11.434986  7633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.61:33901 every 8 connection(s)
I20260812 08:03:11.436125  7554 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
I20260812 08:03:11.436810  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 7554
I20260812 08:03:11.436956  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal/instance
I20260812 08:03:11.437727  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:46263
--webserver_interface=127.4.108.60
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--hive_metastore_uris=thrift://127.0.0.1:34659
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:11.439445  7634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:11.443125  7634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:11.453155  7634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:11.459824  7634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:11.460887  7580 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.60:46263: connect: Connection refused (error 111)
W20260812 08:03:11.462060  7634 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:46263: Network error: Client connection negotiation failed: client connection to 127.4.108.60:46263: connect: Connection refused (error 111)
I20260812 08:03:11.488945  7553 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } attempt: 3
I20260812 08:03:11.494704  7553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:11.496491  7553 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:46263: Network error: Client connection negotiation failed: client connection to 127.4.108.60:46263: connect: Connection refused (error 111)
I20260812 08:03:11.511325  7634 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } attempt: 1
W20260812 08:03:11.513248  7634 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:46263: Network error: Client connection negotiation failed: client connection to 127.4.108.60:46263: connect: Connection refused (error 111)
I20260812 08:03:11.527720  7553 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } attempt: 1
W20260812 08:03:11.529542  7553 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:46263: Network error: Client connection negotiation failed: client connection to 127.4.108.60:46263: connect: Connection refused (error 111)
W20260812 08:03:11.561182  7636 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:11.561435  7636 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:11.561476  7636 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:11.565029  7636 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:11.565102  7636 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:11.565124  7636 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:11.565142  7636 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:11.569244  7636 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:34659
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:46263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.108.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:11.570394  7636 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:11.571656  7636 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:11.577507  7646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:11.577559  7650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:11.577507  7647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:11.578179  7636 server_base.cc:1061] running on GCE node
I20260812 08:03:11.578804  7636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:11.579777  7636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:11.580969  7636 hybrid_clock.cc:648] HybridClock initialized: now 1786521791580939 us; error 46 us; skew 500 ppm
I20260812 08:03:11.581420  7634 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } attempt: 2
W20260812 08:03:11.583113  7634 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:46263: Network error: Client connection negotiation failed: client connection to 127.4.108.60:46263: connect: Connection refused (error 111)
I20260812 08:03:11.583642  7636 webserver.cc:533] Webserver started at http://127.4.108.60:42679/ using document root <none> and password file <none>
I20260812 08:03:11.584326  7636 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:11.584385  7636 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:11.584559  7636 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:11.586462  7636 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/instance:
uuid: "e537ca691da8405796906eb5d85489db"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.587080  7636 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal/instance:
uuid: "e537ca691da8405796906eb5d85489db"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.590953  7636 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:03:11.593670  7658 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:11.595125  7636 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:11.595297  7636 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
uuid: "e537ca691da8405796906eb5d85489db"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:11.595424  7636 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:11.604737  7553 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } attempt: 2
W20260812 08:03:11.606459  7553 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:46263: Network error: Client connection negotiation failed: client connection to 127.4.108.60:46263: connect: Connection refused (error 111)
I20260812 08:03:11.608712  7636 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:11.609349  7636 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:11.609500  7636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:11.617990  7717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.60:46263 every 8 connection(s)
I20260812 08:03:11.618007  7636 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.60:46263
I20260812 08:03:11.619519  7636 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
I20260812 08:03:11.622819  7718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:11.625128  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 7636
I20260812 08:03:11.625228  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal/instance
I20260812 08:03:11.627051  7718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:11.636862  7718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:11.641464  7718 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:11.647925  7718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: Bootstrap starting.
I20260812 08:03:11.650642  7718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:11.651458  7718 log.cc:826] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:11.653429  7718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: No bootstrap required, opened a new log
I20260812 08:03:11.656437  7718 raft_consensus.cc:359] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:11.656680  7718 raft_consensus.cc:385] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:11.656771  7718 raft_consensus.cc:740] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e537ca691da8405796906eb5d85489db, State: Initialized, Role: FOLLOWER
I20260812 08:03:11.657256  7718 consensus_queue.cc:260] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:11.657873  7724 sys_catalog.cc:455] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.658095  7724 sys_catalog.cc:458] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:11.658797  7718 sys_catalog.cc:565] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:03:11.664415  7741 catalog_manager.cc:1594] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:11.664589  7741 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:11.662925  7636 master_runner.cc:187] Error getting master registration for 127.4.108.62:41147: OK, instance_id { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" instance_seqno: 1786521791247768 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:03:11.665206  7636 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:03:11.674324  7634 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } attempt: 3
I20260812 08:03:11.684437  7634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Bootstrap starting.
I20260812 08:03:11.691758  7634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:11.693001  7724 raft_consensus.cc:493] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:11.693264  7724 raft_consensus.cc:515] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:11.694532  7724 leader_election.cc:290] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bd756b1bda04dd1945b975d9895b512 (127.4.108.62:41147), 43327489534f47818b2fe579dcd5fbfa (127.4.108.61:33901)
I20260812 08:03:11.699831  7634 log.cc:826] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:11.705670  7553 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } attempt: 3
I20260812 08:03:11.715489  7553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Bootstrap starting.
I20260812 08:03:11.718767  7553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:11.720237  7553 log.cc:826] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:11.724614  7634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: No bootstrap required, opened a new log
I20260812 08:03:11.727626  7553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: No bootstrap required, opened a new log
I20260812 08:03:11.731318  7553 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:11.731675  7553 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:11.731794  7553 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bd756b1bda04dd1945b975d9895b512, State: Initialized, Role: FOLLOWER
I20260812 08:03:11.732462  7553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:11.732796  7634 raft_consensus.cc:359] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:11.733242  7634 raft_consensus.cc:385] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:11.733402  7634 raft_consensus.cc:740] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43327489534f47818b2fe579dcd5fbfa, State: Initialized, Role: FOLLOWER
I20260812 08:03:11.734278  7553 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:11.734340  7525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e537ca691da8405796906eb5d85489db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bd756b1bda04dd1945b975d9895b512" is_pre_election: true
I20260812 08:03:11.734673  7525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e537ca691da8405796906eb5d85489db in term 0.
I20260812 08:03:11.735216  7634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:11.735381  7663 leader_election.cc:304] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bd756b1bda04dd1945b975d9895b512, e537ca691da8405796906eb5d85489db; no voters: 
I20260812 08:03:11.735745  7724 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:03:11.735826  7724 raft_consensus.cc:493] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:11.735875  7724 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:11.737161  7724 raft_consensus.cc:515] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:11.737720  7724 leader_election.cc:290] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [CANDIDATE]: Term 1 election: Requested vote from peers 8bd756b1bda04dd1945b975d9895b512 (127.4.108.62:41147), 43327489534f47818b2fe579dcd5fbfa (127.4.108.61:33901)
I20260812 08:03:11.737679  7606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e537ca691da8405796906eb5d85489db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43327489534f47818b2fe579dcd5fbfa" is_pre_election: true
I20260812 08:03:11.738003  7606 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e537ca691da8405796906eb5d85489db in term 0.
I20260812 08:03:11.737609  7634 sys_catalog.cc:565] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:11.739151  7606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e537ca691da8405796906eb5d85489db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43327489534f47818b2fe579dcd5fbfa"
I20260812 08:03:11.739153  7525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e537ca691da8405796906eb5d85489db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bd756b1bda04dd1945b975d9895b512"
I20260812 08:03:11.739291  7606 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:11.739300  7525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:11.740612  7606 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e537ca691da8405796906eb5d85489db in term 1.
I20260812 08:03:11.740621  7525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e537ca691da8405796906eb5d85489db in term 1.
I20260812 08:03:11.741048  7661 leader_election.cc:304] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43327489534f47818b2fe579dcd5fbfa, e537ca691da8405796906eb5d85489db; no voters: 
I20260812 08:03:11.741221  7747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.741299  7724 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:11.741362  7747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:11.741581  7724 raft_consensus.cc:697] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 1 LEADER]: Becoming Leader. State: Replica: e537ca691da8405796906eb5d85489db, State: Running, Role: LEADER
I20260812 08:03:11.741990  7724 consensus_queue.cc:237] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
W20260812 08:03:11.743264  7502 tablet.cc:2406] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:11.743961  7724 sys_catalog.cc:455] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: SysCatalogTable state changed. Reason: New leader e537ca691da8405796906eb5d85489db. Latest consensus state: current_term: 1 leader_uuid: "e537ca691da8405796906eb5d85489db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.744093  7724 sys_catalog.cc:458] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:11.744590  7479 master_runner.cc:187] Error getting master registration for 127.4.108.61:33901: OK, instance_id { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" instance_seqno: 1786521791432700 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:03:11.746934  7479 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:03:11.747258  7781 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:11.748400  7781 catalog_manager.cc:1520] Initializing Kudu cluster ID...
W20260812 08:03:11.751961  7769 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:11.752076  7769 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:11.753295  7748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.753449  7748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:03:11.754031  7783 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:11.754164  7783 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:11.761751  7525 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 1 FOLLOWER]: Refusing update from remote peer e537ca691da8405796906eb5d85489db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:11.762046  7606 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 1 FOLLOWER]: Refusing update from remote peer e537ca691da8405796906eb5d85489db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:11.763447  7724 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:11.764801  7724 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [LEADER]: Connected to new peer: Peer: permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:11.770633  7747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e537ca691da8405796906eb5d85489db. Latest consensus state: current_term: 1 leader_uuid: "e537ca691da8405796906eb5d85489db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.770813  7747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:11.774928  7748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader e537ca691da8405796906eb5d85489db. Latest consensus state: current_term: 1 leader_uuid: "e537ca691da8405796906eb5d85489db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.775110  7748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:11.782922  7765 sys_catalog.cc:455] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e537ca691da8405796906eb5d85489db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.783084  7765 sys_catalog.cc:458] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:11.784300  7724 sys_catalog.cc:455] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e537ca691da8405796906eb5d85489db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.784435  7724 sys_catalog.cc:458] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:11.785209  7747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e537ca691da8405796906eb5d85489db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.785327  7747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:11.785676  7748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e537ca691da8405796906eb5d85489db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:11.785789  7748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:11.786573  7792 mvcc.cc:204] Tried to move back new op lower bound from 7317593259041181696 to 7317593258979082240. Current Snapshot: MvccSnapshot[applied={T|T < 7317593259041181696}]
I20260812 08:03:11.789490  7790 mvcc.cc:204] Tried to move back new op lower bound from 7317593259041181696 to 7317593258979082240. Current Snapshot: MvccSnapshot[applied={T|T < 7317593259041181696 or (T in {7317593259041181696})}]
I20260812 08:03:11.792191  7781 catalog_manager.cc:1383] Generated new cluster ID: 159582ef6022439ba27d6b0ae68d0e69
I20260812 08:03:11.792277  7781 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:11.834596  7781 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:11.835963  7781 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:11.854550  7781 catalog_manager.cc:6092] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: Generated new TSK 0
I20260812 08:03:11.855381  7781 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:11.855973  7781 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:03:11.856451  7781 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:03:11.869608  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.1:0
--local_ip_for_outbound_sockets=127.4.108.1
--webserver_interface=127.4.108.1
--webserver_port=0
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:03:12.054268  7797 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:12.054608  7797 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:12.054713  7797 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:12.058372  7797 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:12.058604  7797 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.1
I20260812 08:03:12.063026  7797 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.108.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--never_fsync=true
--heap_profile_path=/tmp/kudu.7797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:12.064287  7797 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:12.065510  7797 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:12.072729  7802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.072751  7803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.072729  7806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.073632  7797 server_base.cc:1061] running on GCE node
I20260812 08:03:12.074151  7797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:12.074913  7797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:12.076152  7797 hybrid_clock.cc:648] HybridClock initialized: now 1786521792076129 us; error 45 us; skew 500 ppm
I20260812 08:03:12.078521  7797 webserver.cc:533] Webserver started at http://127.4.108.1:44509/ using document root <none> and password file <none>
I20260812 08:03:12.079226  7797 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:12.079286  7797 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:12.079533  7797 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:12.081480  7797 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/instance:
uuid: "75e828d14849428b81c7eb0b335bdb8f"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.082060  7797 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal/instance:
uuid: "75e828d14849428b81c7eb0b335bdb8f"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.086009  7797 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260812 08:03:12.088691  7813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.090188  7797 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:12.090329  7797 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
uuid: "75e828d14849428b81c7eb0b335bdb8f"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.090457  7797 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:12.104635  7797 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:12.105477  7797 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:12.105675  7797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:12.106359  7797 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:12.107745  7797 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:12.107807  7797 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.107862  7797 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:12.107889  7797 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.119434  7797 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.1:45719
I20260812 08:03:12.119468  7940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.1:45719 every 8 connection(s)
I20260812 08:03:12.120541  7797 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:12.123944  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 7797
I20260812 08:03:12.124078  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal/instance
I20260812 08:03:12.127614  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.2:0
--local_ip_for_outbound_sockets=127.4.108.2
--webserver_interface=127.4.108.2
--webserver_port=0
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:12.131794  7942 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41147
I20260812 08:03:12.131863  7941 heartbeater.cc:344] Connected to a master server at 127.4.108.60:46263
I20260812 08:03:12.132115  7943 heartbeater.cc:344] Connected to a master server at 127.4.108.61:33901
I20260812 08:03:12.132085  7942 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.132086  7941 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.132190  7943 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.132908  7943 heartbeater.cc:507] Master 127.4.108.61:33901 requested a full tablet report, sending...
I20260812 08:03:12.132899  7942 heartbeater.cc:507] Master 127.4.108.62:41147 requested a full tablet report, sending...
I20260812 08:03:12.132900  7941 heartbeater.cc:507] Master 127.4.108.60:46263 requested a full tablet report, sending...
I20260812 08:03:12.134588  7595 ts_manager.cc:194] Registered new tserver with Master: 75e828d14849428b81c7eb0b335bdb8f (127.4.108.1:45719)
I20260812 08:03:12.134739  7678 ts_manager.cc:194] Registered new tserver with Master: 75e828d14849428b81c7eb0b335bdb8f (127.4.108.1:45719)
I20260812 08:03:12.135139  7514 ts_manager.cc:194] Registered new tserver with Master: 75e828d14849428b81c7eb0b335bdb8f (127.4.108.1:45719)
I20260812 08:03:12.136508  7678 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.1:34707
W20260812 08:03:12.249449  7948 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:12.249715  7948 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:12.249809  7948 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:12.254779  7948 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:12.254963  7948 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.2
I20260812 08:03:12.260751  7948 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.108.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--never_fsync=true
--heap_profile_path=/tmp/kudu.7948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:12.262216  7948 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:12.263736  7948 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:12.271997  7955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.272001  7954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.271997  7957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.272289  7948 server_base.cc:1061] running on GCE node
I20260812 08:03:12.272763  7948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:12.273399  7948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:12.274569  7948 hybrid_clock.cc:648] HybridClock initialized: now 1786521792274560 us; error 42 us; skew 500 ppm
I20260812 08:03:12.276515  7948 webserver.cc:533] Webserver started at http://127.4.108.2:45905/ using document root <none> and password file <none>
I20260812 08:03:12.277172  7948 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:12.277262  7948 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:12.277477  7948 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:12.279330  7948 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/instance:
uuid: "3abd0c3ecc5b42c19524a65f4a5cb101"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.279855  7948 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal/instance:
uuid: "3abd0c3ecc5b42c19524a65f4a5cb101"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.283643  7948 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.001s
I20260812 08:03:12.286181  7963 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.287351  7948 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:12.287503  7948 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
uuid: "3abd0c3ecc5b42c19524a65f4a5cb101"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.287626  7948 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:12.323022  7948 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:12.323778  7948 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:12.323997  7948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:12.324647  7948 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:12.325778  7948 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:12.325855  7948 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.325930  7948 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:12.325973  7948 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.336241  7948 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.2:41449
I20260812 08:03:12.336277  8094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.2:41449 every 8 connection(s)
I20260812 08:03:12.337335  7948 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:12.338140  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 7948
I20260812 08:03:12.338261  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal/instance
I20260812 08:03:12.341554  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.3:0
--local_ip_for_outbound_sockets=127.4.108.3
--webserver_interface=127.4.108.3
--webserver_port=0
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:12.350404  8096 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41147
I20260812 08:03:12.350569  8095 heartbeater.cc:344] Connected to a master server at 127.4.108.60:46263
I20260812 08:03:12.350725  8095 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.350723  8096 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.350754  8098 heartbeater.cc:344] Connected to a master server at 127.4.108.61:33901
I20260812 08:03:12.350883  8098 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.351509  8095 heartbeater.cc:507] Master 127.4.108.60:46263 requested a full tablet report, sending...
I20260812 08:03:12.351505  8098 heartbeater.cc:507] Master 127.4.108.61:33901 requested a full tablet report, sending...
I20260812 08:03:12.351534  8096 heartbeater.cc:507] Master 127.4.108.62:41147 requested a full tablet report, sending...
I20260812 08:03:12.353071  7595 ts_manager.cc:194] Registered new tserver with Master: 3abd0c3ecc5b42c19524a65f4a5cb101 (127.4.108.2:41449)
I20260812 08:03:12.353195  7678 ts_manager.cc:194] Registered new tserver with Master: 3abd0c3ecc5b42c19524a65f4a5cb101 (127.4.108.2:41449)
I20260812 08:03:12.353539  7514 ts_manager.cc:194] Registered new tserver with Master: 3abd0c3ecc5b42c19524a65f4a5cb101 (127.4.108.2:41449)
I20260812 08:03:12.353951  7678 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.2:37979
I20260812 08:03:12.354197  8105 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e537ca691da8405796906eb5d85489db)
I20260812 08:03:12.354378  8105 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:12.355505  8105 leader_election.cc:290] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8bd756b1bda04dd1945b975d9895b512 (127.4.108.62:41147), e537ca691da8405796906eb5d85489db (127.4.108.60:46263)
I20260812 08:03:12.355897  7525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43327489534f47818b2fe579dcd5fbfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8bd756b1bda04dd1945b975d9895b512" is_pre_election: true
I20260812 08:03:12.355945  7688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43327489534f47818b2fe579dcd5fbfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e537ca691da8405796906eb5d85489db" is_pre_election: true
I20260812 08:03:12.356046  7525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43327489534f47818b2fe579dcd5fbfa in term 1.
I20260812 08:03:12.356446  7580 leader_election.cc:304] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43327489534f47818b2fe579dcd5fbfa, 8bd756b1bda04dd1945b975d9895b512; no voters: 
I20260812 08:03:12.356860  8105 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:03:12.356942  8105 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader e537ca691da8405796906eb5d85489db)
I20260812 08:03:12.357008  8105 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:12.357977  8105 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:12.358414  8105 leader_election.cc:290] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [CANDIDATE]: Term 2 election: Requested vote from peers 8bd756b1bda04dd1945b975d9895b512 (127.4.108.62:41147), e537ca691da8405796906eb5d85489db (127.4.108.60:46263)
I20260812 08:03:12.358942  7688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43327489534f47818b2fe579dcd5fbfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e537ca691da8405796906eb5d85489db"
I20260812 08:03:12.358966  7525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43327489534f47818b2fe579dcd5fbfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8bd756b1bda04dd1945b975d9895b512"
I20260812 08:03:12.359098  7525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:12.360244  7525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43327489534f47818b2fe579dcd5fbfa in term 2.
I20260812 08:03:12.360664  7580 leader_election.cc:304] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43327489534f47818b2fe579dcd5fbfa, 8bd756b1bda04dd1945b975d9895b512; no voters: e537ca691da8405796906eb5d85489db
I20260812 08:03:12.360885  8105 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:03:12.361186  8105 raft_consensus.cc:697] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 2 LEADER]: Becoming Leader. State: Replica: 43327489534f47818b2fe579dcd5fbfa, State: Running, Role: LEADER
I20260812 08:03:12.361527  8105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:12.362958  8106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43327489534f47818b2fe579dcd5fbfa. Latest consensus state: current_term: 2 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:12.363062  8106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:12.363405  8107 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:12.364568  8107 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:12.365147  8107 catalog_manager.cc:1295] Loaded cluster ID: 159582ef6022439ba27d6b0ae68d0e69
I20260812 08:03:12.365213  8107 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:12.366935  8107 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:12.367511  8107 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Loaded TSK: 0
I20260812 08:03:12.368324  8107 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:12.368747  8107 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:03:12.369093  8107 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:03:12.399925  7606 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 2 LEADER]: Rejecting Update request from peer e537ca691da8405796906eb5d85489db for earlier term 1. Current term is 2. Ops: []
I20260812 08:03:12.400667  8108 consensus_queue.cc:1059] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:03:12.400985  8108 consensus_queue.cc:1243] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [LEADER]: Peer 43327489534f47818b2fe579dcd5fbfa log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 08:03:12.401069  8109 raft_consensus.cc:3055] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:03:12.401134  8109 raft_consensus.cc:740] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e537ca691da8405796906eb5d85489db, State: Running, Role: LEADER
I20260812 08:03:12.401355  8109 consensus_queue.cc:260] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:12.401633  8109 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 1 FOLLOWER]: Advancing to term 2
W20260812 08:03:12.460036  8104 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:12.460278  8104 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:12.460371  8104 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:12.463794  8104 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:12.463912  8104 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.3
I20260812 08:03:12.467793  8104 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.108.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--never_fsync=true
--heap_profile_path=/tmp/kudu.8104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:12.468963  8104 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:12.470124  8104 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:12.477108  8114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.477110  8115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.477181  8104 server_base.cc:1061] running on GCE node
W20260812 08:03:12.477110  8118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.477768  8104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:12.478363  8104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:12.479529  8104 hybrid_clock.cc:648] HybridClock initialized: now 1786521792479523 us; error 47 us; skew 500 ppm
I20260812 08:03:12.481511  8104 webserver.cc:533] Webserver started at http://127.4.108.3:38697/ using document root <none> and password file <none>
I20260812 08:03:12.482127  8104 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:12.482185  8104 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:12.482409  8104 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:12.484212  8104 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/instance:
uuid: "c25453de4276432e8b94431a243ebc62"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.484754  8104 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal/instance:
uuid: "c25453de4276432e8b94431a243ebc62"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.488462  8104 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:12.490967  8125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.492446  8104 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:12.492623  8104 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
uuid: "c25453de4276432e8b94431a243ebc62"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:12.492744  8104 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:12.512755  8104 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:12.513484  8104 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:12.513695  8104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:12.514318  8104 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:12.515555  8104 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:12.515632  8104 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.515710  8104 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:12.515760  8104 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.526194  8104 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.3:39201
I20260812 08:03:12.526233  8249 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.3:39201 every 8 connection(s)
I20260812 08:03:12.527266  8104 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:12.529742  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 8104
I20260812 08:03:12.529876  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal/instance
I20260812 08:03:12.538563  8251 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41147
I20260812 08:03:12.538563  8252 heartbeater.cc:344] Connected to a master server at 127.4.108.61:33901
I20260812 08:03:12.538625  8250 heartbeater.cc:344] Connected to a master server at 127.4.108.60:46263
I20260812 08:03:12.538872  8250 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.538875  8252 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.538875  8251 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.539461  8250 heartbeater.cc:507] Master 127.4.108.60:46263 requested a full tablet report, sending...
I20260812 08:03:12.539462  8252 heartbeater.cc:507] Master 127.4.108.61:33901 requested a full tablet report, sending...
I20260812 08:03:12.539462  8251 heartbeater.cc:507] Master 127.4.108.62:41147 requested a full tablet report, sending...
I20260812 08:03:12.540628  7595 ts_manager.cc:194] Registered new tserver with Master: c25453de4276432e8b94431a243ebc62 (127.4.108.3:39201)
I20260812 08:03:12.540730  7514 ts_manager.cc:194] Registered new tserver with Master: c25453de4276432e8b94431a243ebc62 (127.4.108.3:39201)
I20260812 08:03:12.541909  7595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.3:47705
I20260812 08:03:12.542692  7678 ts_manager.cc:194] Registered new tserver with Master: c25453de4276432e8b94431a243ebc62 (127.4.108.3:39201)
I20260812 08:03:12.552628  4528 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:12.574415  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 7797
I20260812 08:03:12.588531  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 7948
I20260812 08:03:12.600817  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 8104
I20260812 08:03:12.610247  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 7479
I20260812 08:03:12.620173  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 7554
I20260812 08:03:12.631973  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 7636
I20260812 08:03:12.642323  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:41147
--webserver_interface=127.4.108.62
--webserver_port=42179
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--hive_metastore_uris=thrift://127.0.0.1:34659
--leader_failure_max_missed_heartbeat_periods=1.0
--hive_metastore_uris=thrift://127.0.0.1:34659
--hive_metastore_sasl_enabled=false with env {}
W20260812 08:03:12.754413  8268 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:12.754705  8268 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:12.754750  8268 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:12.758545  8268 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:12.758662  8268 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:12.758693  8268 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:12.758759  8268 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:12.763141  8268 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:34659
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:41147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.108.62
--webserver_port=42179
--never_fsync=true
--heap_profile_path=/tmp/kudu.8268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:12.764457  8268 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:12.765749  8268 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:12.772044  8274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.772127  8278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.772150  8268 server_base.cc:1061] running on GCE node
W20260812 08:03:12.772063  8276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.772945  8268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:12.773885  8268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:12.775035  8268 hybrid_clock.cc:648] HybridClock initialized: now 1786521792775015 us; error 38 us; skew 500 ppm
I20260812 08:03:12.776999  8268 webserver.cc:533] Webserver started at http://127.4.108.62:42179/ using document root <none> and password file <none>
I20260812 08:03:12.777563  8268 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:12.777633  8268 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:12.781383  8268 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:12.783527  8285 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.784662  8268 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:12.784832  8268 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
uuid: "8bd756b1bda04dd1945b975d9895b512"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:12.785249  8268 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:12.800593  8268 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:12.801450  8268 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:12.801705  8268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:12.811233  8268 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.62:41147
I20260812 08:03:12.811236  8347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.62:41147 every 8 connection(s)
I20260812 08:03:12.812636  8268 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:12.817232  8348 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:03:12.819087  8348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Bootstrap starting.
I20260812 08:03:12.819857  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 8268
I20260812 08:03:12.820339  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:33901
--webserver_interface=127.4.108.61
--webserver_port=39751
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--hive_metastore_uris=thrift://127.0.0.1:34659
--leader_failure_max_missed_heartbeat_periods=1.0
--hive_metastore_uris=thrift://127.0.0.1:34659
--hive_metastore_sasl_enabled=false with env {}
I20260812 08:03:12.834861  8348 log.cc:826] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:12.841176  8348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:12.841662  8348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Bootstrap complete.
I20260812 08:03:12.845397  8348 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:12.845778  8348 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bd756b1bda04dd1945b975d9895b512, State: Initialized, Role: FOLLOWER
I20260812 08:03:12.846303  8348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:12.846846  8351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:12.846977  8351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:12.847558  8348 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:12.856467  8366 catalog_manager.cc:1295] Loaded cluster ID: 159582ef6022439ba27d6b0ae68d0e69
I20260812 08:03:12.856616  8366 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: loading cluster ID for follower catalog manager: success
I20260812 08:03:12.859153  8366 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: acquiring CA information for follower catalog manager: success
I20260812 08:03:12.860677  8366 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:12.872264  8268 master_runner.cc:187] Error getting master registration for 127.4.108.61:33901: Network error: Client connection negotiation failed: client connection to 127.4.108.61:33901: connect: Connection refused (error 111), 
I20260812 08:03:12.874397  8268 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:12.950359  8349 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:12.950712  8349 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:12.950794  8349 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:12.954463  8349 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:12.954620  8349 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:12.954658  8349 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:12.954698  8349 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:12.958935  8349 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:34659
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:33901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.108.61
--webserver_port=39751
--never_fsync=true
--heap_profile_path=/tmp/kudu.8349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:12.960196  8349 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:12.961418  8349 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:12.967458  8379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.967465  8376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.967475  8375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.968169  8349 server_base.cc:1061] running on GCE node
I20260812 08:03:12.968763  8349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:12.969764  8349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:12.970990  8349 hybrid_clock.cc:648] HybridClock initialized: now 1786521792970971 us; error 37 us; skew 500 ppm
I20260812 08:03:12.973237  8349 webserver.cc:533] Webserver started at http://127.4.108.61:39751/ using document root <none> and password file <none>
I20260812 08:03:12.973929  8349 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:12.974048  8349 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:12.979146  8349 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:12.981715  8385 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.983107  8349 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:12.983292  8349 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
uuid: "43327489534f47818b2fe579dcd5fbfa"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:12.983762  8349 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:13.005918  8349 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:13.006845  8349 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:13.007076  8349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:13.016027  8349 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.61:33901
I20260812 08:03:13.016083  8445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.61:33901 every 8 connection(s)
I20260812 08:03:13.017314  8349 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
I20260812 08:03:13.019966  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 8349
I20260812 08:03:13.020434  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:46263
--webserver_interface=127.4.108.60
--webserver_port=42679
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--hive_metastore_uris=thrift://127.0.0.1:34659
--leader_failure_max_missed_heartbeat_periods=1.0
--hive_metastore_uris=thrift://127.0.0.1:34659
--hive_metastore_sasl_enabled=false with env {}
I20260812 08:03:13.022946  8446 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:03:13.025364  8446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Bootstrap starting.
I20260812 08:03:13.044305  8446 log.cc:826] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:13.052707  8446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 08:03:13.053298  8446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Bootstrap complete.
I20260812 08:03:13.058605  8446 raft_consensus.cc:359] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.059348  8446 raft_consensus.cc:740] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43327489534f47818b2fe579dcd5fbfa, State: Initialized, Role: FOLLOWER
I20260812 08:03:13.060439  8446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.060987  8450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.061203  8450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:13.061779  8446 sys_catalog.cc:565] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:13.068606  8468 catalog_manager.cc:1295] Loaded cluster ID: 159582ef6022439ba27d6b0ae68d0e69
I20260812 08:03:13.068686  8468 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: loading cluster ID for follower catalog manager: success
I20260812 08:03:13.071154  8468 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: acquiring CA information for follower catalog manager: success
I20260812 08:03:13.072569  8468 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:13.094715  8349 master_runner.cc:187] Error getting master registration for 127.4.108.60:46263: Network error: Client connection negotiation failed: client connection to 127.4.108.60:46263: connect: Connection refused (error 111), 
I20260812 08:03:13.097036  8349 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:13.161727  8448 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:13.161995  8448 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:13.162039  8448 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:13.165702  8448 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:13.165792  8448 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:13.165814  8448 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:13.165832  8448 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:13.169938  8448 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:34659
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:46263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.108.60
--webserver_port=42679
--never_fsync=true
--heap_profile_path=/tmp/kudu.8448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:13.171342  8448 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:13.172536  8448 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:13.178526  8478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:13.178611  8483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:13.178519  8479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:13.178803  8448 server_base.cc:1061] running on GCE node
I20260812 08:03:13.179451  8448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:13.180528  8448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:13.181718  8448 hybrid_clock.cc:648] HybridClock initialized: now 1786521793181699 us; error 42 us; skew 500 ppm
I20260812 08:03:13.183665  8448 webserver.cc:533] Webserver started at http://127.4.108.60:42679/ using document root <none> and password file <none>
I20260812 08:03:13.184288  8448 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:13.184403  8448 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:13.188022  8448 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 08:03:13.190229  8491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.191418  8448 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260812 08:03:13.191543  8448 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
uuid: "e537ca691da8405796906eb5d85489db"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-5l3k"
I20260812 08:03:13.191951  8448 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:13.220237  8448 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:13.221038  8448 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:13.221256  8448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:13.230147  8448 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.60:46263
I20260812 08:03:13.230129  8547 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.60:46263 every 8 connection(s)
I20260812 08:03:13.231444  8448 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
I20260812 08:03:13.236907  8548 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:03:13.239288  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 8448
I20260812 08:03:13.239521  8548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: Bootstrap starting.
I20260812 08:03:13.239799  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.1:45719
--local_ip_for_outbound_sockets=127.4.108.1
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--webserver_port=44509
--webserver_interface=127.4.108.1
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:13.258949  8548 log.cc:826] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:13.267463  8548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:13.268029  8548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: Bootstrap complete.
I20260812 08:03:13.272930  8548 raft_consensus.cc:359] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.273401  8548 raft_consensus.cc:740] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e537ca691da8405796906eb5d85489db, State: Initialized, Role: FOLLOWER
I20260812 08:03:13.274019  8548 consensus_queue.cc:260] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.274572  8554 sys_catalog.cc:455] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.274765  8554 sys_catalog.cc:458] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:13.275345  8548 sys_catalog.cc:565] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:13.283533  8573 catalog_manager.cc:1295] Loaded cluster ID: 159582ef6022439ba27d6b0ae68d0e69
I20260812 08:03:13.283694  8573 catalog_manager.cc:1588] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: loading cluster ID for follower catalog manager: success
I20260812 08:03:13.288715  8573 catalog_manager.cc:1610] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: acquiring CA information for follower catalog manager: success
I20260812 08:03:13.298117  8573 catalog_manager.cc:1638] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:13.311015  8448 master_runner.cc:264] No leader master found from master e537ca691da8405796906eb5d85489db
I20260812 08:03:13.311141  8448 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:03:13.311510  8351 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:13.311720  8351 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.312903  8351 leader_election.cc:290] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43327489534f47818b2fe579dcd5fbfa (127.4.108.61:33901), e537ca691da8405796906eb5d85489db (127.4.108.60:46263)
I20260812 08:03:13.317683  8417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8bd756b1bda04dd1945b975d9895b512" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43327489534f47818b2fe579dcd5fbfa" is_pre_election: true
I20260812 08:03:13.318074  8417 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8bd756b1bda04dd1945b975d9895b512 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260812 08:03:13.318815  8520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8bd756b1bda04dd1945b975d9895b512" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e537ca691da8405796906eb5d85489db" is_pre_election: true
I20260812 08:03:13.319155  8520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bd756b1bda04dd1945b975d9895b512 in term 2.
I20260812 08:03:13.319602  8289 leader_election.cc:304] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bd756b1bda04dd1945b975d9895b512, e537ca691da8405796906eb5d85489db; no voters: 43327489534f47818b2fe579dcd5fbfa
I20260812 08:03:13.319901  8351 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:03:13.319974  8351 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:13.320019  8351 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:03:13.321746  8351 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.322155  8351 leader_election.cc:290] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [CANDIDATE]: Term 3 election: Requested vote from peers 43327489534f47818b2fe579dcd5fbfa (127.4.108.61:33901), e537ca691da8405796906eb5d85489db (127.4.108.60:46263)
I20260812 08:03:13.322798  8417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8bd756b1bda04dd1945b975d9895b512" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43327489534f47818b2fe579dcd5fbfa"
I20260812 08:03:13.322922  8520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8bd756b1bda04dd1945b975d9895b512" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e537ca691da8405796906eb5d85489db"
I20260812 08:03:13.322955  8417 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:03:13.323045  8520 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:03:13.325153  8520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bd756b1bda04dd1945b975d9895b512 in term 3.
I20260812 08:03:13.325233  8417 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8bd756b1bda04dd1945b975d9895b512 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260812 08:03:13.325676  8289 leader_election.cc:304] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8bd756b1bda04dd1945b975d9895b512, e537ca691da8405796906eb5d85489db; no voters: 43327489534f47818b2fe579dcd5fbfa
I20260812 08:03:13.325930  8351 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:03:13.326253  8351 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 3 LEADER]: Becoming Leader. State: Replica: 8bd756b1bda04dd1945b975d9895b512, State: Running, Role: LEADER
I20260812 08:03:13.326663  8351 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.328619  8580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bd756b1bda04dd1945b975d9895b512. Latest consensus state: current_term: 3 leader_uuid: "8bd756b1bda04dd1945b975d9895b512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.328745  8580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:13.329125  8582 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:13.330119  8582 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:13.330633  8582 catalog_manager.cc:1295] Loaded cluster ID: 159582ef6022439ba27d6b0ae68d0e69
I20260812 08:03:13.330708  8582 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:13.331260  8582 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:13.331669  8582 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Loaded TSK: 0
I20260812 08:03:13.332247  8582 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:13.332646  8582 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:03:13.333017  8582 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
W20260812 08:03:13.393457  8549 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:13.393787  8549 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:13.393867  8549 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:13.398736  8549 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:13.398916  8549 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.1
I20260812 08:03:13.404521  8549 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.1:45719
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.108.1
--webserver_port=44509
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--never_fsync=true
--heap_profile_path=/tmp/kudu.8549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:13.406021  8549 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:13.407850  8549 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:13.416133  8589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:13.416128  8588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:13.416128  8591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:13.416610  8549 server_base.cc:1061] running on GCE node
I20260812 08:03:13.417019  8549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:13.417721  8549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:13.418917  8549 hybrid_clock.cc:648] HybridClock initialized: now 1786521793418898 us; error 39 us; skew 500 ppm
I20260812 08:03:13.420897  8549 webserver.cc:533] Webserver started at http://127.4.108.1:44509/ using document root <none> and password file <none>
I20260812 08:03:13.421528  8549 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:13.421636  8549 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:13.425268  8549 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:13.427335  8597 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.428467  8549 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:13.428606  8549 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
uuid: "75e828d14849428b81c7eb0b335bdb8f"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:13.429028  8549 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:13.444422  8549 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:13.445133  8549 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:13.445353  8549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:13.445998  8549 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:13.447211  8549 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:13.447289  8549 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.447366  8549 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:13.447420  8549 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.459017  8549 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.1:45719
I20260812 08:03:13.459081  8732 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.1:45719 every 8 connection(s)
I20260812 08:03:13.460124  8549 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:13.466120  8450 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:13.466308  8450 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.467787  8450 leader_election.cc:290] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8bd756b1bda04dd1945b975d9895b512 (127.4.108.62:41147), e537ca691da8405796906eb5d85489db (127.4.108.60:46263)
I20260812 08:03:13.468264  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 8549
I20260812 08:03:13.468739  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.2:41449
--local_ip_for_outbound_sockets=127.4.108.2
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--webserver_port=45905
--webserver_interface=127.4.108.2
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:13.471413  8734 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41147
I20260812 08:03:13.471695  8734 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.472318  8734 heartbeater.cc:507] Master 127.4.108.62:41147 requested a full tablet report, sending...
I20260812 08:03:13.472646  8736 heartbeater.cc:344] Connected to a master server at 127.4.108.61:33901
I20260812 08:03:13.472750  8736 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.472954  8736 heartbeater.cc:507] Master 127.4.108.61:33901 requested a full tablet report, sending...
I20260812 08:03:13.473762  8316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43327489534f47818b2fe579dcd5fbfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8bd756b1bda04dd1945b975d9895b512" is_pre_election: true
I20260812 08:03:13.474651  8406 ts_manager.cc:194] Registered new tserver with Master: 75e828d14849428b81c7eb0b335bdb8f (127.4.108.1:45719)
I20260812 08:03:13.475178  8304 ts_manager.cc:194] Registered new tserver with Master: 75e828d14849428b81c7eb0b335bdb8f (127.4.108.1:45719)
I20260812 08:03:13.476889  8304 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.1:47859
I20260812 08:03:13.481119  8520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43327489534f47818b2fe579dcd5fbfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e537ca691da8405796906eb5d85489db" is_pre_election: true
I20260812 08:03:13.481323  8520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43327489534f47818b2fe579dcd5fbfa in term 3.
I20260812 08:03:13.481778  8391 leader_election.cc:304] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43327489534f47818b2fe579dcd5fbfa, e537ca691da8405796906eb5d85489db; no voters: 8bd756b1bda04dd1945b975d9895b512
I20260812 08:03:13.482070  8450 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:03:13.482126  8450 raft_consensus.cc:493] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:13.482165  8450 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:03:13.482662  8733 heartbeater.cc:344] Connected to a master server at 127.4.108.60:46263
I20260812 08:03:13.482774  8733 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.483013  8733 heartbeater.cc:507] Master 127.4.108.60:46263 requested a full tablet report, sending...
I20260812 08:03:13.483402  8450 raft_consensus.cc:515] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.483836  8450 leader_election.cc:290] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [CANDIDATE]: Term 4 election: Requested vote from peers 8bd756b1bda04dd1945b975d9895b512 (127.4.108.62:41147), e537ca691da8405796906eb5d85489db (127.4.108.60:46263)
I20260812 08:03:13.484521  8316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43327489534f47818b2fe579dcd5fbfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8bd756b1bda04dd1945b975d9895b512"
I20260812 08:03:13.485118  8509 ts_manager.cc:194] Registered new tserver with Master: 75e828d14849428b81c7eb0b335bdb8f (127.4.108.1:45719)
I20260812 08:03:13.485664  8520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "43327489534f47818b2fe579dcd5fbfa" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e537ca691da8405796906eb5d85489db"
I20260812 08:03:13.485790  8520 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:03:13.486927  8520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43327489534f47818b2fe579dcd5fbfa in term 4.
I20260812 08:03:13.487337  8391 leader_election.cc:304] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43327489534f47818b2fe579dcd5fbfa, e537ca691da8405796906eb5d85489db; no voters: 8bd756b1bda04dd1945b975d9895b512
I20260812 08:03:13.487617  8450 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 4 FOLLOWER]: Leader election won for term 4
I20260812 08:03:13.487841  8450 raft_consensus.cc:697] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 4 LEADER]: Becoming Leader. State: Replica: 43327489534f47818b2fe579dcd5fbfa, State: Running, Role: LEADER
I20260812 08:03:13.488229  8450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.490263  8743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43327489534f47818b2fe579dcd5fbfa. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.490403  8743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:13.490810  8745 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:13.492110  8745 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:13.492588  8745 catalog_manager.cc:1295] Loaded cluster ID: 159582ef6022439ba27d6b0ae68d0e69
I20260812 08:03:13.492657  8745 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:13.493296  8745 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:13.493785  8745 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa: Loaded TSK: 0
I20260812 08:03:13.494593  8745 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:13.495070  8745 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:03:13.495507  8745 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
W20260812 08:03:13.594048  8742 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:13.594332  8742 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:13.594425  8742 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:13.598006  8742 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:13.598198  8742 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.2
I20260812 08:03:13.602816  8742 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.2:41449
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.108.2
--webserver_port=45905
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--never_fsync=true
--heap_profile_path=/tmp/kudu.8742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:13.604043  8742 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:13.605228  8742 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:13.612386  8754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:13.612358  8751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:13.612567  8742 server_base.cc:1061] running on GCE node
W20260812 08:03:13.612358  8752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:13.613106  8742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:13.613718  8742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:13.614914  8742 hybrid_clock.cc:648] HybridClock initialized: now 1786521793614882 us; error 48 us; skew 500 ppm
I20260812 08:03:13.616710  8742 webserver.cc:533] Webserver started at http://127.4.108.2:45905/ using document root <none> and password file <none>
I20260812 08:03:13.617283  8742 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:13.617429  8742 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:13.620924  8742 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:13.622925  8761 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.624029  8742 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:13.624128  8742 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
uuid: "3abd0c3ecc5b42c19524a65f4a5cb101"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:13.624560  8742 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:13.641978  8742 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:13.642772  8742 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:13.642975  8742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:13.643610  8742 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:13.644707  8742 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:13.644757  8742 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.644829  8742 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:13.644869  8742 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.655222  8742 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.2:41449
I20260812 08:03:13.655293  8898 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.2:41449 every 8 connection(s)
I20260812 08:03:13.656406  8742 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:13.663532  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 8742
I20260812 08:03:13.664067  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.3:39201
--local_ip_for_outbound_sockets=127.4.108.3
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--webserver_port=38697
--webserver_interface=127.4.108.3
--builtin_ntp_servers=127.4.108.20:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:13.667387  8901 heartbeater.cc:344] Connected to a master server at 127.4.108.61:33901
I20260812 08:03:13.667394  8899 heartbeater.cc:344] Connected to a master server at 127.4.108.60:46263
I20260812 08:03:13.667662  8901 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.667661  8899 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.668267  8901 heartbeater.cc:507] Master 127.4.108.61:33901 requested a full tablet report, sending...
I20260812 08:03:13.668267  8899 heartbeater.cc:507] Master 127.4.108.60:46263 requested a full tablet report, sending...
I20260812 08:03:13.668857  8900 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41147
I20260812 08:03:13.668947  8900 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.669176  8900 heartbeater.cc:507] Master 127.4.108.62:41147 requested a full tablet report, sending...
I20260812 08:03:13.669894  8304 ts_manager.cc:194] Registered new tserver with Master: 3abd0c3ecc5b42c19524a65f4a5cb101 (127.4.108.2:41449)
I20260812 08:03:13.669910  8509 ts_manager.cc:194] Registered new tserver with Master: 3abd0c3ecc5b42c19524a65f4a5cb101 (127.4.108.2:41449)
I20260812 08:03:13.670109  8406 ts_manager.cc:194] Registered new tserver with Master: 3abd0c3ecc5b42c19524a65f4a5cb101 (127.4.108.2:41449)
I20260812 08:03:13.670673  8304 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.2:59435
I20260812 08:03:13.671835  8406 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.2:34215
W20260812 08:03:13.780977  8909 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:13.781316  8909 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:13.781436  8909 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:13.784983  8909 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:13.785149  8909 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.3
I20260812 08:03:13.789321  8909 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.3:39201
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.108.3
--webserver_port=38697
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41147,127.4.108.61:33901,127.4.108.60:46263
--never_fsync=true
--heap_profile_path=/tmp/kudu.8909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:13.790661  8909 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:13.792244  8909 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:13.799930  8917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:13.799914  8914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:13.800030  8909 server_base.cc:1061] running on GCE node
W20260812 08:03:13.799916  8915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:13.800697  8909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:13.801409  8909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:13.802634  8909 hybrid_clock.cc:648] HybridClock initialized: now 1786521793802618 us; error 41 us; skew 500 ppm
I20260812 08:03:13.804809  8909 webserver.cc:533] Webserver started at http://127.4.108.3:38697/ using document root <none> and password file <none>
I20260812 08:03:13.805500  8909 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:13.805616  8909 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:13.809990  8909 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:13.812544  8923 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.813977  8909 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:13.814129  8909 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
uuid: "c25453de4276432e8b94431a243ebc62"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-5l3k"
I20260812 08:03:13.814689  8909 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:13.846320  8909 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:13.847132  8909 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:13.847302  8909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:13.847882  8909 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:13.849133  8909 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:13.849211  8909 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.849308  8909 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:13.849345  8909 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:13.859964  8909 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.3:39201
I20260812 08:03:13.859993  9059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.3:39201 every 8 connection(s)
I20260812 08:03:13.860131  8417 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [term 4 LEADER]: Rejecting Update request from peer 8bd756b1bda04dd1945b975d9895b512 for earlier term 3. Current term is 4. Ops: []
I20260812 08:03:13.860852  9052 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:03:13.861184  9052 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [LEADER]: Peer 43327489534f47818b2fe579dcd5fbfa log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 08:03:13.861326  9061 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 08:03:13.861388  9061 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8bd756b1bda04dd1945b975d9895b512, State: Running, Role: LEADER
I20260812 08:03:13.861456  8909 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestMasterUUIDResolution_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:13.861577  9061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } }
I20260812 08:03:13.861819  9061 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:03:13.862915  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 8909
I20260812 08:03:13.870661  8316 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 4 FOLLOWER]: Refusing update from remote peer 43327489534f47818b2fe579dcd5fbfa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 08:03:13.871701  8743 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:03:13.872000  8743 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [LEADER]: Peer 8bd756b1bda04dd1945b975d9895b512 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 08:03:13.872721  9062 heartbeater.cc:344] Connected to a master server at 127.4.108.60:46263
I20260812 08:03:13.873004  9062 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.873266  8316 pending_rounds.cc:85] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Aborting all ops after (but not including) 4
I20260812 08:03:13.873361  8316 pending_rounds.cc:107] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260812 08:03:13.873435  8316 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 08:03:13.873724  9062 heartbeater.cc:507] Master 127.4.108.60:46263 requested a full tablet report, sending...
I20260812 08:03:13.874920  9064 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41147
I20260812 08:03:13.875059  9064 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.875284  8509 ts_manager.cc:194] Registered new tserver with Master: c25453de4276432e8b94431a243ebc62 (127.4.108.3:39201)
I20260812 08:03:13.875341  9064 heartbeater.cc:507] Master 127.4.108.62:41147 requested a full tablet report, sending...
I20260812 08:03:13.875890  9065 heartbeater.cc:344] Connected to a master server at 127.4.108.61:33901
I20260812 08:03:13.875982  9065 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:13.876196  9065 heartbeater.cc:507] Master 127.4.108.61:33901 requested a full tablet report, sending...
I20260812 08:03:13.876307  8304 ts_manager.cc:194] Registered new tserver with Master: c25453de4276432e8b94431a243ebc62 (127.4.108.3:39201)
I20260812 08:03:13.876965  8406 ts_manager.cc:194] Registered new tserver with Master: c25453de4276432e8b94431a243ebc62 (127.4.108.3:39201)
I20260812 08:03:13.877092  9061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43327489534f47818b2fe579dcd5fbfa. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.877295  9061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:13.877631  8406 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.3:49701
I20260812 08:03:13.879251  8450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.879361  8450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:13.879540  8743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.879642  8743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:13.879949  8520 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [term 4 FOLLOWER]: Refusing update from remote peer 43327489534f47818b2fe579dcd5fbfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260812 08:03:13.879953  9052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.880060  9052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:13.880152  9052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.880225  9052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bd756b1bda04dd1945b975d9895b512 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:13.880658  8743 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 43327489534f47818b2fe579dcd5fbfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:03:13.883764  9080 sys_catalog.cc:455] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.883966  9080 sys_catalog.cc:458] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:13.884124  9080 sys_catalog.cc:455] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.884260  9080 sys_catalog.cc:458] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:13.884552  9076 sys_catalog.cc:455] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43327489534f47818b2fe579dcd5fbfa. Latest consensus state: current_term: 4 leader_uuid: "43327489534f47818b2fe579dcd5fbfa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bd756b1bda04dd1945b975d9895b512" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41147 } } peers { permanent_uuid: "43327489534f47818b2fe579dcd5fbfa" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 33901 } } peers { permanent_uuid: "e537ca691da8405796906eb5d85489db" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 46263 } } }
I20260812 08:03:13.884680  9076 sys_catalog.cc:458] T 00000000000000000000000000000000 P e537ca691da8405796906eb5d85489db [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:13.888374  4528 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:13.900557  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 8549
I20260812 08:03:13.912412  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 8742
I20260812 08:03:13.929193  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 8909
I20260812 08:03:13.938812  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 8268
I20260812 08:03:13.949268  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 8349
I20260812 08:03:13.961688  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 8448
Shutting down hive metastore.
2026-08-12T08:03:14Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestMasterUUIDResolution/1 (20639 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestClusterIdOnFailover/1
2026-08-12T08:03:14Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:03:14Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:	 jdbc:derby:/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/metadb;create=true
Metastore Connection Driver :	 org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User:	 APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 

 
 
 
 

 
 
 
 


 
 
 

 
 
 


 
 
 
 
 
 
 


 
 
 

 
 
 

 
 

 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 


 
 
 
 
 
 



 
 
 
 
 


 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 


Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/security.properties
2026-08-12 08:03:22: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-tasky9M1gb/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260812 08:03:33.439388  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:41073
--webserver_interface=127.4.108.62
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:46371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--hive_metastore_uris=thrift://127.0.0.1:42523
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:03:33.551550  9426 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:33.551826  9426 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:33.551865  9426 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:33.555388  9426 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:33.555461  9426 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:33.555482  9426 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:33.555501  9426 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:33.559675  9426 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:46371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42523
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.62:41073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.108.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:33.560949  9426 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:33.562237  9426 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:33.568506  9432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:33.568576  9433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:33.568572  9426 server_base.cc:1061] running on GCE node
W20260812 08:03:33.568504  9436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:33.569326  9426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:33.570448  9426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:33.571766  9426 hybrid_clock.cc:648] HybridClock initialized: now 1786521813571751 us; error 43 us; skew 500 ppm
I20260812 08:03:33.573951  9426 webserver.cc:533] Webserver started at http://127.4.108.62:36735/ using document root <none> and password file <none>
I20260812 08:03:33.574659  9426 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:33.574752  9426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:33.574970  9426 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:33.576673  9426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/data/instance:
uuid: "669210a6372845b8a4cb498895573541"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
I20260812 08:03:33.577200  9426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/wal/instance:
uuid: "669210a6372845b8a4cb498895573541"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
I20260812 08:03:33.581403  9426 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:03:33.584007  9443 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:33.585340  9426 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:33.585512  9426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/wal
uuid: "669210a6372845b8a4cb498895573541"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
I20260812 08:03:33.585695  9426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:33.604507  9426 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:33.605202  9426 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:33.605352  9426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:33.613217  9426 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.62:41073
I20260812 08:03:33.613207  9509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.62:41073 every 8 connection(s)
I20260812 08:03:33.614349  9426 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:33.616626  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 9426
I20260812 08:03:33.616727  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-0/wal/instance
I20260812 08:03:33.617378  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:37417
--webserver_interface=127.4.108.61
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:46371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--hive_metastore_uris=thrift://127.0.0.1:42523
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:33.617619  9510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:33.622154  9510 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:33.639226  9510 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:33.640338  9446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
W20260812 08:03:33.641414  9510 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:37417: Network error: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
I20260812 08:03:33.690683  9510 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } attempt: 1
W20260812 08:03:33.692625  9510 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:37417: Network error: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
W20260812 08:03:33.734828  9511 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:33.735137  9511 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:33.735248  9511 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:33.738974  9511 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:33.739099  9511 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:33.739140  9511 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:33.739189  9511 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:33.743419  9511 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:46371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42523
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.61:37417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.108.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:33.744736  9511 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:33.745980  9511 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:33.752095  9523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:33.752108  9521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:33.752547  9520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:33.753240  9511 server_base.cc:1061] running on GCE node
I20260812 08:03:33.753811  9511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:33.754946  9511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:33.756140  9511 hybrid_clock.cc:648] HybridClock initialized: now 1786521813756123 us; error 47 us; skew 500 ppm
I20260812 08:03:33.758183  9511 webserver.cc:533] Webserver started at http://127.4.108.61:38739/ using document root <none> and password file <none>
I20260812 08:03:33.758912  9511 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:33.759004  9511 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:33.759265  9511 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:33.760828  9510 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } attempt: 2
I20260812 08:03:33.761066  9511 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/data/instance:
uuid: "97ecc40c0f504b49830e9a3b39425e51"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
I20260812 08:03:33.761691  9511 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/wal/instance:
uuid: "97ecc40c0f504b49830e9a3b39425e51"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
W20260812 08:03:33.762652  9510 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.61:37417: Network error: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
I20260812 08:03:33.765635  9511 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:03:33.768191  9530 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:33.769687  9511 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260812 08:03:33.769872  9511 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/wal
uuid: "97ecc40c0f504b49830e9a3b39425e51"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
I20260812 08:03:33.770004  9511 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:33.788482  9511 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:33.789336  9511 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:33.789567  9511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:33.798130  9511 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.61:37417
I20260812 08:03:33.798115  9588 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.61:37417 every 8 connection(s)
I20260812 08:03:33.799393  9511 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/data/info.pb
I20260812 08:03:33.802618  9589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:33.805644  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 9511
I20260812 08:03:33.805786  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-1/wal/instance
I20260812 08:03:33.806618  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:40403
--webserver_interface=127.4.108.60
--webserver_port=0
--builtin_ntp_servers=127.4.108.20:46371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--hive_metastore_uris=thrift://127.0.0.1:42523
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:03:33.805950  9589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:33.817001  9589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:33.824261  9589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:33.825325  9533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.60:40403: connect: Connection refused (error 111)
W20260812 08:03:33.826391  9589 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:40403: Network error: Client connection negotiation failed: client connection to 127.4.108.60:40403: connect: Connection refused (error 111)
I20260812 08:03:33.853883  9510 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } attempt: 3
I20260812 08:03:33.858911  9510 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:03:33.860316  9510 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:40403: Network error: Client connection negotiation failed: client connection to 127.4.108.60:40403: connect: Connection refused (error 111)
I20260812 08:03:33.875666  9589 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } attempt: 1
W20260812 08:03:33.877277  9589 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:40403: Network error: Client connection negotiation failed: client connection to 127.4.108.60:40403: connect: Connection refused (error 111)
I20260812 08:03:33.891517  9510 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } attempt: 1
W20260812 08:03:33.893239  9510 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:40403: Network error: Client connection negotiation failed: client connection to 127.4.108.60:40403: connect: Connection refused (error 111)
W20260812 08:03:33.923393  9590 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:33.923664  9590 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:33.923763  9590 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:33.927393  9590 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:33.927479  9590 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:33.927501  9590 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:33.927520  9590 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:33.931859  9590 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:46371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:42523
--ipki_ca_key_size=768
--master_addresses=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.108.60:40403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.108.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:33.933156  9590 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:33.934455  9590 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:33.940531  9603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:33.940543  9601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:33.940543  9600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:33.941072  9590 server_base.cc:1061] running on GCE node
I20260812 08:03:33.941804  9590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:33.943241  9590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:33.944432  9590 hybrid_clock.cc:648] HybridClock initialized: now 1786521813944406 us; error 51 us; skew 500 ppm
I20260812 08:03:33.945473  9589 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } attempt: 2
W20260812 08:03:33.947417  9589 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:40403: Network error: Client connection negotiation failed: client connection to 127.4.108.60:40403: connect: Connection refused (error 111)
I20260812 08:03:33.947736  9590 webserver.cc:533] Webserver started at http://127.4.108.60:35775/ using document root <none> and password file <none>
I20260812 08:03:33.948407  9590 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:33.948469  9590 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:33.948716  9590 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:33.950438  9590 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/data/instance:
uuid: "8150887821534dce9e35bab0a49708c6"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
I20260812 08:03:33.951165  9590 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/wal/instance:
uuid: "8150887821534dce9e35bab0a49708c6"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
I20260812 08:03:33.955057  9590 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:03:33.957650  9610 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:33.959059  9590 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:33.959245  9590 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/wal
uuid: "8150887821534dce9e35bab0a49708c6"
format_stamp: "Formatted at 2026-08-12 08:03:33 on dist-test-slave-5l3k"
I20260812 08:03:33.959367  9590 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:33.968905  9510 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } attempt: 2
W20260812 08:03:33.970705  9510 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.108.60:40403: Network error: Client connection negotiation failed: client connection to 127.4.108.60:40403: connect: Connection refused (error 111)
I20260812 08:03:33.975046  9590 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:33.975835  9590 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:33.976048  9590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:33.985289  9590 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.60:40403
I20260812 08:03:33.985281  9667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.60:40403 every 8 connection(s)
I20260812 08:03:33.986441  9590 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/data/info.pb
I20260812 08:03:33.989530  9668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:33.992779  9668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:33.994498  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 9590
I20260812 08:03:33.994673  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/master-2/wal/instance
I20260812 08:03:34.006565  9668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:34.012816  9668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:03:34.021404  9668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: Bootstrap starting.
I20260812 08:03:34.023891  9668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:34.024716  9668 log.cc:826] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:34.026638  9668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: No bootstrap required, opened a new log
I20260812 08:03:34.029894  9668 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.030125  9668 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:34.030216  9668 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150887821534dce9e35bab0a49708c6, State: Initialized, Role: FOLLOWER
I20260812 08:03:34.030745  9668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.031668  9675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.031819  9675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:34.032251  9668 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:34.038568  9589 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } attempt: 3
I20260812 08:03:34.037158  9590 master_runner.cc:187] Error getting master registration for 127.4.108.62:41073: OK, instance_id { permanent_uuid: "669210a6372845b8a4cb498895573541" instance_seqno: 1786521813610978 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:03:34.040810  9590 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:34.043852  9691 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:34.044078  9691 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:34.048193  9589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51: Bootstrap starting.
I20260812 08:03:34.051290  9589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:34.052307  9589 log.cc:826] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:34.054654  9589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51: No bootstrap required, opened a new log
I20260812 08:03:34.058920  9589 raft_consensus.cc:359] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.059182  9589 raft_consensus.cc:385] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:34.059278  9589 raft_consensus.cc:740] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ecc40c0f504b49830e9a3b39425e51, State: Initialized, Role: FOLLOWER
I20260812 08:03:34.061820  9589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.063731  9589 sys_catalog.cc:565] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:34.069876  9510 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } attempt: 3
I20260812 08:03:34.068691  9511 master_runner.cc:187] Error getting master registration for 127.4.108.62:41073: OK, instance_id { permanent_uuid: "669210a6372845b8a4cb498895573541" instance_seqno: 1786521813610978 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:03:34.071486  9511 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:03:34.077863  9510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: Bootstrap starting.
I20260812 08:03:34.081691  9510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:34.083691  9510 log.cc:826] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: Log is configured to *not* fsync() on all Append() calls
W20260812 08:03:34.088517  9715 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:34.088642  9715 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:03:34.089001  9699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.089169  9699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:34.093138  9510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: No bootstrap required, opened a new log
I20260812 08:03:34.096931  9510 raft_consensus.cc:359] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.097175  9510 raft_consensus.cc:385] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:34.097250  9510 raft_consensus.cc:740] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669210a6372845b8a4cb498895573541, State: Initialized, Role: FOLLOWER
I20260812 08:03:34.097879  9510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.099401  9510 sys_catalog.cc:565] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:03:34.106753  9453 tablet.cc:2406] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:34.107504  9720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.107650  9720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:34.123333  9426 master_runner.cc:264] No leader master found from master 669210a6372845b8a4cb498895573541
I20260812 08:03:34.123441  9426 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:03:34.135931  9737 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:03:34.136053  9737 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 08:03:34.227465  9617 tablet.cc:2406] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:34.251407  9675 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:34.251639  9675 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.252831  9675 leader_election.cc:290] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669210a6372845b8a4cb498895573541 (127.4.108.62:41073), 97ecc40c0f504b49830e9a3b39425e51 (127.4.108.61:37417)
I20260812 08:03:34.253672  9477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8150887821534dce9e35bab0a49708c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669210a6372845b8a4cb498895573541" is_pre_election: true
I20260812 08:03:34.253672  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8150887821534dce9e35bab0a49708c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ecc40c0f504b49830e9a3b39425e51" is_pre_election: true
I20260812 08:03:34.253984  9561 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150887821534dce9e35bab0a49708c6 in term 0.
I20260812 08:03:34.253984  9477 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150887821534dce9e35bab0a49708c6 in term 0.
I20260812 08:03:34.254520  9612 leader_election.cc:304] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8150887821534dce9e35bab0a49708c6, 97ecc40c0f504b49830e9a3b39425e51; no voters: 
I20260812 08:03:34.254957  9675 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:03:34.255036  9675 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:34.255086  9675 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:34.256322  9675 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.259645  9675 leader_election.cc:290] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 1 election: Requested vote from peers 669210a6372845b8a4cb498895573541 (127.4.108.62:41073), 97ecc40c0f504b49830e9a3b39425e51 (127.4.108.61:37417)
I20260812 08:03:34.259924  9477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8150887821534dce9e35bab0a49708c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669210a6372845b8a4cb498895573541"
I20260812 08:03:34.260078  9477 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:34.260154  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8150887821534dce9e35bab0a49708c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97ecc40c0f504b49830e9a3b39425e51"
I20260812 08:03:34.260293  9561 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:34.261623  9561 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150887821534dce9e35bab0a49708c6 in term 1.
I20260812 08:03:34.261993  9477 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150887821534dce9e35bab0a49708c6 in term 1.
I20260812 08:03:34.262046  9612 leader_election.cc:304] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8150887821534dce9e35bab0a49708c6, 97ecc40c0f504b49830e9a3b39425e51; no voters: 
I20260812 08:03:34.262254  9675 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:34.268980  9675 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 1 LEADER]: Becoming Leader. State: Replica: 8150887821534dce9e35bab0a49708c6, State: Running, Role: LEADER
I20260812 08:03:34.269491  9675 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.271620  9675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8150887821534dce9e35bab0a49708c6. Latest consensus state: current_term: 1 leader_uuid: "8150887821534dce9e35bab0a49708c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.271791  9675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:34.280462  9744 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:34.282079  9744 catalog_manager.cc:1520] Initializing Kudu cluster ID...
W20260812 08:03:34.291343  9537 tablet.cc:2406] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:34.298633  9561 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 1 FOLLOWER]: Refusing update from remote peer 8150887821534dce9e35bab0a49708c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:34.299456  9741 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:34.304859  9699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8150887821534dce9e35bab0a49708c6. Latest consensus state: current_term: 1 leader_uuid: "8150887821534dce9e35bab0a49708c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.305027  9699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:34.306116  9477 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 1 FOLLOWER]: Refusing update from remote peer 8150887821534dce9e35bab0a49708c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:34.306751  9741 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:34.311125  9720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8150887821534dce9e35bab0a49708c6. Latest consensus state: current_term: 1 leader_uuid: "8150887821534dce9e35bab0a49708c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.311295  9720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:34.321552  9675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8150887821534dce9e35bab0a49708c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.321715  9675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:34.322357  9720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8150887821534dce9e35bab0a49708c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.322638  9720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:34.323007  9745 mvcc.cc:204] Tried to move back new op lower bound from 7317593351357009920 to 7317593351251873792. Current Snapshot: MvccSnapshot[applied={T|T < 7317593351357009920}]
I20260812 08:03:34.325764  9749 mvcc.cc:204] Tried to move back new op lower bound from 7317593351357009920 to 7317593351251873792. Current Snapshot: MvccSnapshot[applied={T|T < 7317593351357009920 or (T in {7317593351357009920})}]
I20260812 08:03:34.326905  9741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8150887821534dce9e35bab0a49708c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.327055  9741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:34.328495  9699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8150887821534dce9e35bab0a49708c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.328635  9699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:03:34.330807  9746 mvcc.cc:204] Tried to move back new op lower bound from 7317593351357009920 to 7317593351251873792. Current Snapshot: MvccSnapshot[applied={T|T < 7317593351357009920}]
I20260812 08:03:34.334638  9744 catalog_manager.cc:1383] Generated new cluster ID: 7c59f623cd304570916e15a2e6475582
I20260812 08:03:34.334728  9744 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:34.358029  9744 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:34.359261  9744 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:34.384902  9744 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: Generated new TSK 0
I20260812 08:03:34.385701  9744 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:34.386405  9744 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:03:34.386940  9744 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:03:34.415349  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.1:0
--local_ip_for_outbound_sockets=127.4.108.1
--webserver_interface=127.4.108.1
--webserver_port=0
--tserver_master_addrs=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--builtin_ntp_servers=127.4.108.20:46371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:03:34.558104  9759 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:34.558362  9759 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:34.558415  9759 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:34.561903  9759 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:34.562047  9759 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.1
I20260812 08:03:34.566447  9759 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:46371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.108.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--never_fsync=true
--heap_profile_path=/tmp/kudu.9759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:34.567873  9759 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:34.569110  9759 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:34.576378  9764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:34.576382  9768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:34.576367  9765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:34.577340  9759 server_base.cc:1061] running on GCE node
I20260812 08:03:34.577904  9759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:34.578639  9759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:34.579890  9759 hybrid_clock.cc:648] HybridClock initialized: now 1786521814579891 us; error 54 us; skew 500 ppm
I20260812 08:03:34.582118  9759 webserver.cc:533] Webserver started at http://127.4.108.1:45497/ using document root <none> and password file <none>
I20260812 08:03:34.582854  9759 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:34.582954  9759 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:34.583226  9759 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:34.584949  9759 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/data/instance:
uuid: "c0f0f8c42685418eb73e2945c35b23d4"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.585549  9759 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/wal/instance:
uuid: "c0f0f8c42685418eb73e2945c35b23d4"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.590037  9759 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260812 08:03:34.593108  9775 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:34.594733  9759 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:34.594906  9759 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
uuid: "c0f0f8c42685418eb73e2945c35b23d4"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.595021  9759 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:34.615830  9759 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:34.616678  9759 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:34.616874  9759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:34.617534  9759 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:34.618919  9759 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:34.618983  9759 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:34.619037  9759 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:34.619067  9759 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:34.630389  9759 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.1:35687
I20260812 08:03:34.630432  9908 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.1:35687 every 8 connection(s)
I20260812 08:03:34.631593  9759 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:34.635264  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 9759
I20260812 08:03:34.635387  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-0/wal/instance
I20260812 08:03:34.638811  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.2:0
--local_ip_for_outbound_sockets=127.4.108.2
--webserver_interface=127.4.108.2
--webserver_port=0
--tserver_master_addrs=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--builtin_ntp_servers=127.4.108.20:46371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:34.643412  9913 heartbeater.cc:344] Connected to a master server at 127.4.108.61:37417
I20260812 08:03:34.643463  9911 heartbeater.cc:344] Connected to a master server at 127.4.108.60:40403
I20260812 08:03:34.643699  9911 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:34.643698  9913 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:34.643841  9912 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41073
I20260812 08:03:34.643908  9912 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:34.644395  9912 heartbeater.cc:507] Master 127.4.108.62:41073 requested a full tablet report, sending...
I20260812 08:03:34.644409  9913 heartbeater.cc:507] Master 127.4.108.61:37417 requested a full tablet report, sending...
I20260812 08:03:34.644413  9911 heartbeater.cc:507] Master 127.4.108.60:40403 requested a full tablet report, sending...
I20260812 08:03:34.646194  9550 ts_manager.cc:194] Registered new tserver with Master: c0f0f8c42685418eb73e2945c35b23d4 (127.4.108.1:35687)
I20260812 08:03:34.646219  9463 ts_manager.cc:194] Registered new tserver with Master: c0f0f8c42685418eb73e2945c35b23d4 (127.4.108.1:35687)
I20260812 08:03:34.647293  9629 ts_manager.cc:194] Registered new tserver with Master: c0f0f8c42685418eb73e2945c35b23d4 (127.4.108.1:35687)
I20260812 08:03:34.648520  9629 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.1:60663
W20260812 08:03:34.757889  9922 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:34.758163  9922 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:34.758215  9922 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:34.761801  9922 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:34.761942  9922 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.2
I20260812 08:03:34.766390  9922 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:46371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.108.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--never_fsync=true
--heap_profile_path=/tmp/kudu.9922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:34.767709  9922 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:34.768944  9922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:34.776445  9928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:34.776528  9930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:34.776454  9927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:34.777185  9922 server_base.cc:1061] running on GCE node
I20260812 08:03:34.777637  9922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:34.778252  9922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:34.779440  9922 hybrid_clock.cc:648] HybridClock initialized: now 1786521814779412 us; error 46 us; skew 500 ppm
I20260812 08:03:34.781452  9922 webserver.cc:533] Webserver started at http://127.4.108.2:43781/ using document root <none> and password file <none>
I20260812 08:03:34.782090  9922 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:34.782188  9922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:34.782426  9922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:34.784124  9922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/data/instance:
uuid: "b705d4a4ce594653825578a9ab94fca1"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.784644  9922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/wal/instance:
uuid: "b705d4a4ce594653825578a9ab94fca1"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.788295  9922 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:34.790846  9936 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:34.792052  9922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:03:34.792229  9922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
uuid: "b705d4a4ce594653825578a9ab94fca1"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.792354  9922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:34.811539  9922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:34.812279  9922 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:34.812494  9922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:34.813128  9922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:34.814282  9922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:34.814359  9922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:34.814432  9922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:34.814484  9922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:34.824697  9922 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.2:36765
I20260812 08:03:34.824723 10068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.2:36765 every 8 connection(s)
I20260812 08:03:34.825778  9922 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:34.829885  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 9922
I20260812 08:03:34.830037  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-1/wal/instance
I20260812 08:03:34.833216  4528 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
/tmp/dist-test-tasky9M1gb/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.108.3:0
--local_ip_for_outbound_sockets=127.4.108.3
--webserver_interface=127.4.108.3
--webserver_port=0
--tserver_master_addrs=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--builtin_ntp_servers=127.4.108.20:46371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:03:34.837903 10071 heartbeater.cc:344] Connected to a master server at 127.4.108.61:37417
I20260812 08:03:34.838241 10071 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:34.838555 10069 heartbeater.cc:344] Connected to a master server at 127.4.108.60:40403
I20260812 08:03:34.838681 10069 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:34.839011 10071 heartbeater.cc:507] Master 127.4.108.61:37417 requested a full tablet report, sending...
I20260812 08:03:34.839010 10069 heartbeater.cc:507] Master 127.4.108.60:40403 requested a full tablet report, sending...
I20260812 08:03:34.840438  9629 ts_manager.cc:194] Registered new tserver with Master: b705d4a4ce594653825578a9ab94fca1 (127.4.108.2:36765)
I20260812 08:03:34.840461  9550 ts_manager.cc:194] Registered new tserver with Master: b705d4a4ce594653825578a9ab94fca1 (127.4.108.2:36765)
I20260812 08:03:34.841291  9629 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.2:37061
I20260812 08:03:34.843793 10070 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41073
I20260812 08:03:34.843921 10070 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:34.844117 10070 heartbeater.cc:507] Master 127.4.108.62:41073 requested a full tablet report, sending...
I20260812 08:03:34.844931  9463 ts_manager.cc:194] Registered new tserver with Master: b705d4a4ce594653825578a9ab94fca1 (127.4.108.2:36765)
I20260812 08:03:34.882396 10077 raft_consensus.cc:493] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8150887821534dce9e35bab0a49708c6)
I20260812 08:03:34.882632 10077 raft_consensus.cc:515] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.883666 10077 leader_election.cc:290] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 669210a6372845b8a4cb498895573541 (127.4.108.62:41073), 8150887821534dce9e35bab0a49708c6 (127.4.108.60:40403)
I20260812 08:03:34.884125  9477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97ecc40c0f504b49830e9a3b39425e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "669210a6372845b8a4cb498895573541" is_pre_election: true
I20260812 08:03:34.884223 10079 raft_consensus.cc:493] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8150887821534dce9e35bab0a49708c6)
I20260812 08:03:34.884414 10079 raft_consensus.cc:515] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.884418  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97ecc40c0f504b49830e9a3b39425e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8150887821534dce9e35bab0a49708c6" is_pre_election: true
I20260812 08:03:34.884819  9477 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97ecc40c0f504b49830e9a3b39425e51 in term 1.
I20260812 08:03:34.885272  9531 leader_election.cc:304] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 669210a6372845b8a4cb498895573541, 97ecc40c0f504b49830e9a3b39425e51; no voters: 8150887821534dce9e35bab0a49708c6
I20260812 08:03:34.885766 10077 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:03:34.885735  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "669210a6372845b8a4cb498895573541" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8150887821534dce9e35bab0a49708c6" is_pre_election: true
I20260812 08:03:34.885728  9561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "669210a6372845b8a4cb498895573541" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "97ecc40c0f504b49830e9a3b39425e51" is_pre_election: true
I20260812 08:03:34.885869 10077 raft_consensus.cc:493] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8150887821534dce9e35bab0a49708c6)
I20260812 08:03:34.885951 10077 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:34.886096 10079 leader_election.cc:290] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 97ecc40c0f504b49830e9a3b39425e51 (127.4.108.61:37417), 8150887821534dce9e35bab0a49708c6 (127.4.108.60:40403)
I20260812 08:03:34.887045 10077 raft_consensus.cc:515] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.887344  9561 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 669210a6372845b8a4cb498895573541 in current term 2: Already voted for candidate 97ecc40c0f504b49830e9a3b39425e51 in this term.
I20260812 08:03:34.887729 10077 leader_election.cc:290] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [CANDIDATE]: Term 2 election: Requested vote from peers 669210a6372845b8a4cb498895573541 (127.4.108.62:41073), 8150887821534dce9e35bab0a49708c6 (127.4.108.60:40403)
I20260812 08:03:34.887857  9477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97ecc40c0f504b49830e9a3b39425e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "669210a6372845b8a4cb498895573541"
I20260812 08:03:34.887992  9477 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:34.888163  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "97ecc40c0f504b49830e9a3b39425e51" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8150887821534dce9e35bab0a49708c6"
I20260812 08:03:34.888185  9446 leader_election.cc:304] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 669210a6372845b8a4cb498895573541; no voters: 8150887821534dce9e35bab0a49708c6, 97ecc40c0f504b49830e9a3b39425e51
I20260812 08:03:34.889127  9477 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97ecc40c0f504b49830e9a3b39425e51 in term 2.
I20260812 08:03:34.889271 10079 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:03:34.889528  9531 leader_election.cc:304] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 669210a6372845b8a4cb498895573541, 97ecc40c0f504b49830e9a3b39425e51; no voters: 8150887821534dce9e35bab0a49708c6
I20260812 08:03:34.889693 10077 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:03:34.889895 10077 raft_consensus.cc:697] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 2 LEADER]: Becoming Leader. State: Replica: 97ecc40c0f504b49830e9a3b39425e51, State: Running, Role: LEADER
I20260812 08:03:34.890223 10077 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.891362 10080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97ecc40c0f504b49830e9a3b39425e51. Latest consensus state: current_term: 2 leader_uuid: "97ecc40c0f504b49830e9a3b39425e51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:34.891485 10080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:34.891793 10081 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:34.892921 10081 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:34.893399 10081 catalog_manager.cc:1295] Loaded cluster ID: 7c59f623cd304570916e15a2e6475582
I20260812 08:03:34.893474 10081 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:34.895144 10081 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:34.895702 10081 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51: Loaded TSK: 0
I20260812 08:03:34.896458 10081 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:34.896862 10081 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:03:34.897284 10081 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
W20260812 08:03:34.955770 10076 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:34.956018 10076 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:34.956071 10076 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260812 08:03:34.959591  9561 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 97ecc40c0f504b49830e9a3b39425e51 [term 2 LEADER]: Rejecting Update request from peer 8150887821534dce9e35bab0a49708c6 for earlier term 1. Current term is 2. Ops: []
W20260812 08:03:34.959980 10076 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:34.960162 10076 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.108.3
I20260812 08:03:34.960235 10085 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:03:34.960549 10085 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [LEADER]: Peer 97ecc40c0f504b49830e9a3b39425e51 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 08:03:34.960656 10086 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:03:34.960732 10086 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8150887821534dce9e35bab0a49708c6, State: Running, Role: LEADER
I20260812 08:03:34.960954 10086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:34.961263 10086 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:34.965159 10076 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.108.20:46371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.108.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.108.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.4.108.62:41073,127.4.108.61:37417,127.4.108.60:40403
--never_fsync=true
--heap_profile_path=/tmp/kudu.10076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.108.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:34.966361 10076 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:34.967707 10076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:34.974753 10089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:34.974776 10088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:34.974925 10091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:34.975600 10076 server_base.cc:1061] running on GCE node
I20260812 08:03:34.975957 10076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:34.976519 10076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:34.977690 10076 hybrid_clock.cc:648] HybridClock initialized: now 1786521814977673 us; error 32 us; skew 500 ppm
I20260812 08:03:34.979738 10076 webserver.cc:533] Webserver started at http://127.4.108.3:42753/ using document root <none> and password file <none>
I20260812 08:03:34.980357 10076 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:34.980415 10076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:34.980712 10076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:34.982406 10076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/data/instance:
uuid: "b5d87988e26d47b6b0a9b9e1e8dd12af"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.982996 10076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/wal/instance:
uuid: "b5d87988e26d47b6b0a9b9e1e8dd12af"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.987059 10076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:03:34.989672 10099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:34.991194 10076 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:34.991353 10076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/data,/tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
uuid: "b5d87988e26d47b6b0a9b9e1e8dd12af"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-5l3k"
I20260812 08:03:34.991472 10076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:35.032821 10076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:35.033766 10076 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:35.034044 10076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:35.034811 10076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:03:35.036078 10076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:35.036144 10076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.036222 10076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:35.036268 10076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.045902  9691 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:35.047626 10076 rpc_server.cc:307] RPC server started. Bound to: 127.4.108.3:40001
I20260812 08:03:35.047652 10231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.108.3:40001 every 8 connection(s)
I20260812 08:03:35.048822 10076 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:35.052142  4528 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu as pid 10076
I20260812 08:03:35.052287  4528 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasky9M1gb/test-tmp/master_failover-itest.3.HmsConfigurations_MasterFailoverTest.TestClusterIdOnFailover_1.1786521687308489-4528-0/minicluster-data/ts-2/wal/instance
I20260812 08:03:35.060822 10232 heartbeater.cc:344] Connected to a master server at 127.4.108.60:40403
I20260812 08:03:35.060879 10235 heartbeater.cc:344] Connected to a master server at 127.4.108.61:37417
I20260812 08:03:35.061116 10232 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:35.061115 10235 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:35.061184 10234 heartbeater.cc:344] Connected to a master server at 127.4.108.62:41073
I20260812 08:03:35.061319 10234 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:35.061815 10234 heartbeater.cc:507] Master 127.4.108.62:41073 requested a full tablet report, sending...
I20260812 08:03:35.061812 10232 heartbeater.cc:507] Master 127.4.108.60:40403 requested a full tablet report, sending...
I20260812 08:03:35.061825 10235 heartbeater.cc:507] Master 127.4.108.61:37417 requested a full tablet report, sending...
I20260812 08:03:35.063093  9550 ts_manager.cc:194] Registered new tserver with Master: b5d87988e26d47b6b0a9b9e1e8dd12af (127.4.108.3:40001)
I20260812 08:03:35.063156  9463 ts_manager.cc:194] Registered new tserver with Master: b5d87988e26d47b6b0a9b9e1e8dd12af (127.4.108.3:40001)
I20260812 08:03:35.063256  9629 ts_manager.cc:194] Registered new tserver with Master: b5d87988e26d47b6b0a9b9e1e8dd12af (127.4.108.3:40001)
I20260812 08:03:35.064481  9550 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.108.3:60425
I20260812 08:03:35.075156  4528 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:35.088421  4528 master_failover-itest.cc:507] Shutdown the leader master
I20260812 08:03:35.088515  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 9511
I20260812 08:03:35.137295  9737 catalog_manager.cc:1295] Loaded cluster ID: 7c59f623cd304570916e15a2e6475582
I20260812 08:03:35.137387  9737 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: loading cluster ID for follower catalog manager: success
I20260812 08:03:35.139153  9737 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: acquiring CA information for follower catalog manager: success
I20260812 08:03:35.140345  9737 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:03:35.150569  9911 heartbeater.cc:499] Master 127.4.108.60:40403 was elected leader, sending a full tablet report...
W20260812 08:03:35.150709  9913 heartbeater.cc:646] Failed to heartbeat to 127.4.108.61:37417 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
W20260812 08:03:35.342599 10071 heartbeater.cc:646] Failed to heartbeat to 127.4.108.61:37417 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
I20260812 08:03:35.343146 10069 heartbeater.cc:499] Master 127.4.108.60:40403 was elected leader, sending a full tablet report...
I20260812 08:03:35.411722 10086 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:35.411872 10086 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:35.412343 10086 leader_election.cc:290] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 669210a6372845b8a4cb498895573541 (127.4.108.62:41073), 97ecc40c0f504b49830e9a3b39425e51 (127.4.108.61:37417)
I20260812 08:03:35.412848  9477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8150887821534dce9e35bab0a49708c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "669210a6372845b8a4cb498895573541" is_pre_election: true
I20260812 08:03:35.413009  9477 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8150887821534dce9e35bab0a49708c6 in term 2.
W20260812 08:03:35.413080  9612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
I20260812 08:03:35.413380  9611 leader_election.cc:304] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669210a6372845b8a4cb498895573541, 8150887821534dce9e35bab0a49708c6; no voters: 
I20260812 08:03:35.413571 10086 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:03:35.413669 10086 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:35.413727 10086 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 2 FOLLOWER]: Advancing to term 3
W20260812 08:03:35.414036  9612 leader_election.cc:336] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 97ecc40c0f504b49830e9a3b39425e51 (127.4.108.61:37417): Network error: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
I20260812 08:03:35.414750 10086 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:35.415153 10086 leader_election.cc:290] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 3 election: Requested vote from peers 669210a6372845b8a4cb498895573541 (127.4.108.62:41073), 97ecc40c0f504b49830e9a3b39425e51 (127.4.108.61:37417)
I20260812 08:03:35.415512  9477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8150887821534dce9e35bab0a49708c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "669210a6372845b8a4cb498895573541"
I20260812 08:03:35.415665  9477 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 2 FOLLOWER]: Advancing to term 3
W20260812 08:03:35.416231  9612 leader_election.cc:336] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 97ecc40c0f504b49830e9a3b39425e51 (127.4.108.61:37417): Network error: Client connection negotiation failed: client connection to 127.4.108.61:37417: connect: Connection refused (error 111)
I20260812 08:03:35.416709  9477 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 669210a6372845b8a4cb498895573541 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8150887821534dce9e35bab0a49708c6 in term 3.
I20260812 08:03:35.417048  9611 leader_election.cc:304] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 669210a6372845b8a4cb498895573541, 8150887821534dce9e35bab0a49708c6; no voters: 97ecc40c0f504b49830e9a3b39425e51
I20260812 08:03:35.417259 10086 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:03:35.417379 10086 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [term 3 LEADER]: Becoming Leader. State: Replica: 8150887821534dce9e35bab0a49708c6, State: Running, Role: LEADER
I20260812 08:03:35.417553 10086 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } }
I20260812 08:03:35.418285 10085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8150887821534dce9e35bab0a49708c6. Latest consensus state: current_term: 3 leader_uuid: "8150887821534dce9e35bab0a49708c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669210a6372845b8a4cb498895573541" member_type: VOTER last_known_addr { host: "127.4.108.62" port: 41073 } } peers { permanent_uuid: "97ecc40c0f504b49830e9a3b39425e51" member_type: VOTER last_known_addr { host: "127.4.108.61" port: 37417 } } peers { permanent_uuid: "8150887821534dce9e35bab0a49708c6" member_type: VOTER last_known_addr { host: "127.4.108.60" port: 40403 } } }
I20260812 08:03:35.418412 10085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:35.418741 10252 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:35.419512 10252 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:35.419989 10252 catalog_manager.cc:1295] Loaded cluster ID: 7c59f623cd304570916e15a2e6475582
I20260812 08:03:35.420063 10252 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:35.420758 10252 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:35.421150 10252 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 8150887821534dce9e35bab0a49708c6: Loaded TSK: 0
I20260812 08:03:35.421579 10252 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:35.421944 10252 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 08:03:35.422282 10252 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 08:03:35.434824  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 9759
I20260812 08:03:35.446180  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 9922
I20260812 08:03:35.455965  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 10076
I20260812 08:03:35.467458  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 9426
I20260812 08:03:35.477089  4528 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasky9M1gb/build/debug/bin/kudu with pid 9590
Shutting down hive metastore.
2026-08-12T08:03:35Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestClusterIdOnFailover/1 (21502 ms)
[----------] 4 tests from HmsConfigurations/MasterFailoverTest (128575 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (128575 ms total)
[  PASSED  ] 4 tests.
