Note: This is test shard 1 of 4.
[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from HmsConfigurations/MasterFailoverTest
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestCreateTableSync/0
2026-08-12T08:01:04Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:04Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 08:01:04.065256 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:39589
--webserver_interface=127.26.116.126
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:01:04.181596 27104 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:04.181838 27104 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:04.181880 27104 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:04.185928 27104 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:04.186005 27104 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:04.186028 27104 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:04.186046 27104 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:04.190408 27104 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:39589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.116.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.27104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:04.191576 27104 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:04.192847 27104 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:04.198659 27112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:04.198730 27104 server_base.cc:1061] running on GCE node
W20260812 08:01:04.198663 27115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:04.198659 27118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:04.199452 27104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:04.200491 27104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:04.201663 27104 hybrid_clock.cc:648] HybridClock initialized: now 1786521664201657 us; error 65 us; skew 500 ppm
I20260812 08:01:04.203496 27104 webserver.cc:533] Webserver started at http://127.26.116.126:36343/ using document root <none> and password file <none>
I20260812 08:01:04.204131 27104 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:04.204187 27104 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:04.204391 27104 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:04.205947 27104 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/instance:
uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
I20260812 08:01:04.206444 27104 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance:
uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
I20260812 08:01:04.209858 27104 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 08:01:04.212106 27127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:04.213130 27104 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 08:01:04.213230 27104 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
I20260812 08:01:04.213356 27104 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:04.237785 27104 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:04.238554 27104 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:04.238786 27104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:04.250311 27214 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.126:39589 every 8 connection(s)
I20260812 08:01:04.250316 27104 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.126:39589
I20260812 08:01:04.251488 27104 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:04.254925 27215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:04.258761 27215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:04.261864 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 27104
I20260812 08:01:04.262038 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance
I20260812 08:01:04.263934 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:33337
--webserver_interface=127.26.116.125
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:04.272509 27215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:04.273455 27134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.125:33337: connect: Connection refused (error 111)
W20260812 08:01:04.274401 27215 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:33337: Network error: Client connection negotiation failed: client connection to 127.26.116.125:33337: connect: Connection refused (error 111)
I20260812 08:01:04.323731 27215 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } attempt: 1
W20260812 08:01:04.325417 27215 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:33337: Network error: Client connection negotiation failed: client connection to 127.26.116.125:33337: connect: Connection refused (error 111)
W20260812 08:01:04.371820 27221 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:04.372040 27221 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:04.372126 27221 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:04.375423 27221 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:04.375486 27221 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:04.375506 27221 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:04.375579 27221 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:04.379366 27221 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:33337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.116.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.27221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:04.380452 27221 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:04.381568 27221 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 08:01:04.387234 27221 server_base.cc:1061] running on GCE node
W20260812 08:01:04.387172 27235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:04.387192 27237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:04.387162 27243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:04.387931 27221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:04.388751 27221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:04.389935 27221 hybrid_clock.cc:648] HybridClock initialized: now 1786521664389909 us; error 43 us; skew 500 ppm
I20260812 08:01:04.391747 27221 webserver.cc:533] Webserver started at http://127.26.116.125:35659/ using document root <none> and password file <none>
I20260812 08:01:04.392325 27221 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:04.392409 27221 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:04.392653 27221 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:04.393637 27215 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } attempt: 2
I20260812 08:01:04.394399 27221 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/instance:
uuid: "4a8cfe62a7244af2bdc92daf896e9177"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
I20260812 08:01:04.394966 27221 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance:
uuid: "4a8cfe62a7244af2bdc92daf896e9177"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
W20260812 08:01:04.395119 27215 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:33337: Network error: Client connection negotiation failed: client connection to 127.26.116.125:33337: connect: Connection refused (error 111)
I20260812 08:01:04.398414 27221 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:01:04.400873 27256 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:04.401952 27221 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:04.402109 27221 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
uuid: "4a8cfe62a7244af2bdc92daf896e9177"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
I20260812 08:01:04.402222 27221 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:04.415911 27221 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:04.416601 27221 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:04.416803 27221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:04.425401 27351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.125:33337 every 8 connection(s)
I20260812 08:01:04.425410 27221 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.125:33337
I20260812 08:01:04.426548 27221 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
I20260812 08:01:04.429445 27353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:04.431026 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 27221
I20260812 08:01:04.431160 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance
I20260812 08:01:04.431887 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:44085
--webserver_interface=127.26.116.124
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:04.432878 27353 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:04.442617 27353 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:04.448688 27353 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:04.449483 27261 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.124:44085: connect: Connection refused (error 111)
W20260812 08:01:04.450362 27353 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:44085: Network error: Client connection negotiation failed: client connection to 127.26.116.124:44085: connect: Connection refused (error 111)
I20260812 08:01:04.486318 27215 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } attempt: 3
I20260812 08:01:04.491276 27215 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:04.492744 27215 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:44085: Network error: Client connection negotiation failed: client connection to 127.26.116.124:44085: connect: Connection refused (error 111)
I20260812 08:01:04.499581 27353 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } attempt: 1
W20260812 08:01:04.501118 27353 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:44085: Network error: Client connection negotiation failed: client connection to 127.26.116.124:44085: connect: Connection refused (error 111)
I20260812 08:01:04.524034 27215 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } attempt: 1
W20260812 08:01:04.525810 27215 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:44085: Network error: Client connection negotiation failed: client connection to 127.26.116.124:44085: connect: Connection refused (error 111)
W20260812 08:01:04.545805 27358 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:04.546044 27358 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:04.546085 27358 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:04.549351 27358 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:04.549410 27358 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:04.549432 27358 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:04.549450 27358 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:04.553220 27358 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:44085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.116.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.27358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:04.554291 27358 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:04.555387 27358 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:04.560680 27376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:04.560751 27375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:04.560673 27386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:04.560921 27358 server_base.cc:1061] running on GCE node
I20260812 08:01:04.561450 27358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:04.562382 27358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:04.563581 27358 hybrid_clock.cc:648] HybridClock initialized: now 1786521664563562 us; error 37 us; skew 500 ppm
I20260812 08:01:04.565579 27358 webserver.cc:533] Webserver started at http://127.26.116.124:39933/ using document root <none> and password file <none>
I20260812 08:01:04.566169 27358 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:04.566257 27358 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:04.566490 27358 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:04.568238 27358 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/instance:
uuid: "79880f59fe4e4d2781b36011272327ac"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
I20260812 08:01:04.568738 27358 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance:
uuid: "79880f59fe4e4d2781b36011272327ac"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
I20260812 08:01:04.569298 27353 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } attempt: 2
W20260812 08:01:04.570858 27353 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:44085: Network error: Client connection negotiation failed: client connection to 127.26.116.124:44085: connect: Connection refused (error 111)
I20260812 08:01:04.572868 27358 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260812 08:01:04.575055 27397 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:04.576272 27358 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:04.576464 27358 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
uuid: "79880f59fe4e4d2781b36011272327ac"
format_stamp: "Formatted at 2026-08-12 08:01:04 on dist-test-slave-92m1"
I20260812 08:01:04.576588 27358 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:04.596762 27358 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:04.597601 27358 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:04.597831 27358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:04.601011 27215 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } attempt: 2
W20260812 08:01:04.603078 27215 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:44085: Network error: Client connection negotiation failed: client connection to 127.26.116.124:44085: connect: Connection refused (error 111)
I20260812 08:01:04.608249 27358 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.124:44085
I20260812 08:01:04.608258 27478 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.124:44085 every 8 connection(s)
I20260812 08:01:04.609414 27358 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
I20260812 08:01:04.612324 27482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:04.615706 27482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:04.618757 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 27358
I20260812 08:01:04.618865 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance
I20260812 08:01:04.624691 27482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:04.629642 27482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:04.637962 27482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac: Bootstrap starting.
I20260812 08:01:04.640247 27482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:04.641019 27482 log.cc:826] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:04.643077 27482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac: No bootstrap required, opened a new log
I20260812 08:01:04.646415 27482 raft_consensus.cc:359] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.646688 27482 raft_consensus.cc:385] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:04.646786 27482 raft_consensus.cc:740] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79880f59fe4e4d2781b36011272327ac, State: Initialized, Role: FOLLOWER
I20260812 08:01:04.647338 27482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.647837 27501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.647965 27501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:04.648488 27482 sys_catalog.cc:565] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:01:04.653587 27520 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:04.653743 27520 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:04.652436 27358 master_runner.cc:187] Error getting master registration for 127.26.116.126:39589: OK, instance_id { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" instance_seqno: 1786521664248134 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:04.654994 27358 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:04.662062 27353 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } attempt: 3
I20260812 08:01:04.669168 27353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: Bootstrap starting.
I20260812 08:01:04.671550 27353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:04.672498 27353 log.cc:826] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:04.674538 27353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: No bootstrap required, opened a new log
I20260812 08:01:04.677760 27353 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.677917 27353 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:04.677951 27353 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8cfe62a7244af2bdc92daf896e9177, State: Initialized, Role: FOLLOWER
I20260812 08:01:04.678478 27353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.679055 27525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.679176 27525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:04.679809 27353 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:01:04.685546 27546 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:04.685663 27546 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:04.684347 27221 master_runner.cc:187] Error getting master registration for 127.26.116.126:39589: OK, instance_id { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" instance_seqno: 1786521664248134 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:04.686832 27221 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:04.702286 27215 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } attempt: 3
I20260812 08:01:04.708868 27215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: Bootstrap starting.
I20260812 08:01:04.711257 27215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:04.712316 27215 log.cc:826] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:04.713943 27215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: No bootstrap required, opened a new log
I20260812 08:01:04.717856 27215 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.718050 27215 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:04.718119 27215 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, State: Initialized, Role: FOLLOWER
I20260812 08:01:04.718595 27215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.719081 27554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.719275 27554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:04.719857 27215 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:01:04.725312 27569 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:04.725466 27569 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:04.731084 27104 master_runner.cc:264] No leader master found from master 3d3dfdf95f1d43b8b3e8d38f42b3cbac
I20260812 08:01:04.731165 27104 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:01:04.740442 27140 tablet.cc:2406] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:04.849361 27403 tablet.cc:2406] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:04.918370 27263 tablet.cc:2406] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:04.941342 27501 raft_consensus.cc:493] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:04.941633 27501 raft_consensus.cc:515] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.942694 27501 leader_election.cc:290] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d3dfdf95f1d43b8b3e8d38f42b3cbac (127.26.116.126:39589), 4a8cfe62a7244af2bdc92daf896e9177 (127.26.116.125:33337)
I20260812 08:01:04.943395 27177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79880f59fe4e4d2781b36011272327ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" is_pre_election: true
I20260812 08:01:04.943461 27309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79880f59fe4e4d2781b36011272327ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8cfe62a7244af2bdc92daf896e9177" is_pre_election: true
I20260812 08:01:04.943709 27177 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79880f59fe4e4d2781b36011272327ac in term 0.
I20260812 08:01:04.943737 27309 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79880f59fe4e4d2781b36011272327ac in term 0.
I20260812 08:01:04.944178 27401 leader_election.cc:304] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, 79880f59fe4e4d2781b36011272327ac; no voters: 
I20260812 08:01:04.944445 27501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:04.944540 27501 raft_consensus.cc:493] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:04.944618 27501 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:04.945575 27501 raft_consensus.cc:515] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.945984 27501 leader_election.cc:290] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [CANDIDATE]: Term 1 election: Requested vote from peers 3d3dfdf95f1d43b8b3e8d38f42b3cbac (127.26.116.126:39589), 4a8cfe62a7244af2bdc92daf896e9177 (127.26.116.125:33337)
I20260812 08:01:04.946365 27309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79880f59fe4e4d2781b36011272327ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8cfe62a7244af2bdc92daf896e9177"
I20260812 08:01:04.946406 27177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79880f59fe4e4d2781b36011272327ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac"
I20260812 08:01:04.946511 27309 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:04.946548 27177 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:04.947573 27309 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79880f59fe4e4d2781b36011272327ac in term 1.
I20260812 08:01:04.947631 27177 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79880f59fe4e4d2781b36011272327ac in term 1.
I20260812 08:01:04.947911 27400 leader_election.cc:304] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8cfe62a7244af2bdc92daf896e9177, 79880f59fe4e4d2781b36011272327ac; no voters: 
I20260812 08:01:04.948110 27501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:04.948385 27501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 1 LEADER]: Becoming Leader. State: Replica: 79880f59fe4e4d2781b36011272327ac, State: Running, Role: LEADER
I20260812 08:01:04.948804 27501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:04.950999 27573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79880f59fe4e4d2781b36011272327ac. Latest consensus state: current_term: 1 leader_uuid: "79880f59fe4e4d2781b36011272327ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.951130 27573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:04.951586 27579 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:04.952473 27579 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:04.957149 27177 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Refusing update from remote peer 79880f59fe4e4d2781b36011272327ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:04.957234 27309 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 1 FOLLOWER]: Refusing update from remote peer 79880f59fe4e4d2781b36011272327ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:04.957830 27501 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:04.958021 27573 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:04.961789 27554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79880f59fe4e4d2781b36011272327ac. Latest consensus state: current_term: 1 leader_uuid: "79880f59fe4e4d2781b36011272327ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.961910 27554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:04.961886 27525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79880f59fe4e4d2781b36011272327ac. Latest consensus state: current_term: 1 leader_uuid: "79880f59fe4e4d2781b36011272327ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.962005 27525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:04.964794 27501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "79880f59fe4e4d2781b36011272327ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.964919 27501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:04.964949 27554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "79880f59fe4e4d2781b36011272327ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.965075 27554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:04.965093 27581 mvcc.cc:204] Tried to move back new op lower bound from 7317592739657859072 to 7317592739633451008. Current Snapshot: MvccSnapshot[applied={T|T < 7317592739657859072}]
I20260812 08:01:04.964777 27588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "79880f59fe4e4d2781b36011272327ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.965215 27525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "79880f59fe4e4d2781b36011272327ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:04.965322 27525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:04.965459 27582 mvcc.cc:204] Tried to move back new op lower bound from 7317592739657859072 to 7317592739633451008. Current Snapshot: MvccSnapshot[applied={T|T < 7317592739657859072}]
I20260812 08:01:04.965297 27588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:04.967830 27579 catalog_manager.cc:1383] Generated new cluster ID: 73bdfc46a27b4821aa95c456c7c770ac
I20260812 08:01:04.967902 27579 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:04.990237 27579 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:04.991416 27579 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:05.000994 27579 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac: Generated new TSK 0
I20260812 08:01:05.001796 27579 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:05.009331 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.65:0
--local_ip_for_outbound_sockets=127.26.116.65
--webserver_interface=127.26.116.65
--webserver_port=0
--tserver_master_addrs=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--builtin_ntp_servers=127.26.116.84:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:01:05.116096 27594 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:05.116313 27594 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:05.116413 27594 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:05.119738 27594 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:05.119891 27594 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.65
I20260812 08:01:05.123759 27594 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.116.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--never_fsync=true
--heap_profile_path=/tmp/kudu.27594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:05.124864 27594 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:05.126041 27594 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:05.132848 27605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:05.133024 27594 server_base.cc:1061] running on GCE node
W20260812 08:01:05.132858 27602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:05.132858 27603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:05.133549 27594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:05.134032 27594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:05.135237 27594 hybrid_clock.cc:648] HybridClock initialized: now 1786521665135176 us; error 33 us; skew 500 ppm
I20260812 08:01:05.137219 27594 webserver.cc:533] Webserver started at http://127.26.116.65:34091/ using document root <none> and password file <none>
I20260812 08:01:05.137746 27594 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:05.137799 27594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:05.137950 27594 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:05.139549 27594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/instance:
uuid: "ca10131ba43c476d9629174c822e1c71"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.139984 27594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal/instance:
uuid: "ca10131ba43c476d9629174c822e1c71"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.143265 27594 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260812 08:01:05.145362 27615 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.146407 27594 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:05.146540 27594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
uuid: "ca10131ba43c476d9629174c822e1c71"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.146646 27594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:05.173666 27594 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:05.174392 27594 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:05.174595 27594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:05.175185 27594 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:05.176308 27594 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:05.176380 27594 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.176451 27594 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:05.176503 27594 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.189038 27594 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.65:43203
I20260812 08:01:05.189065 27835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.65:43203 every 8 connection(s)
I20260812 08:01:05.190012 27594 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:05.196759 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 27594
I20260812 08:01:05.196880 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:05.200065 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.66:0
--local_ip_for_outbound_sockets=127.26.116.66
--webserver_interface=127.26.116.66
--webserver_port=0
--tserver_master_addrs=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--builtin_ntp_servers=127.26.116.84:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:05.200634 27841 heartbeater.cc:344] Connected to a master server at 127.26.116.125:33337
I20260812 08:01:05.200881 27841 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.201411 27841 heartbeater.cc:507] Master 127.26.116.125:33337 requested a full tablet report, sending...
I20260812 08:01:05.200657 27839 heartbeater.cc:344] Connected to a master server at 127.26.116.126:39589
I20260812 08:01:05.202186 27839 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.202411 27839 heartbeater.cc:507] Master 127.26.116.126:39589 requested a full tablet report, sending...
I20260812 08:01:05.203045 27285 ts_manager.cc:194] Registered new tserver with Master: ca10131ba43c476d9629174c822e1c71 (127.26.116.65:43203)
I20260812 08:01:05.203305 27838 heartbeater.cc:344] Connected to a master server at 127.26.116.124:44085
I20260812 08:01:05.203380 27838 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.203555 27838 heartbeater.cc:507] Master 127.26.116.124:44085 requested a full tablet report, sending...
I20260812 08:01:05.203608 27164 ts_manager.cc:194] Registered new tserver with Master: ca10131ba43c476d9629174c822e1c71 (127.26.116.65:43203)
I20260812 08:01:05.204919 27421 ts_manager.cc:194] Registered new tserver with Master: ca10131ba43c476d9629174c822e1c71 (127.26.116.65:43203)
I20260812 08:01:05.206123 27421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.65:37165
W20260812 08:01:05.315671 27857 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:05.315941 27857 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:05.316046 27857 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:05.319386 27857 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:05.319566 27857 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.66
I20260812 08:01:05.323549 27857 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.116.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--never_fsync=true
--heap_profile_path=/tmp/kudu.27857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:05.324716 27857 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:05.325901 27857 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:05.332523 27863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:05.332559 27857 server_base.cc:1061] running on GCE node
W20260812 08:01:05.332525 27868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:05.332571 27871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:05.333180 27857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:05.333765 27857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:05.334923 27857 hybrid_clock.cc:648] HybridClock initialized: now 1786521665334884 us; error 52 us; skew 500 ppm
I20260812 08:01:05.336743 27857 webserver.cc:533] Webserver started at http://127.26.116.66:43567/ using document root <none> and password file <none>
I20260812 08:01:05.337317 27857 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:05.337378 27857 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:05.337585 27857 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:05.339280 27857 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/instance:
uuid: "4f81f09eee284571999245d088f3b409"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.339784 27857 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal/instance:
uuid: "4f81f09eee284571999245d088f3b409"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.343125 27857 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:05.345356 27882 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.346360 27857 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:05.346477 27857 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
uuid: "4f81f09eee284571999245d088f3b409"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.346575 27857 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:05.362175 27857 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:05.362833 27857 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:05.363039 27857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:05.363742 27857 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:05.364775 27857 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:05.364826 27857 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.364899 27857 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:05.364938 27857 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.376303 27857 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.66:41509
I20260812 08:01:05.376328 28087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.66:41509 every 8 connection(s)
I20260812 08:01:05.377396 27857 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:05.378379 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 27857
I20260812 08:01:05.378487 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:05.382025 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.67:0
--local_ip_for_outbound_sockets=127.26.116.67
--webserver_interface=127.26.116.67
--webserver_port=0
--tserver_master_addrs=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--builtin_ntp_servers=127.26.116.84:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:05.390568 28090 heartbeater.cc:344] Connected to a master server at 127.26.116.126:39589
I20260812 08:01:05.390661 28089 heartbeater.cc:344] Connected to a master server at 127.26.116.124:44085
I20260812 08:01:05.390712 28091 heartbeater.cc:344] Connected to a master server at 127.26.116.125:33337
I20260812 08:01:05.390847 28091 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.390851 28089 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.391498 28091 heartbeater.cc:507] Master 127.26.116.125:33337 requested a full tablet report, sending...
I20260812 08:01:05.391500 28089 heartbeater.cc:507] Master 127.26.116.124:44085 requested a full tablet report, sending...
I20260812 08:01:05.390848 28090 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.392436 28090 heartbeater.cc:507] Master 127.26.116.126:39589 requested a full tablet report, sending...
I20260812 08:01:05.392839 27285 ts_manager.cc:194] Registered new tserver with Master: 4f81f09eee284571999245d088f3b409 (127.26.116.66:41509)
I20260812 08:01:05.393293 27164 ts_manager.cc:194] Registered new tserver with Master: 4f81f09eee284571999245d088f3b409 (127.26.116.66:41509)
I20260812 08:01:05.393934 27421 ts_manager.cc:194] Registered new tserver with Master: 4f81f09eee284571999245d088f3b409 (127.26.116.66:41509)
I20260812 08:01:05.394811 27421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.66:60977
W20260812 08:01:05.493623 28099 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:05.493837 28099 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:05.493891 28099 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:05.497092 28099 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:05.497197 28099 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.67
I20260812 08:01:05.500988 28099 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.116.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:39589,127.26.116.125:33337,127.26.116.124:44085
--never_fsync=true
--heap_profile_path=/tmp/kudu.28099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:05.501518 28105 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79880f59fe4e4d2781b36011272327ac)
I20260812 08:01:05.501678 28105 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:05.502317 28099 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:05.502718 28105 leader_election.cc:290] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a8cfe62a7244af2bdc92daf896e9177 (127.26.116.125:33337), 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085)
I20260812 08:01:05.503170 27309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a8cfe62a7244af2bdc92daf896e9177" is_pre_election: true
I20260812 08:01:05.503278 27440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:05.503790 28099 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 08:01:05.503875 27135 leader_election.cc:304] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac; no voters: 4a8cfe62a7244af2bdc92daf896e9177, 79880f59fe4e4d2781b36011272327ac
I20260812 08:01:05.504148 28105 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:05.510030 28114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:05.510063 28111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:05.510125 28099 server_base.cc:1061] running on GCE node
W20260812 08:01:05.510038 28110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:05.510787 28099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:05.511305 28099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:05.512465 28099 hybrid_clock.cc:648] HybridClock initialized: now 1786521665512452 us; error 33 us; skew 500 ppm
I20260812 08:01:05.514135 28099 webserver.cc:533] Webserver started at http://127.26.116.67:46059/ using document root <none> and password file <none>
I20260812 08:01:05.514694 28099 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:05.514750 28099 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:05.514974 28099 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:05.516499 28099 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/instance:
uuid: "83fd95e4b69a423cbebdd4bebc4b38d2"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.516978 28099 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/instance:
uuid: "83fd95e4b69a423cbebdd4bebc4b38d2"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.520231 28099 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260812 08:01:05.522452 28126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.523540 28099 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:01:05.523658 28099 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
uuid: "83fd95e4b69a423cbebdd4bebc4b38d2"
format_stamp: "Formatted at 2026-08-12 08:01:05 on dist-test-slave-92m1"
I20260812 08:01:05.523752 28099 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:05.579708 28099 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:05.580564 28099 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:05.580843 28099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:05.581511 28099 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:05.582753 28099 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:05.582801 28099 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.582865 28099 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:05.582902 28099 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:05.594259 28099 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.67:38163
I20260812 08:01:05.594308 28325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.67:38163 every 8 connection(s)
I20260812 08:01:05.595237 28099 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:05.601382 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 28099
I20260812 08:01:05.601516 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:05.609885 28328 heartbeater.cc:344] Connected to a master server at 127.26.116.125:33337
I20260812 08:01:05.609954 28327 heartbeater.cc:344] Connected to a master server at 127.26.116.126:39589
I20260812 08:01:05.609958 28326 heartbeater.cc:344] Connected to a master server at 127.26.116.124:44085
I20260812 08:01:05.610136 28326 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.610133 28328 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.610132 28327 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:05.610749 28326 heartbeater.cc:507] Master 127.26.116.124:44085 requested a full tablet report, sending...
I20260812 08:01:05.610749 28327 heartbeater.cc:507] Master 127.26.116.126:39589 requested a full tablet report, sending...
I20260812 08:01:05.611408 28328 heartbeater.cc:507] Master 127.26.116.125:33337 requested a full tablet report, sending...
I20260812 08:01:05.611953 27421 ts_manager.cc:194] Registered new tserver with Master: 83fd95e4b69a423cbebdd4bebc4b38d2 (127.26.116.67:38163)
I20260812 08:01:05.612007 27164 ts_manager.cc:194] Registered new tserver with Master: 83fd95e4b69a423cbebdd4bebc4b38d2 (127.26.116.67:38163)
I20260812 08:01:05.612669 27421 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.67:55225
I20260812 08:01:05.613363 27285 ts_manager.cc:194] Registered new tserver with Master: 83fd95e4b69a423cbebdd4bebc4b38d2 (127.26.116.67:38163)
I20260812 08:01:05.623466 27089 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:05.633805 27089 master_failover-itest.cc:180] Pausing leader master
I20260812 08:01:05.689782 27546 catalog_manager.cc:1295] Loaded cluster ID: 73bdfc46a27b4821aa95c456c7c770ac
I20260812 08:01:05.689879 27546 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: loading cluster ID for follower catalog manager: success
I20260812 08:01:05.691840 27546 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: acquiring CA information for follower catalog manager: success
I20260812 08:01:05.692989 27546 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:05.708129 27838 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:05.726874 27569 catalog_manager.cc:1295] Loaded cluster ID: 73bdfc46a27b4821aa95c456c7c770ac
I20260812 08:01:05.726975 27569 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: loading cluster ID for follower catalog manager: success
I20260812 08:01:05.729189 27569 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: acquiring CA information for follower catalog manager: success
I20260812 08:01:05.730481 27569 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:05.893774 28353 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79880f59fe4e4d2781b36011272327ac)
I20260812 08:01:05.893955 28353 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:05.895116 28353 leader_election.cc:290] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d3dfdf95f1d43b8b3e8d38f42b3cbac (127.26.116.126:39589), 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085)
I20260812 08:01:05.895754 27177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" is_pre_election: true
I20260812 08:01:05.896765 28089 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:06.060070 28357 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79880f59fe4e4d2781b36011272327ac)
I20260812 08:01:06.060225 28357 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:06.060671 28357 leader_election.cc:290] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a8cfe62a7244af2bdc92daf896e9177 (127.26.116.125:33337), 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085)
I20260812 08:01:06.061358 27309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a8cfe62a7244af2bdc92daf896e9177" is_pre_election: true
I20260812 08:01:06.061517 27309 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3dfdf95f1d43b8b3e8d38f42b3cbac in term 1.
I20260812 08:01:06.061934 27134 leader_election.cc:304] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, 4a8cfe62a7244af2bdc92daf896e9177; no voters: 
I20260812 08:01:06.062170 28357 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:06.062237 28357 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79880f59fe4e4d2781b36011272327ac)
I20260812 08:01:06.062268 28357 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:06.063258 28357 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:06.063699 28357 leader_election.cc:290] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [CANDIDATE]: Term 2 election: Requested vote from peers 4a8cfe62a7244af2bdc92daf896e9177 (127.26.116.125:33337), 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085)
I20260812 08:01:06.064123 27309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4a8cfe62a7244af2bdc92daf896e9177"
I20260812 08:01:06.064250 27309 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:06.065330 27309 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3dfdf95f1d43b8b3e8d38f42b3cbac in term 2.
I20260812 08:01:06.065809 27134 leader_election.cc:304] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, 4a8cfe62a7244af2bdc92daf896e9177; no voters: 
I20260812 08:01:06.066044 28357 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:01:06.066284 28357 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 2 LEADER]: Becoming Leader. State: Replica: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, State: Running, Role: LEADER
I20260812 08:01:06.066624 28357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:06.067802 28358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3dfdf95f1d43b8b3e8d38f42b3cbac. Latest consensus state: current_term: 2 leader_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:06.067927 28358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:06.068246 28361 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:06.069018 28361 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:06.069343 28361 catalog_manager.cc:1295] Loaded cluster ID: 73bdfc46a27b4821aa95c456c7c770ac
I20260812 08:01:06.069386 28361 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:06.069891 28361 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:06.070240 28361 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac: Loaded TSK: 0
I20260812 08:01:06.070818 28361 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:06.114315 28326 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:06.615473 28327 heartbeater.cc:499] Master 127.26.116.126:39589 was elected leader, sending a full tablet report...
I20260812 08:01:06.664129 27309 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Refusing update from remote peer 3d3dfdf95f1d43b8b3e8d38f42b3cbac: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 08:01:06.664803 28364 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:01:06.666419 28367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3dfdf95f1d43b8b3e8d38f42b3cbac. Latest consensus state: current_term: 2 leader_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:06.666572 28367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:06.668097 28372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:06.668239 28372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:06.668435 28367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:06.668560 28367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:06.708037 27839 heartbeater.cc:499] Master 127.26.116.126:39589 was elected leader, sending a full tablet report...
W20260812 08:01:06.710776 27838 heartbeater.cc:646] Failed to heartbeat to 127.26.116.124:44085 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.124:44085 timed out after 1.000s (SENT)
I20260812 08:01:06.898000 28090 heartbeater.cc:499] Master 127.26.116.126:39589 was elected leader, sending a full tablet report...
W20260812 08:01:06.898125 28089 heartbeater.cc:646] Failed to heartbeat to 127.26.116.124:44085 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.124:44085 timed out after 1.000s (SENT)
W20260812 08:01:06.907816 27261 leader_election.cc:336] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085): Timed out: RequestConsensusVote RPC to 127.26.116.124:44085 timed out after 0.505s (SENT)
I20260812 08:01:06.907961 27261 leader_election.cc:304] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a8cfe62a7244af2bdc92daf896e9177; no voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, 79880f59fe4e4d2781b36011272327ac
I20260812 08:01:06.908278 28367 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:07.116441 28326 heartbeater.cc:646] Failed to heartbeat to 127.26.116.124:44085 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.124:44085 timed out after 1.000s (SENT)
I20260812 08:01:07.211117 27838 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
W20260812 08:01:07.256012 27135 leader_election.cc:336] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085): Timed out: RequestConsensusVote RPC to 127.26.116.124:44085 timed out after 0.596s (SENT)
I20260812 08:01:07.398437 28089 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
W20260812 08:01:07.475128 27135 leader_election.cc:336] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085): Timed out: RequestConsensusVote RPC to 127.26.116.124:44085 timed out after 0.704s (SENT)
I20260812 08:01:07.616822 28326 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:07.722929 28379 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d3dfdf95f1d43b8b3e8d38f42b3cbac)
I20260812 08:01:07.723096 28379 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:07.723645 28379 leader_election.cc:290] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d3dfdf95f1d43b8b3e8d38f42b3cbac (127.26.116.126:39589), 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085)
I20260812 08:01:07.724233 27177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" is_pre_election: true
I20260812 08:01:08.712543 27838 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
W20260812 08:01:08.895332 27261 leader_election.cc:336] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085): Timed out: RequestConsensusVote RPC to 127.26.116.124:44085 timed out after 0.584s (SENT)
I20260812 08:01:08.895453 27261 leader_election.cc:304] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a8cfe62a7244af2bdc92daf896e9177; no voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, 79880f59fe4e4d2781b36011272327ac
I20260812 08:01:08.895819 28384 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:01:08.900538 28089 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:09.119031 28326 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:09.879349 28386 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d3dfdf95f1d43b8b3e8d38f42b3cbac)
I20260812 08:01:09.879509 28386 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:09.879940 28386 leader_election.cc:290] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d3dfdf95f1d43b8b3e8d38f42b3cbac (127.26.116.126:39589), 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085)
I20260812 08:01:09.880515 27177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" is_pre_election: true
I20260812 08:01:10.214154 27838 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:10.401957 28089 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
W20260812 08:01:10.505702 27261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.124:44085 timed out after 0.625s (SENT) [suppressed 4 similar messages]
I20260812 08:01:10.620921 28326 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
W20260812 08:01:11.132333 27261 leader_election.cc:336] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085): Timed out: RequestConsensusVote RPC to 127.26.116.124:44085 timed out after 0.625s (SENT)
I20260812 08:01:11.132469 27261 leader_election.cc:304] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a8cfe62a7244af2bdc92daf896e9177; no voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, 79880f59fe4e4d2781b36011272327ac
I20260812 08:01:11.132822 28396 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:01:11.716209 27838 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:11.903566 28089 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:12.122750 28326 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:12.123879 28400 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d3dfdf95f1d43b8b3e8d38f42b3cbac)
I20260812 08:01:12.124044 28400 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:12.124634 28400 leader_election.cc:290] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d3dfdf95f1d43b8b3e8d38f42b3cbac (127.26.116.126:39589), 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085)
I20260812 08:01:12.125133 27177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" is_pre_election: true
I20260812 08:01:13.217799 27838 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:13.405593 28089 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
W20260812 08:01:13.452229 27261 leader_election.cc:336] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085): Timed out: RequestConsensusVote RPC to 127.26.116.124:44085 timed out after 0.662s (SENT)
I20260812 08:01:13.452345 27261 leader_election.cc:304] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a8cfe62a7244af2bdc92daf896e9177; no voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, 79880f59fe4e4d2781b36011272327ac
I20260812 08:01:13.452747 28412 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:01:13.624413 28326 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:14.202879 28413 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3d3dfdf95f1d43b8b3e8d38f42b3cbac)
I20260812 08:01:14.203047 28413 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:14.203573 28413 leader_election.cc:290] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3d3dfdf95f1d43b8b3e8d38f42b3cbac (127.26.116.126:39589), 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085)
I20260812 08:01:14.204101 27177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" is_pre_election: true
I20260812 08:01:14.719705 27838 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:14.907177 28089 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:15.125845 28326 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
W20260812 08:01:15.284799 27261 leader_election.cc:336] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79880f59fe4e4d2781b36011272327ac (127.26.116.124:44085): Timed out: RequestConsensusVote RPC to 127.26.116.124:44085 timed out after 0.539s (SENT)
I20260812 08:01:15.284914 27261 leader_election.cc:304] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a8cfe62a7244af2bdc92daf896e9177; no voters: 3d3dfdf95f1d43b8b3e8d38f42b3cbac, 79880f59fe4e4d2781b36011272327ac
I20260812 08:01:15.285352 28418 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 08:01:15.650614 28344 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.124:44085)
I20260812 08:01:15.653472 27164 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38184:
name: "default.test_create_table_sync"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:15.655977 27164 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_create_table_sync in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:15.674887 28216 tablet_service.cc:1511] Processing CreateTablet for tablet 43c10c3493204b17aeaf0de3a026df7d (DEFAULT_TABLE table=default.test_create_table_sync [id=99b8daca3b6e4ebb9cbeda21e221ea7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:15.675216 27713 tablet_service.cc:1511] Processing CreateTablet for tablet 43c10c3493204b17aeaf0de3a026df7d (DEFAULT_TABLE table=default.test_create_table_sync [id=99b8daca3b6e4ebb9cbeda21e221ea7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:15.675879 28216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c10c3493204b17aeaf0de3a026df7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:15.676110 27713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c10c3493204b17aeaf0de3a026df7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:15.680583 28442 tablet_bootstrap.cc:492] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2: Bootstrap starting.
I20260812 08:01:15.680594 28444 tablet_bootstrap.cc:492] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71: Bootstrap starting.
I20260812 08:01:15.682791 28442 tablet_bootstrap.cc:654] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:15.682801 28444 tablet_bootstrap.cc:654] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:15.683668 28442 log.cc:826] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:15.683704 28444 log.cc:826] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:15.683413 27966 tablet_service.cc:1511] Processing CreateTablet for tablet 43c10c3493204b17aeaf0de3a026df7d (DEFAULT_TABLE table=default.test_create_table_sync [id=99b8daca3b6e4ebb9cbeda21e221ea7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:15.684284 27966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c10c3493204b17aeaf0de3a026df7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:15.685143 28442 tablet_bootstrap.cc:492] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2: No bootstrap required, opened a new log
I20260812 08:01:15.685278 28444 tablet_bootstrap.cc:492] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71: No bootstrap required, opened a new log
I20260812 08:01:15.685374 28442 ts_tablet_manager.cc:1403] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:15.685448 28444 ts_tablet_manager.cc:1403] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:15.688516 28442 raft_consensus.cc:359] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
I20260812 08:01:15.688711 28442 raft_consensus.cc:385] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:15.688796 28442 raft_consensus.cc:740] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83fd95e4b69a423cbebdd4bebc4b38d2, State: Initialized, Role: FOLLOWER
I20260812 08:01:15.689210 28442 consensus_queue.cc:260] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
I20260812 08:01:15.689174 28444 raft_consensus.cc:359] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
I20260812 08:01:15.689352 28444 raft_consensus.cc:385] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:15.689459 28444 raft_consensus.cc:740] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca10131ba43c476d9629174c822e1c71, State: Initialized, Role: FOLLOWER
I20260812 08:01:15.689749 28448 tablet_bootstrap.cc:492] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409: Bootstrap starting.
I20260812 08:01:15.689930 28444 consensus_queue.cc:260] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
I20260812 08:01:15.690057 28442 ts_tablet_manager.cc:1434] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:01:15.690738 28444 ts_tablet_manager.cc:1434] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:01:15.692438 28448 tablet_bootstrap.cc:654] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:15.693324 28448 log.cc:826] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:15.695730 28448 tablet_bootstrap.cc:492] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409: No bootstrap required, opened a new log
I20260812 08:01:15.695931 28448 ts_tablet_manager.cc:1403] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409: Time spent bootstrapping tablet: real 0.006s	user 0.003s	sys 0.001s
I20260812 08:01:15.698763 28448 raft_consensus.cc:359] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
I20260812 08:01:15.698923 28448 raft_consensus.cc:385] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:15.699014 28448 raft_consensus.cc:740] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f81f09eee284571999245d088f3b409, State: Initialized, Role: FOLLOWER
I20260812 08:01:15.699452 28448 consensus_queue.cc:260] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
W20260812 08:01:15.700204 27845 tablet.cc:2406] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:15.700227 28448 ts_tablet_manager.cc:1434] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.004s
I20260812 08:01:15.721647 27838 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:15.778947 28451 raft_consensus.cc:493] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:15.779201 28451 raft_consensus.cc:515] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
I20260812 08:01:15.780563 28451 leader_election.cc:290] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83fd95e4b69a423cbebdd4bebc4b38d2 (127.26.116.67:38163), 4f81f09eee284571999245d088f3b409 (127.26.116.66:41509)
I20260812 08:01:15.785785 28244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c10c3493204b17aeaf0de3a026df7d" candidate_uuid: "ca10131ba43c476d9629174c822e1c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" is_pre_election: true
I20260812 08:01:15.785985 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c10c3493204b17aeaf0de3a026df7d" candidate_uuid: "ca10131ba43c476d9629174c822e1c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f81f09eee284571999245d088f3b409" is_pre_election: true
I20260812 08:01:15.786108 28244 raft_consensus.cc:2468] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca10131ba43c476d9629174c822e1c71 in term 0.
I20260812 08:01:15.786294 28009 raft_consensus.cc:2468] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca10131ba43c476d9629174c822e1c71 in term 0.
I20260812 08:01:15.786583 27622 leader_election.cc:304] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83fd95e4b69a423cbebdd4bebc4b38d2, ca10131ba43c476d9629174c822e1c71; no voters: 
I20260812 08:01:15.786883 28451 raft_consensus.cc:2804] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:15.786960 28451 raft_consensus.cc:493] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:15.786991 28451 raft_consensus.cc:3060] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:15.787945 28451 raft_consensus.cc:515] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
I20260812 08:01:15.788355 28451 leader_election.cc:290] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [CANDIDATE]: Term 1 election: Requested vote from peers 83fd95e4b69a423cbebdd4bebc4b38d2 (127.26.116.67:38163), 4f81f09eee284571999245d088f3b409 (127.26.116.66:41509)
I20260812 08:01:15.788686 28244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c10c3493204b17aeaf0de3a026df7d" candidate_uuid: "ca10131ba43c476d9629174c822e1c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2"
I20260812 08:01:15.788781 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c10c3493204b17aeaf0de3a026df7d" candidate_uuid: "ca10131ba43c476d9629174c822e1c71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f81f09eee284571999245d088f3b409"
I20260812 08:01:15.788823 28244 raft_consensus.cc:3060] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:15.788926 28009 raft_consensus.cc:3060] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:15.789734 28244 raft_consensus.cc:2468] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca10131ba43c476d9629174c822e1c71 in term 1.
I20260812 08:01:15.789801 28009 raft_consensus.cc:2468] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca10131ba43c476d9629174c822e1c71 in term 1.
I20260812 08:01:15.790046 27622 leader_election.cc:304] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83fd95e4b69a423cbebdd4bebc4b38d2, ca10131ba43c476d9629174c822e1c71; no voters: 
I20260812 08:01:15.790235 28451 raft_consensus.cc:2804] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:15.790480 28451 raft_consensus.cc:697] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [term 1 LEADER]: Becoming Leader. State: Replica: ca10131ba43c476d9629174c822e1c71, State: Running, Role: LEADER
I20260812 08:01:15.790817 28451 consensus_queue.cc:237] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } }
I20260812 08:01:15.794775 27160 catalog_manager.cc:5719] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca10131ba43c476d9629174c822e1c71 (127.26.116.65). New cstate: current_term: 1 leader_uuid: "ca10131ba43c476d9629174c822e1c71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca10131ba43c476d9629174c822e1c71" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 43203 } health_report { overall_health: HEALTHY } } }
W20260812 08:01:15.828557 27673 tablet_service.cc:3018] Rejecting scan request for tablet 43c10c3493204b17aeaf0de3a026df7d: Uninitialized: clean time has not yet been initialized
W20260812 08:01:15.855773 28330 tablet.cc:2406] T 43c10c3493204b17aeaf0de3a026df7d P 83fd95e4b69a423cbebdd4bebc4b38d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:15.888120 28094 tablet.cc:2406] T 43c10c3493204b17aeaf0de3a026df7d P 4f81f09eee284571999245d088f3b409: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:15.908803 28089 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
W20260812 08:01:16.030894 27673 tablet_service.cc:3018] Rejecting scan request for tablet 43c10c3493204b17aeaf0de3a026df7d: Uninitialized: clean time has not yet been initialized
I20260812 08:01:16.127293 28326 heartbeater.cc:499] Master 127.26.116.124:44085 was elected leader, sending a full tablet report...
I20260812 08:01:16.315003 28466 consensus_queue.cc:1048] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f81f09eee284571999245d088f3b409" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 41509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:16.324512 28479 consensus_queue.cc:1048] T 43c10c3493204b17aeaf0de3a026df7d P ca10131ba43c476d9629174c822e1c71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83fd95e4b69a423cbebdd4bebc4b38d2" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:01:16.436661 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.617s	user 0.003s	sys 0.000s
I20260812 08:01:16.437526 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 27594
I20260812 08:01:16.446720 27440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.447018 27440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.447196 27440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.447383 27440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.447526 27440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.447664 27440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.447820 27439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac"
I20260812 08:01:16.448233 27437 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:01:16.448290 27437 raft_consensus.cc:740] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79880f59fe4e4d2781b36011272327ac, State: Running, Role: LEADER
I20260812 08:01:16.448431 27437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } }
I20260812 08:01:16.448549 27437 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:16.449695 27437 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 2 FOLLOWER]: Refusing update from remote peer 3d3dfdf95f1d43b8b3e8d38f42b3cbac: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 08:01:16.449985 27436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.450109 27436 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d3dfdf95f1d43b8b3e8d38f42b3cbac in term 2.
I20260812 08:01:16.450279 27435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac"
I20260812 08:01:16.451189 27435 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3dfdf95f1d43b8b3e8d38f42b3cbac in term 2.
I20260812 08:01:16.451390 27432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.451499 27432 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a8cfe62a7244af2bdc92daf896e9177 in current term 2: Already voted for candidate 3d3dfdf95f1d43b8b3e8d38f42b3cbac in this term.
I20260812 08:01:16.451637 27430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.451721 27430 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a8cfe62a7244af2bdc92daf896e9177 in current term 2: Already voted for candidate 3d3dfdf95f1d43b8b3e8d38f42b3cbac in this term.
I20260812 08:01:16.451830 27428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.451891 27428 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8cfe62a7244af2bdc92daf896e9177 in term 2.
I20260812 08:01:16.452005 27427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.452073 27427 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8cfe62a7244af2bdc92daf896e9177 in term 2.
I20260812 08:01:16.452203 27423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a8cfe62a7244af2bdc92daf896e9177" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "79880f59fe4e4d2781b36011272327ac" is_pre_election: true
I20260812 08:01:16.452262 27423 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8cfe62a7244af2bdc92daf896e9177 in term 2.
I20260812 08:01:16.453228 28416 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [LEADER]: Connected to new peer: Peer: permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:01:16.455354 27177 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 3d3dfdf95f1d43b8b3e8d38f42b3cbac [term 2 LEADER]: Rejecting Update request from peer 79880f59fe4e4d2781b36011272327ac for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:16.455771 27309 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 4a8cfe62a7244af2bdc92daf896e9177 [term 2 FOLLOWER]: Rejecting Update request from peer 79880f59fe4e4d2781b36011272327ac for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:16.457865 28492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3dfdf95f1d43b8b3e8d38f42b3cbac. Latest consensus state: current_term: 2 leader_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:16.457965 28492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:16.458043 28492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3dfdf95f1d43b8b3e8d38f42b3cbac" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 39589 } } peers { permanent_uuid: "4a8cfe62a7244af2bdc92daf896e9177" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 33337 } } peers { permanent_uuid: "79880f59fe4e4d2781b36011272327ac" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 44085 } } }
I20260812 08:01:16.458091 28492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79880f59fe4e4d2781b36011272327ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:16.459904 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 27857
W20260812 08:01:16.467482 27398 connection.cc:769] server connection from 127.26.116.65:37165 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260812 08:01:16.467648 27398 connection.cc:466] server connection from 127.26.116.65:37165 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.26.116.65:37165 (request call id 2) could send its response
W20260812 08:01:16.467841 27398 connection.cc:466] server connection from 127.26.116.65:37165 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.26.116.65:37165 (request call id 3) could send its response
W20260812 08:01:16.467968 27398 connection.cc:466] server connection from 127.26.116.65:37165 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.26.116.65:37165 (request call id 4) could send its response
W20260812 08:01:16.468066 27398 connection.cc:466] server connection from 127.26.116.65:37165 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.26.116.65:37165 (request call id 5) could send its response
W20260812 08:01:16.468413 27398 connection.cc:466] server connection from 127.26.116.65:37165 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.26.116.65:37165 (request call id 6) could send its response
W20260812 08:01:16.468537 27398 connection.cc:466] server connection from 127.26.116.65:37165 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.26.116.65:37165 (request call id 9) could send its response
I20260812 08:01:16.469480 28493 mvcc.cc:204] Tried to move back new op lower bound from 7317592784061042688 to 7317592744211808256. Current Snapshot: MvccSnapshot[applied={T|T < 7317592784061042688}]
W20260812 08:01:16.477015 27401 connection.cc:573] server connection from 127.26.116.66:60977 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:01:16.477512 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 28099
I20260812 08:01:16.492712 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 27104
I20260812 08:01:16.509153 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 27221
I20260812 08:01:16.522737 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 27358
2026-08-12T08:01:16Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestCreateTableSync/0 (12514 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestDeleteTableSync/0
2026-08-12T08:01:16Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:16Z Disabled control of system clock
I20260812 08:01:16.567664 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:40543
--webserver_interface=127.26.116.126
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:44899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:01:16.669003 28500 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:16.669209 28500 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:16.669246 28500 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:16.672482 28500 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:16.672530 28500 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:16.672550 28500 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:16.672567 28500 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:16.676242 28500 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:44899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:40543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.116.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.28500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:16.677179 28500 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:16.678189 28500 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:16.683171 28513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:16.683166 28511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:16.683226 28517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:16.683478 28500 server_base.cc:1061] running on GCE node
I20260812 08:01:16.683911 28500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:16.684705 28500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:16.685856 28500 hybrid_clock.cc:648] HybridClock initialized: now 1786521676685840 us; error 28 us; skew 500 ppm
I20260812 08:01:16.687569 28500 webserver.cc:533] Webserver started at http://127.26.116.126:45591/ using document root <none> and password file <none>
I20260812 08:01:16.688127 28500 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:16.688184 28500 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:16.688378 28500 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:16.689811 28500 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/instance:
uuid: "100d2916ebd34ee5bf5f35978b5908f8"
format_stamp: "Formatted at 2026-08-12 08:01:16 on dist-test-slave-92m1"
I20260812 08:01:16.690267 28500 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance:
uuid: "100d2916ebd34ee5bf5f35978b5908f8"
format_stamp: "Formatted at 2026-08-12 08:01:16 on dist-test-slave-92m1"
I20260812 08:01:16.693439 28500 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:16.695425 28525 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:16.696332 28500 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:16.696463 28500 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
uuid: "100d2916ebd34ee5bf5f35978b5908f8"
format_stamp: "Formatted at 2026-08-12 08:01:16 on dist-test-slave-92m1"
I20260812 08:01:16.696563 28500 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:16.709818 28500 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:16.710475 28500 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:16.710675 28500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:16.718112 28622 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.126:40543 every 8 connection(s)
I20260812 08:01:16.718113 28500 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.126:40543
I20260812 08:01:16.719144 28500 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:16.721900 28623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:16.722579 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 28500
I20260812 08:01:16.722700 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance
I20260812 08:01:16.723413 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:37509
--webserver_interface=127.26.116.125
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:44899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:16.725518 28623 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:16.739368 28623 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:16.740209 28535 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.125:37509: connect: Connection refused (error 111)
W20260812 08:01:16.741171 28623 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:37509: Network error: Client connection negotiation failed: client connection to 127.26.116.125:37509: connect: Connection refused (error 111)
I20260812 08:01:16.790431 28623 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } attempt: 1
W20260812 08:01:16.792117 28623 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:37509: Network error: Client connection negotiation failed: client connection to 127.26.116.125:37509: connect: Connection refused (error 111)
W20260812 08:01:16.830101 28628 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:16.830345 28628 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:16.830385 28628 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:16.833690 28628 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:16.833760 28628 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:16.833781 28628 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:16.833798 28628 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:16.837719 28628 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:44899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:37509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.116.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.28628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:16.838819 28628 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:16.839987 28628 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:16.845317 28647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:16.845321 28649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:16.845782 28645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:16.845985 28628 server_base.cc:1061] running on GCE node
I20260812 08:01:16.846519 28628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:16.847513 28628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:16.848711 28628 hybrid_clock.cc:648] HybridClock initialized: now 1786521676848693 us; error 29 us; skew 500 ppm
I20260812 08:01:16.850433 28628 webserver.cc:533] Webserver started at http://127.26.116.125:35453/ using document root <none> and password file <none>
I20260812 08:01:16.851011 28628 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:16.851096 28628 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:16.851361 28628 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:16.852939 28628 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/instance:
uuid: "a517245f359c460db641adeb87c74347"
format_stamp: "Formatted at 2026-08-12 08:01:16 on dist-test-slave-92m1"
I20260812 08:01:16.853437 28628 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance:
uuid: "a517245f359c460db641adeb87c74347"
format_stamp: "Formatted at 2026-08-12 08:01:16 on dist-test-slave-92m1"
I20260812 08:01:16.856802 28628 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 08:01:16.858899 28668 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:16.859882 28628 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:01:16.860029 28628 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
uuid: "a517245f359c460db641adeb87c74347"
format_stamp: "Formatted at 2026-08-12 08:01:16 on dist-test-slave-92m1"
I20260812 08:01:16.860142 28628 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:16.860306 28623 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } attempt: 2
W20260812 08:01:16.861681 28623 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:37509: Network error: Client connection negotiation failed: client connection to 127.26.116.125:37509: connect: Connection refused (error 111)
I20260812 08:01:16.871814 28628 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:16.872437 28628 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:16.872645 28628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:16.879871 28628 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.125:37509
I20260812 08:01:16.879904 28761 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.125:37509 every 8 connection(s)
I20260812 08:01:16.880836 28628 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
I20260812 08:01:16.883620 28762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:16.886858 28762 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:16.889983 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 28628
I20260812 08:01:16.890139 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance
I20260812 08:01:16.890856 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:35111
--webserver_interface=127.26.116.124
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:44899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:16.896251 28762 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:16.902539 28762 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:16.903482 28672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.124:35111: connect: Connection refused (error 111)
W20260812 08:01:16.904800 28762 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:35111: Network error: Client connection negotiation failed: client connection to 127.26.116.124:35111: connect: Connection refused (error 111)
I20260812 08:01:16.952872 28623 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } attempt: 3
I20260812 08:01:16.954015 28762 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } attempt: 1
W20260812 08:01:16.955479 28762 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:35111: Network error: Client connection negotiation failed: client connection to 127.26.116.124:35111: connect: Connection refused (error 111)
I20260812 08:01:16.958189 28623 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:16.959515 28623 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:35111: Network error: Client connection negotiation failed: client connection to 127.26.116.124:35111: connect: Connection refused (error 111)
I20260812 08:01:16.990710 28623 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } attempt: 1
W20260812 08:01:16.992259 28623 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:35111: Network error: Client connection negotiation failed: client connection to 127.26.116.124:35111: connect: Connection refused (error 111)
W20260812 08:01:17.000938 28765 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:17.001153 28765 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:17.001236 28765 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:17.004619 28765 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:17.004678 28765 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:17.004699 28765 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:17.004768 28765 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:17.008698 28765 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:44899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:35111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.116.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.28765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:17.009783 28765 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:17.010918 28765 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:17.016237 28775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:17.016252 28774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:17.016248 28780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:17.016678 28765 server_base.cc:1061] running on GCE node
I20260812 08:01:17.017143 28765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:17.017987 28765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:17.019148 28765 hybrid_clock.cc:648] HybridClock initialized: now 1786521677019134 us; error 28 us; skew 500 ppm
I20260812 08:01:17.020841 28765 webserver.cc:533] Webserver started at http://127.26.116.124:34963/ using document root <none> and password file <none>
I20260812 08:01:17.021399 28765 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:17.021452 28765 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:17.021687 28765 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:17.023253 28765 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/instance:
uuid: "13089733c659436fb32d201eb6f65b74"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.023669 28762 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } attempt: 2
I20260812 08:01:17.023739 28765 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance:
uuid: "13089733c659436fb32d201eb6f65b74"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
W20260812 08:01:17.025090 28762 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:35111: Network error: Client connection negotiation failed: client connection to 127.26.116.124:35111: connect: Connection refused (error 111)
I20260812 08:01:17.027384 28765 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:17.029419 28787 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.030375 28765 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:17.030519 28765 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
uuid: "13089733c659436fb32d201eb6f65b74"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.030625 28765 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:17.054771 28765 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:17.055511 28765 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:17.055716 28765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:17.063282 28765 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.124:35111
I20260812 08:01:17.063308 28873 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.124:35111 every 8 connection(s)
I20260812 08:01:17.064289 28765 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
I20260812 08:01:17.067114 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:17.067436 28623 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } attempt: 2
I20260812 08:01:17.068250 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 28765
I20260812 08:01:17.068356 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance
I20260812 08:01:17.071825 28875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:17.079041 28875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:17.079308 28623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8: Bootstrap starting.
I20260812 08:01:17.081831 28623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:17.082967 28623 log.cc:826] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:17.084110 28875 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:17.084889 28623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8: No bootstrap required, opened a new log
I20260812 08:01:17.088276 28623 raft_consensus.cc:359] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.088495 28623 raft_consensus.cc:385] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:17.088616 28623 raft_consensus.cc:740] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 100d2916ebd34ee5bf5f35978b5908f8, State: Initialized, Role: FOLLOWER
I20260812 08:01:17.089118 28623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.089568 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.089694 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:17.090332 28623 sys_catalog.cc:565] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:17.090723 28875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: Bootstrap starting.
I20260812 08:01:17.092191 28884 raft_consensus.cc:493] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:17.092367 28884 raft_consensus.cc:515] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.093348 28875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:17.093370 28884 leader_election.cc:290] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a517245f359c460db641adeb87c74347 (127.26.116.125:37509), 13089733c659436fb32d201eb6f65b74 (127.26.116.124:35111)
I20260812 08:01:17.094156 28875 log.cc:826] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: Log is configured to *not* fsync() on all Append() calls
W20260812 08:01:17.095636 28899 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:17.095712 28899 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:17.096875 28500 master_runner.cc:187] Error getting master registration for 127.26.116.125:37509: OK, instance_id { permanent_uuid: "a517245f359c460db641adeb87c74347" instance_seqno: 1786521676877853 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:17.099247 28500 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:17.100580 28875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: No bootstrap required, opened a new log
I20260812 08:01:17.104394 28875 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.104588 28875 raft_consensus.cc:385] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:17.104652 28875 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13089733c659436fb32d201eb6f65b74, State: Initialized, Role: FOLLOWER
I20260812 08:01:17.105093 28875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.105602 28908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.105767 28908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:17.106323 28875 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:17.107158 28830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "100d2916ebd34ee5bf5f35978b5908f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13089733c659436fb32d201eb6f65b74" is_pre_election: true
I20260812 08:01:17.107458 28830 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 100d2916ebd34ee5bf5f35978b5908f8 in term 0.
I20260812 08:01:17.108003 28531 leader_election.cc:304] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 100d2916ebd34ee5bf5f35978b5908f8, 13089733c659436fb32d201eb6f65b74; no voters: 
I20260812 08:01:17.108378 28884 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:17.108464 28884 raft_consensus.cc:493] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:17.108525 28884 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:17.109423 28884 raft_consensus.cc:515] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.109786 28884 leader_election.cc:290] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [CANDIDATE]: Term 1 election: Requested vote from peers a517245f359c460db641adeb87c74347 (127.26.116.125:37509), 13089733c659436fb32d201eb6f65b74 (127.26.116.124:35111)
I20260812 08:01:17.111093 28830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "100d2916ebd34ee5bf5f35978b5908f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13089733c659436fb32d201eb6f65b74"
I20260812 08:01:17.111223 28830 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:17.112376 28830 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 100d2916ebd34ee5bf5f35978b5908f8 in term 1.
W20260812 08:01:17.112433 28927 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:17.112498 28927 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:17.112706 28531 leader_election.cc:304] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 100d2916ebd34ee5bf5f35978b5908f8, 13089733c659436fb32d201eb6f65b74; no voters: 
I20260812 08:01:17.112927 28884 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:17.113147 28884 raft_consensus.cc:697] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 1 LEADER]: Becoming Leader. State: Replica: 100d2916ebd34ee5bf5f35978b5908f8, State: Running, Role: LEADER
I20260812 08:01:17.113442 28884 consensus_queue.cc:237] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.115157 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 100d2916ebd34ee5bf5f35978b5908f8. Latest consensus state: current_term: 1 leader_uuid: "100d2916ebd34ee5bf5f35978b5908f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.115281 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:17.113996 28765 master_runner.cc:187] Error getting master registration for 127.26.116.125:37509: OK, instance_id { permanent_uuid: "a517245f359c460db641adeb87c74347" instance_seqno: 1786521676877853 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:17.116277 28765 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:17.116252 28762 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } attempt: 3
I20260812 08:01:17.123517 28934 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:17.124687 28762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347: Bootstrap starting.
I20260812 08:01:17.125144 28934 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:17.127279 28762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:17.128144 28762 log.cc:826] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:17.130038 28762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347: No bootstrap required, opened a new log
I20260812 08:01:17.134071 28762 raft_consensus.cc:359] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.134271 28762 raft_consensus.cc:385] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:17.134356 28762 raft_consensus.cc:740] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a517245f359c460db641adeb87c74347, State: Initialized, Role: FOLLOWER
I20260812 08:01:17.134888 28762 consensus_queue.cc:260] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:17.135589 28941 sys_catalog.cc:455] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.135918 28941 sys_catalog.cc:458] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:17.136274 28762 sys_catalog.cc:565] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:17.136353 28709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "100d2916ebd34ee5bf5f35978b5908f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a517245f359c460db641adeb87c74347" is_pre_election: true
I20260812 08:01:17.136590 28709 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 100d2916ebd34ee5bf5f35978b5908f8 in term 0.
I20260812 08:01:17.137288 28708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "100d2916ebd34ee5bf5f35978b5908f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a517245f359c460db641adeb87c74347"
I20260812 08:01:17.137424 28708 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:17.138777 28708 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 100d2916ebd34ee5bf5f35978b5908f8 in term 1.
I20260812 08:01:17.142935 28830 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 1 FOLLOWER]: Refusing update from remote peer 100d2916ebd34ee5bf5f35978b5908f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:17.143667 28931 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:01:17.146643 28955 catalog_manager.cc:1594] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:17.146780 28955 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:17.147524 28908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 100d2916ebd34ee5bf5f35978b5908f8. Latest consensus state: current_term: 1 leader_uuid: "100d2916ebd34ee5bf5f35978b5908f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.147653 28908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:17.148108 28708 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 1 FOLLOWER]: Refusing update from remote peer 100d2916ebd34ee5bf5f35978b5908f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:17.148815 28931 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:17.154855 28941 sys_catalog.cc:455] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 100d2916ebd34ee5bf5f35978b5908f8. Latest consensus state: current_term: 1 leader_uuid: "100d2916ebd34ee5bf5f35978b5908f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.155014 28941 sys_catalog.cc:458] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:17.157912 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "100d2916ebd34ee5bf5f35978b5908f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.158042 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:17.158167 28936 mvcc.cc:204] Tried to move back new op lower bound from 7317592789570449408 to 7317592789459980288. Current Snapshot: MvccSnapshot[applied={T|T < 7317592789570449408}]
I20260812 08:01:17.159490 28934 catalog_manager.cc:1383] Generated new cluster ID: 0398a69ea408414e99fd536281c0adc3
I20260812 08:01:17.159574 28934 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:17.159556 28941 sys_catalog.cc:455] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "100d2916ebd34ee5bf5f35978b5908f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.159674 28941 sys_catalog.cc:458] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:17.172098 28931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "100d2916ebd34ee5bf5f35978b5908f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.172235 28931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:17.173540 28908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "100d2916ebd34ee5bf5f35978b5908f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:17.173656 28908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:17.229730 28934 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:17.230968 28934 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:17.246366 28934 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8: Generated new TSK 0
I20260812 08:01:17.247138 28934 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:17.260107 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.65:0
--local_ip_for_outbound_sockets=127.26.116.65
--webserver_interface=127.26.116.65
--webserver_port=0
--tserver_master_addrs=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--builtin_ntp_servers=127.26.116.84:44899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:01:17.415962 28968 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:17.416261 28968 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:17.416352 28968 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:17.421065 28968 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:17.421267 28968 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.65
I20260812 08:01:17.426717 28968 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:44899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.116.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--never_fsync=true
--heap_profile_path=/tmp/kudu.28968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:17.428160 28968 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:17.429595 28968 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:17.437039 28975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:17.437063 28974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:17.437039 28979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:17.437336 28968 server_base.cc:1061] running on GCE node
I20260812 08:01:17.437804 28968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:17.438410 28968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:17.439561 28968 hybrid_clock.cc:648] HybridClock initialized: now 1786521677439540 us; error 47 us; skew 500 ppm
I20260812 08:01:17.441324 28968 webserver.cc:533] Webserver started at http://127.26.116.65:42511/ using document root <none> and password file <none>
I20260812 08:01:17.441896 28968 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:17.441953 28968 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:17.442190 28968 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:17.443791 28968 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/instance:
uuid: "c7639accfbc34302a08107439ffc089f"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.444278 28968 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal/instance:
uuid: "c7639accfbc34302a08107439ffc089f"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.447695 28968 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:17.450114 28991 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.451285 28968 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:17.451419 28968 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
uuid: "c7639accfbc34302a08107439ffc089f"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.451545 28968 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:17.476828 28968 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:17.477569 28968 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:17.477774 28968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:17.478377 28968 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:17.479540 28968 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:17.479617 28968 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.479691 28968 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:17.479748 28968 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.490440 28968 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.65:46523
I20260812 08:01:17.490486 29188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.65:46523 every 8 connection(s)
I20260812 08:01:17.491577 28968 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:17.501436 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 28968
I20260812 08:01:17.501569 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:17.501559 29190 heartbeater.cc:344] Connected to a master server at 127.26.116.124:35111
I20260812 08:01:17.501585 29189 heartbeater.cc:344] Connected to a master server at 127.26.116.126:40543
I20260812 08:01:17.501811 29193 heartbeater.cc:344] Connected to a master server at 127.26.116.125:37509
I20260812 08:01:17.501782 29189 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.501884 29193 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.501782 29190 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.502472 29190 heartbeater.cc:507] Master 127.26.116.124:35111 requested a full tablet report, sending...
I20260812 08:01:17.502478 29193 heartbeater.cc:507] Master 127.26.116.125:37509 requested a full tablet report, sending...
I20260812 08:01:17.502488 29189 heartbeater.cc:507] Master 127.26.116.126:40543 requested a full tablet report, sending...
I20260812 08:01:17.504233 28808 ts_manager.cc:194] Registered new tserver with Master: c7639accfbc34302a08107439ffc089f (127.26.116.65:46523)
I20260812 08:01:17.504411 28693 ts_manager.cc:194] Registered new tserver with Master: c7639accfbc34302a08107439ffc089f (127.26.116.65:46523)
I20260812 08:01:17.504770 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.66:0
--local_ip_for_outbound_sockets=127.26.116.66
--webserver_interface=127.26.116.66
--webserver_port=0
--tserver_master_addrs=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--builtin_ntp_servers=127.26.116.84:44899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:17.505239 28555 ts_manager.cc:194] Registered new tserver with Master: c7639accfbc34302a08107439ffc089f (127.26.116.65:46523)
I20260812 08:01:17.506475 28555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.65:57053
W20260812 08:01:17.612915 29211 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:17.613108 29211 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:17.613155 29211 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:17.616472 29211 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:17.616572 29211 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.66
I20260812 08:01:17.620187 29211 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:44899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.116.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--never_fsync=true
--heap_profile_path=/tmp/kudu.29211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:17.621124 29211 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:17.622169 29211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:17.628572 29224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:17.628542 29220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:17.628783 29211 server_base.cc:1061] running on GCE node
W20260812 08:01:17.628566 29221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:17.629290 29211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:17.629865 29211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:17.631057 29211 hybrid_clock.cc:648] HybridClock initialized: now 1786521677631037 us; error 34 us; skew 500 ppm
I20260812 08:01:17.632769 29211 webserver.cc:533] Webserver started at http://127.26.116.66:37263/ using document root <none> and password file <none>
I20260812 08:01:17.633315 29211 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:17.633373 29211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:17.633618 29211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:17.635095 29211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/instance:
uuid: "584d29c67571484f97d4c1678a04dda5"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.635628 29211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal/instance:
uuid: "584d29c67571484f97d4c1678a04dda5"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.638785 29211 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:17.640843 29234 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.641790 29211 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:17.641906 29211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
uuid: "584d29c67571484f97d4c1678a04dda5"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.641995 29211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:17.676461 29211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:17.677285 29211 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:17.677492 29211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:17.678282 29211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:17.679400 29211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:17.679450 29211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.679490 29211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:17.679505 29211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.688899 29211 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.66:39037
I20260812 08:01:17.688922 29420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.66:39037 every 8 connection(s)
I20260812 08:01:17.689859 29211 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:17.692344 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 29211
I20260812 08:01:17.692446 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:17.695415 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.67:0
--local_ip_for_outbound_sockets=127.26.116.67
--webserver_interface=127.26.116.67
--webserver_port=0
--tserver_master_addrs=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--builtin_ntp_servers=127.26.116.84:44899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:17.701280 29421 heartbeater.cc:344] Connected to a master server at 127.26.116.126:40543
I20260812 08:01:17.701319 29422 heartbeater.cc:344] Connected to a master server at 127.26.116.124:35111
I20260812 08:01:17.701321 29423 heartbeater.cc:344] Connected to a master server at 127.26.116.125:37509
I20260812 08:01:17.701534 29422 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.701536 29423 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.701536 29421 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.702206 29421 heartbeater.cc:507] Master 127.26.116.126:40543 requested a full tablet report, sending...
I20260812 08:01:17.702225 29423 heartbeater.cc:507] Master 127.26.116.125:37509 requested a full tablet report, sending...
I20260812 08:01:17.702203 29422 heartbeater.cc:507] Master 127.26.116.124:35111 requested a full tablet report, sending...
I20260812 08:01:17.703452 28555 ts_manager.cc:194] Registered new tserver with Master: 584d29c67571484f97d4c1678a04dda5 (127.26.116.66:39037)
I20260812 08:01:17.703485 28693 ts_manager.cc:194] Registered new tserver with Master: 584d29c67571484f97d4c1678a04dda5 (127.26.116.66:39037)
I20260812 08:01:17.704248 28555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.66:57725
I20260812 08:01:17.704880 28808 ts_manager.cc:194] Registered new tserver with Master: 584d29c67571484f97d4c1678a04dda5 (127.26.116.66:39037)
W20260812 08:01:17.802451 29436 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:17.802651 29436 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:17.802701 29436 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:17.805846 29436 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:17.805950 29436 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.67
I20260812 08:01:17.809708 29436 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:44899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.116.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:40543,127.26.116.125:37509,127.26.116.124:35111
--never_fsync=true
--heap_profile_path=/tmp/kudu.29436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:17.810683 29436 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:17.811725 29436 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:17.817885 29451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:17.817888 29447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:17.818089 29436 server_base.cc:1061] running on GCE node
W20260812 08:01:17.817885 29444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:17.818449 29436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:17.818958 29436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:17.820134 29436 hybrid_clock.cc:648] HybridClock initialized: now 1786521677820116 us; error 29 us; skew 500 ppm
I20260812 08:01:17.821861 29436 webserver.cc:533] Webserver started at http://127.26.116.67:39203/ using document root <none> and password file <none>
I20260812 08:01:17.822435 29436 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:17.822515 29436 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:17.822739 29436 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:17.824342 29436 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/instance:
uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.824822 29436 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/instance:
uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.828023 29436 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:17.830045 29465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.830981 29436 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:17.831120 29436 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0"
format_stamp: "Formatted at 2026-08-12 08:01:17 on dist-test-slave-92m1"
I20260812 08:01:17.831239 29436 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:17.848618 29436 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:17.849295 29436 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:17.849491 29436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:17.850061 29436 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:17.851131 29436 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:17.851207 29436 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.851320 29436 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:17.851369 29436 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:17.860905 29436 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.67:43711
I20260812 08:01:17.860939 29660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.67:43711 every 8 connection(s)
I20260812 08:01:17.861826 29436 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:17.862844 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 29436
I20260812 08:01:17.862960 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:17.871704 29667 heartbeater.cc:344] Connected to a master server at 127.26.116.125:37509
I20260812 08:01:17.871942 29667 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.871984 29663 heartbeater.cc:344] Connected to a master server at 127.26.116.126:40543
I20260812 08:01:17.872041 29663 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.872560 29664 heartbeater.cc:344] Connected to a master server at 127.26.116.124:35111
I20260812 08:01:17.872534 29663 heartbeater.cc:507] Master 127.26.116.126:40543 requested a full tablet report, sending...
I20260812 08:01:17.872687 29664 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:17.872534 29667 heartbeater.cc:507] Master 127.26.116.125:37509 requested a full tablet report, sending...
I20260812 08:01:17.872895 29664 heartbeater.cc:507] Master 127.26.116.124:35111 requested a full tablet report, sending...
I20260812 08:01:17.873593 28555 ts_manager.cc:194] Registered new tserver with Master: 4fbc5d4bd5fb4e5086bc1882e16408d0 (127.26.116.67:43711)
I20260812 08:01:17.873652 28693 ts_manager.cc:194] Registered new tserver with Master: 4fbc5d4bd5fb4e5086bc1882e16408d0 (127.26.116.67:43711)
I20260812 08:01:17.873665 28808 ts_manager.cc:194] Registered new tserver with Master: 4fbc5d4bd5fb4e5086bc1882e16408d0 (127.26.116.67:43711)
I20260812 08:01:17.874289 28555 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.67:57529
I20260812 08:01:17.883652 27089 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:17.893532 28555 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53006:
name: "default.test_delete_table_sync"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:17.894613 28555 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_delete_table_sync in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:17.914819 29303 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9917dc860840faa401ac20dc686c98 (DEFAULT_TABLE table=default.test_delete_table_sync [id=e3b78c08eca94cada1a55fc36977c207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:17.914816 29543 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9917dc860840faa401ac20dc686c98 (DEFAULT_TABLE table=default.test_delete_table_sync [id=e3b78c08eca94cada1a55fc36977c207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:17.915865 29543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9917dc860840faa401ac20dc686c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:17.915865 29303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9917dc860840faa401ac20dc686c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:17.915710 29068 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9917dc860840faa401ac20dc686c98 (DEFAULT_TABLE table=default.test_delete_table_sync [id=e3b78c08eca94cada1a55fc36977c207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:17.916476 29068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9917dc860840faa401ac20dc686c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:17.921106 29704 tablet_bootstrap.cc:492] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f: Bootstrap starting.
I20260812 08:01:17.922257 29710 tablet_bootstrap.cc:492] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5: Bootstrap starting.
I20260812 08:01:17.923143 29704 tablet_bootstrap.cc:654] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:17.923581 29706 tablet_bootstrap.cc:492] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Bootstrap starting.
I20260812 08:01:17.924063 29704 log.cc:826] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:17.924337 29710 tablet_bootstrap.cc:654] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:17.924970 29710 log.cc:826] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:17.925307 29706 tablet_bootstrap.cc:654] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:17.926041 29706 log.cc:826] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:17.926748 29710 tablet_bootstrap.cc:492] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5: No bootstrap required, opened a new log
I20260812 08:01:17.926944 29710 ts_tablet_manager.cc:1403] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:01:17.927734 29706 tablet_bootstrap.cc:492] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: No bootstrap required, opened a new log
I20260812 08:01:17.927915 29706 ts_tablet_manager.cc:1403] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Time spent bootstrapping tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:17.928154 29704 tablet_bootstrap.cc:492] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f: No bootstrap required, opened a new log
I20260812 08:01:17.928332 29704 ts_tablet_manager.cc:1403] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f: Time spent bootstrapping tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 08:01:17.930349 29710 raft_consensus.cc:359] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:17.930572 29710 raft_consensus.cc:385] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:17.930641 29710 raft_consensus.cc:740] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 584d29c67571484f97d4c1678a04dda5, State: Initialized, Role: FOLLOWER
I20260812 08:01:17.930896 29704 raft_consensus.cc:359] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:17.931103 29704 raft_consensus.cc:385] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:17.931067 29710 consensus_queue.cc:260] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:17.931165 29704 raft_consensus.cc:740] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7639accfbc34302a08107439ffc089f, State: Initialized, Role: FOLLOWER
I20260812 08:01:17.931116 29706 raft_consensus.cc:359] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:17.931339 29706 raft_consensus.cc:385] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:17.931407 29706 raft_consensus.cc:740] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fbc5d4bd5fb4e5086bc1882e16408d0, State: Initialized, Role: FOLLOWER
I20260812 08:01:17.931605 29704 consensus_queue.cc:260] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:17.931787 29706 consensus_queue.cc:260] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:17.931990 29710 ts_tablet_manager.cc:1434] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260812 08:01:17.932336 29189 heartbeater.cc:499] Master 127.26.116.126:40543 was elected leader, sending a full tablet report...
I20260812 08:01:17.932338 29421 heartbeater.cc:499] Master 127.26.116.126:40543 was elected leader, sending a full tablet report...
I20260812 08:01:17.932430 29704 ts_tablet_manager.cc:1434] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:01:17.933558 29706 ts_tablet_manager.cc:1434] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:01:17.934489 29663 heartbeater.cc:499] Master 127.26.116.126:40543 was elected leader, sending a full tablet report...
W20260812 08:01:17.941098 29428 tablet.cc:2406] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:17.993397 29196 tablet.cc:2406] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:18.035965 29723 raft_consensus.cc:493] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:18.036208 29723 raft_consensus.cc:515] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:18.037451 29723 leader_election.cc:290] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fbc5d4bd5fb4e5086bc1882e16408d0 (127.26.116.67:43711), 584d29c67571484f97d4c1678a04dda5 (127.26.116.66:39037)
I20260812 08:01:18.042229 29585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9917dc860840faa401ac20dc686c98" candidate_uuid: "c7639accfbc34302a08107439ffc089f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" is_pre_election: true
I20260812 08:01:18.042236 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9917dc860840faa401ac20dc686c98" candidate_uuid: "c7639accfbc34302a08107439ffc089f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "584d29c67571484f97d4c1678a04dda5" is_pre_election: true
I20260812 08:01:18.042503 29585 raft_consensus.cc:2468] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7639accfbc34302a08107439ffc089f in term 0.
I20260812 08:01:18.042520 29345 raft_consensus.cc:2468] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7639accfbc34302a08107439ffc089f in term 0.
I20260812 08:01:18.042979 28998 leader_election.cc:304] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fbc5d4bd5fb4e5086bc1882e16408d0, c7639accfbc34302a08107439ffc089f; no voters: 
I20260812 08:01:18.043262 29723 raft_consensus.cc:2804] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:18.043337 29723 raft_consensus.cc:493] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:18.043380 29723 raft_consensus.cc:3060] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:18.044320 29723 raft_consensus.cc:515] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:18.044667 29723 leader_election.cc:290] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [CANDIDATE]: Term 1 election: Requested vote from peers 4fbc5d4bd5fb4e5086bc1882e16408d0 (127.26.116.67:43711), 584d29c67571484f97d4c1678a04dda5 (127.26.116.66:39037)
I20260812 08:01:18.044981 29585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9917dc860840faa401ac20dc686c98" candidate_uuid: "c7639accfbc34302a08107439ffc089f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0"
I20260812 08:01:18.045099 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9917dc860840faa401ac20dc686c98" candidate_uuid: "c7639accfbc34302a08107439ffc089f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "584d29c67571484f97d4c1678a04dda5"
I20260812 08:01:18.045091 29585 raft_consensus.cc:3060] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:18.045236 29345 raft_consensus.cc:3060] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:18.046159 29345 raft_consensus.cc:2468] T 9e9917dc860840faa401ac20dc686c98 P 584d29c67571484f97d4c1678a04dda5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7639accfbc34302a08107439ffc089f in term 1.
I20260812 08:01:18.046283 29585 raft_consensus.cc:2468] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7639accfbc34302a08107439ffc089f in term 1.
I20260812 08:01:18.046478 28994 leader_election.cc:304] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 584d29c67571484f97d4c1678a04dda5, c7639accfbc34302a08107439ffc089f; no voters: 
I20260812 08:01:18.046729 29723 raft_consensus.cc:2804] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:18.046911 29723 raft_consensus.cc:697] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [term 1 LEADER]: Becoming Leader. State: Replica: c7639accfbc34302a08107439ffc089f, State: Running, Role: LEADER
I20260812 08:01:18.047256 29723 consensus_queue.cc:237] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } }
I20260812 08:01:18.050513 28555 catalog_manager.cc:5719] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f reported cstate change: term changed from 0 to 1, leader changed from <none> to c7639accfbc34302a08107439ffc089f (127.26.116.65). New cstate: current_term: 1 leader_uuid: "c7639accfbc34302a08107439ffc089f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7639accfbc34302a08107439ffc089f" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 46523 } health_report { overall_health: HEALTHY } } }
I20260812 08:01:18.063397 27089 master_failover-itest.cc:239] Pausing leader master
W20260812 08:01:18.113677 29668 tablet.cc:2406] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:18.114043 28927 catalog_manager.cc:1295] Loaded cluster ID: 0398a69ea408414e99fd536281c0adc3
I20260812 08:01:18.114130 28927 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: loading cluster ID for follower catalog manager: success
I20260812 08:01:18.115866 28927 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: acquiring CA information for follower catalog manager: success
I20260812 08:01:18.116869 28927 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:18.148243 28955 catalog_manager.cc:1295] Loaded cluster ID: 0398a69ea408414e99fd536281c0adc3
I20260812 08:01:18.148324 28955 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347: loading cluster ID for follower catalog manager: success
I20260812 08:01:18.150043 28955 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347: acquiring CA information for follower catalog manager: success
I20260812 08:01:18.151069 28955 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:18.524665 29723 consensus_queue.cc:1048] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [LEADER]: Connected to new peer: Peer: permanent_uuid: "584d29c67571484f97d4c1678a04dda5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 39037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:18.530781 29723 consensus_queue.cc:1048] T 9e9917dc860840faa401ac20dc686c98 P c7639accfbc34302a08107439ffc089f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fbc5d4bd5fb4e5086bc1882e16408d0" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:18.556128 29746 raft_consensus.cc:493] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 100d2916ebd34ee5bf5f35978b5908f8)
I20260812 08:01:18.556217 29747 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 100d2916ebd34ee5bf5f35978b5908f8)
I20260812 08:01:18.556342 29746 raft_consensus.cc:515] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:18.556419 29747 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:18.557427 29747 leader_election.cc:290] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), a517245f359c460db641adeb87c74347 (127.26.116.125:37509)
I20260812 08:01:18.557627 29746 leader_election.cc:290] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), 13089733c659436fb32d201eb6f65b74 (127.26.116.124:35111)
I20260812 08:01:18.557919 28830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "13089733c659436fb32d201eb6f65b74" is_pre_election: true
I20260812 08:01:18.558049 28708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "a517245f359c460db641adeb87c74347" is_pre_election: true
I20260812 08:01:18.558077 28830 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a517245f359c460db641adeb87c74347 in term 1.
I20260812 08:01:18.558202 28708 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13089733c659436fb32d201eb6f65b74 in term 1.
I20260812 08:01:18.558588 28672 leader_election.cc:304] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13089733c659436fb32d201eb6f65b74, a517245f359c460db641adeb87c74347; no voters: 
I20260812 08:01:18.558610 28792 leader_election.cc:304] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13089733c659436fb32d201eb6f65b74, a517245f359c460db641adeb87c74347; no voters: 
I20260812 08:01:18.558816 29747 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:18.558856 29746 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:18.558899 29747 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 100d2916ebd34ee5bf5f35978b5908f8)
I20260812 08:01:18.558960 29747 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:18.558939 29746 raft_consensus.cc:493] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 100d2916ebd34ee5bf5f35978b5908f8)
I20260812 08:01:18.559007 29746 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:18.560004 29747 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:18.560048 29746 raft_consensus.cc:515] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:18.560381 29747 leader_election.cc:290] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 2 election: Requested vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), a517245f359c460db641adeb87c74347 (127.26.116.125:37509)
I20260812 08:01:18.560688 29746 leader_election.cc:290] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 2 election: Requested vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), 13089733c659436fb32d201eb6f65b74 (127.26.116.124:35111)
I20260812 08:01:18.560775 28708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "a517245f359c460db641adeb87c74347"
I20260812 08:01:18.561014 28708 raft_consensus.cc:2393] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 13089733c659436fb32d201eb6f65b74 in current term 2: Already voted for candidate a517245f359c460db641adeb87c74347 in this term.
I20260812 08:01:18.561072 28830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "13089733c659436fb32d201eb6f65b74"
I20260812 08:01:18.561252 28830 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a517245f359c460db641adeb87c74347 in current term 2: Already voted for candidate 13089733c659436fb32d201eb6f65b74 in this term.
W20260812 08:01:19.098917 28790 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.537s (SENT)
W20260812 08:01:19.440063 29663 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:40543 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.126:40543 timed out after 1.000s (SENT)
W20260812 08:01:19.440821 29421 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:40543 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.126:40543 timed out after 1.000s (SENT)
W20260812 08:01:19.531036 29189 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:40543 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.126:40543 timed out after 1.000s (SENT)
W20260812 08:01:19.637629 28790 leader_election.cc:336] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.537s (SENT)
I20260812 08:01:19.637748 28790 leader_election.cc:304] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13089733c659436fb32d201eb6f65b74; no voters: 100d2916ebd34ee5bf5f35978b5908f8, a517245f359c460db641adeb87c74347
I20260812 08:01:19.638144 29756 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 08:01:19.701519 28671 leader_election.cc:336] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.571s (SENT)
W20260812 08:01:19.802749 28790 leader_election.cc:336] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.621s (SENT)
W20260812 08:01:19.815361 28671 leader_election.cc:336] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.626s (SENT)
I20260812 08:01:19.815482 28671 leader_election.cc:304] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a517245f359c460db641adeb87c74347; no voters: 100d2916ebd34ee5bf5f35978b5908f8, 13089733c659436fb32d201eb6f65b74
I20260812 08:01:19.815894 29757 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 08:01:20.232260 29759 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:20.232420 29759 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:20.232918 29759 leader_election.cc:290] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), a517245f359c460db641adeb87c74347 (127.26.116.125:37509)
I20260812 08:01:20.233464 28708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "a517245f359c460db641adeb87c74347" is_pre_election: true
I20260812 08:01:20.233659 28708 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13089733c659436fb32d201eb6f65b74 in term 2.
I20260812 08:01:20.234045 28792 leader_election.cc:304] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13089733c659436fb32d201eb6f65b74, a517245f359c460db641adeb87c74347; no voters: 
I20260812 08:01:20.234257 29759 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:01:20.234333 29759 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:20.234390 29759 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:20.235358 29759 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:20.235718 29759 leader_election.cc:290] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 3 election: Requested vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), a517245f359c460db641adeb87c74347 (127.26.116.125:37509)
I20260812 08:01:20.236088 28708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "a517245f359c460db641adeb87c74347"
I20260812 08:01:20.236186 28708 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:20.237049 28708 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13089733c659436fb32d201eb6f65b74 in term 3.
I20260812 08:01:20.237414 28792 leader_election.cc:304] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13089733c659436fb32d201eb6f65b74, a517245f359c460db641adeb87c74347; no voters: 
I20260812 08:01:20.237639 29759 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:01:20.237808 29759 raft_consensus.cc:697] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [term 3 LEADER]: Becoming Leader. State: Replica: 13089733c659436fb32d201eb6f65b74, State: Running, Role: LEADER
I20260812 08:01:20.238126 29759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:20.239493 29760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13089733c659436fb32d201eb6f65b74. Latest consensus state: current_term: 3 leader_uuid: "13089733c659436fb32d201eb6f65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:20.239619 29760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:20.239939 29763 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:20.241329 29763 catalog_manager.cc:679] Loaded metadata for table default.test_delete_table_sync [id=e3b78c08eca94cada1a55fc36977c207]
I20260812 08:01:20.242226 29763 tablet_loader.cc:96] loaded metadata for tablet 9e9917dc860840faa401ac20dc686c98 (table default.test_delete_table_sync [id=e3b78c08eca94cada1a55fc36977c207])
I20260812 08:01:20.242340 29763 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:20.242666 29763 catalog_manager.cc:1295] Loaded cluster ID: 0398a69ea408414e99fd536281c0adc3
I20260812 08:01:20.242708 29763 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:20.243394 29763 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:20.243747 29763 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: Loaded TSK: 0
I20260812 08:01:20.244268 29763 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:20.668395 28708 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Refusing update from remote peer 13089733c659436fb32d201eb6f65b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
I20260812 08:01:20.669078 29760 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:20.670328 29764 sys_catalog.cc:455] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13089733c659436fb32d201eb6f65b74. Latest consensus state: current_term: 3 leader_uuid: "13089733c659436fb32d201eb6f65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:20.670440 29764 sys_catalog.cc:458] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:20.671762 29759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "13089733c659436fb32d201eb6f65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:20.671878 29759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:20.672091 29764 sys_catalog.cc:455] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "13089733c659436fb32d201eb6f65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:20.672226 29764 sys_catalog.cc:458] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:21.038702 29422 heartbeater.cc:499] Master 127.26.116.124:35111 was elected leader, sending a full tablet report...
I20260812 08:01:21.041463 29664 heartbeater.cc:499] Master 127.26.116.124:35111 was elected leader, sending a full tablet report...
I20260812 08:01:21.093242 29190 heartbeater.cc:499] Master 127.26.116.124:35111 was elected leader, sending a full tablet report...
I20260812 08:01:21.172905 29773 raft_consensus.cc:493] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 13089733c659436fb32d201eb6f65b74)
I20260812 08:01:21.173089 29773 raft_consensus.cc:515] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:21.173606 29773 leader_election.cc:290] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), 13089733c659436fb32d201eb6f65b74 (127.26.116.124:35111)
I20260812 08:01:21.174108 28830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "13089733c659436fb32d201eb6f65b74" is_pre_election: true
W20260812 08:01:21.648962 28790 leader_election.cc:336] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.705s (SENT)
W20260812 08:01:21.803814 28790 leader_election.cc:336] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.784s (SENT)
W20260812 08:01:22.313462 28671 leader_election.cc:336] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.569s (SENT)
I20260812 08:01:22.313601 28671 leader_election.cc:304] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a517245f359c460db641adeb87c74347; no voters: 100d2916ebd34ee5bf5f35978b5908f8, 13089733c659436fb32d201eb6f65b74
I20260812 08:01:22.313994 29783 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:01:23.398967 29785 raft_consensus.cc:493] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 13089733c659436fb32d201eb6f65b74)
I20260812 08:01:23.399108 29785 raft_consensus.cc:515] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:23.399730 29785 leader_election.cc:290] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), 13089733c659436fb32d201eb6f65b74 (127.26.116.124:35111)
I20260812 08:01:23.400388 28830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "13089733c659436fb32d201eb6f65b74" is_pre_election: true
W20260812 08:01:24.146225 28671 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.745s (SENT) [suppressed 5 similar messages]
W20260812 08:01:24.892957 28671 leader_election.cc:336] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.745s (SENT)
I20260812 08:01:24.893060 28671 leader_election.cc:304] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a517245f359c460db641adeb87c74347; no voters: 100d2916ebd34ee5bf5f35978b5908f8, 13089733c659436fb32d201eb6f65b74
I20260812 08:01:24.893425 29794 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:01:25.462139 29795 raft_consensus.cc:493] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 13089733c659436fb32d201eb6f65b74)
I20260812 08:01:25.462301 29795 raft_consensus.cc:515] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:25.462777 29795 leader_election.cc:290] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), 13089733c659436fb32d201eb6f65b74 (127.26.116.124:35111)
I20260812 08:01:25.463361 28830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "13089733c659436fb32d201eb6f65b74" is_pre_election: true
W20260812 08:01:26.483603 28671 leader_election.cc:336] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.509s (SENT)
I20260812 08:01:26.483762 28671 leader_election.cc:304] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a517245f359c460db641adeb87c74347; no voters: 100d2916ebd34ee5bf5f35978b5908f8, 13089733c659436fb32d201eb6f65b74
I20260812 08:01:26.484216 29807 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:01:27.077836 29814 raft_consensus.cc:493] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 13089733c659436fb32d201eb6f65b74)
I20260812 08:01:27.077966 29814 raft_consensus.cc:515] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:27.078447 29814 leader_election.cc:290] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543), 13089733c659436fb32d201eb6f65b74 (127.26.116.124:35111)
I20260812 08:01:27.078890 28830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "13089733c659436fb32d201eb6f65b74" is_pre_election: true
W20260812 08:01:28.078295 29679 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.26.116.126:40543)
I20260812 08:01:28.080832 28811 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34774:
table { table_name: "default.test_delete_table_sync" } modify_external_catalogs: true
I20260812 08:01:28.081001 28811 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34774:
table { table_name: "default.test_delete_table_sync" } modify_external_catalogs: true
I20260812 08:01:28.086565 28811 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74: Sending DeleteTablet for 3 replicas of tablet 9e9917dc860840faa401ac20dc686c98
W20260812 08:01:28.087309 28671 leader_election.cc:336] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 100d2916ebd34ee5bf5f35978b5908f8 (127.26.116.126:40543): Timed out: RequestConsensusVote RPC to 127.26.116.126:40543 timed out after 0.503s (SENT)
I20260812 08:01:28.087430 28671 leader_election.cc:304] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a517245f359c460db641adeb87c74347; no voters: 100d2916ebd34ee5bf5f35978b5908f8, 13089733c659436fb32d201eb6f65b74
I20260812 08:01:28.087890 29836 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a517245f359c460db641adeb87c74347 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:01:28.090426 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 28968
I20260812 08:01:28.093056 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.093219 29543 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e9917dc860840faa401ac20dc686c98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 08:01:28 UTC) from {username='slave'} at 127.0.0.1:35420
I20260812 08:01:28.093528 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.093752 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.093953 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8"
I20260812 08:01:28.094192 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8"
I20260812 08:01:28.094414 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.094616 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.094820 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8"
I20260812 08:01:28.095019 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8"
I20260812 08:01:28.095265 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.095475 28565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "13089733c659436fb32d201eb6f65b74" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.095985 28565 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:01:28.096071 28565 raft_consensus.cc:740] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 100d2916ebd34ee5bf5f35978b5908f8, State: Running, Role: LEADER
I20260812 08:01:28.096310 28559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.096289 28565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } }
I20260812 08:01:28.096625 28565 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 1 FOLLOWER]: Advancing to term 3
I20260812 08:01:28.096851 28561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.097288 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.097899 28565 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 3 FOLLOWER]: Refusing update from remote peer 13089733c659436fb32d201eb6f65b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
I20260812 08:01:28.102234 28568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8"
I20260812 08:01:28.102370 28568 raft_consensus.cc:2368] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a517245f359c460db641adeb87c74347 for earlier term 2. Current term is 3.
I20260812 08:01:28.102516 28564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.102576 28566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.102630 28564 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a517245f359c460db641adeb87c74347 in term 3.
I20260812 08:01:28.102748 28899 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:28.102787 28569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.102881 28569 raft_consensus.cc:2368] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a517245f359c460db641adeb87c74347 for earlier term 2. Current term is 3.
I20260812 08:01:28.103499 28573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8" is_pre_election: true
I20260812 08:01:28.103638 28573 raft_consensus.cc:2368] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a517245f359c460db641adeb87c74347 for earlier term 2. Current term is 3.
I20260812 08:01:28.103822 28570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a517245f359c460db641adeb87c74347" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "100d2916ebd34ee5bf5f35978b5908f8"
I20260812 08:01:28.103940 28570 raft_consensus.cc:2368] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a517245f359c460db641adeb87c74347 for earlier term 2. Current term is 3.
I20260812 08:01:28.104540 29830 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 13089733c659436fb32d201eb6f65b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:28.107385 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13089733c659436fb32d201eb6f65b74. Latest consensus state: current_term: 3 leader_uuid: "13089733c659436fb32d201eb6f65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:28.107484 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.107540 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "13089733c659436fb32d201eb6f65b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100d2916ebd34ee5bf5f35978b5908f8" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 40543 } } peers { permanent_uuid: "a517245f359c460db641adeb87c74347" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 37509 } } peers { permanent_uuid: "13089733c659436fb32d201eb6f65b74" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 35111 } } }
I20260812 08:01:28.107586 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 100d2916ebd34ee5bf5f35978b5908f8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.108055 29845 tablet_replica.cc:333] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: stopping tablet replica
I20260812 08:01:28.108475 29845 raft_consensus.cc:2243] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:01:28.108906 29845 raft_consensus.cc:2272] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:01:28.110157 29845 ts_tablet_manager.cc:1916] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 08:01:28.112462 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 29211
W20260812 08:01:28.112574 28526 connection.cc:573] server connection from 127.26.116.65:57053 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:01:28.112924 29838 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:01:28.088332 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.26.116.65:46523 (local address 127.0.0.1:45074)
0812 08:01:28.088857 (+   525us) negotiation.cc:107] Waiting for socket to connect
0812 08:01:28.088890 (+    33us) client_negotiation.cc:175] Beginning negotiation
0812 08:01:28.088966 (+    76us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 08:01:28.089466 (+   500us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0812 08:01:28.089469 (+     3us) client_negotiation.cc:404] Received NEGOTIATE response from server
0812 08:01:28.089487 (+    18us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0812 08:01:28.089681 (+   194us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0812 08:01:28.089688 (+     7us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0812 08:01:28.112305 (+ 22617us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.116.65:46523: BlockingRecv error: recv got EOF from 127.26.116.65:46523 (error 108)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":83,"threads_started":1}
I20260812 08:01:28.118778 29845 ts_tablet_manager.cc:1929] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 08:01:28.118922 29845 log.cc:1199] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Deleting WAL directory at /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/wals/9e9917dc860840faa401ac20dc686c98
I20260812 08:01:28.119297 29845 ts_tablet_manager.cc:1950] T 9e9917dc860840faa401ac20dc686c98 P 4fbc5d4bd5fb4e5086bc1882e16408d0: Deleting consensus metadata
W20260812 08:01:28.121555 28790 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.65:46523: BlockingRecv error: recv got EOF from 127.26.116.65:46523 (error 108) [suppressed 3 similar messages]
I20260812 08:01:28.123853 28792 catalog_manager.cc:5050] TS 4fbc5d4bd5fb4e5086bc1882e16408d0 (127.26.116.67:43711): tablet 9e9917dc860840faa401ac20dc686c98 (table default.test_delete_table_sync [id=e3b78c08eca94cada1a55fc36977c207]) successfully deleted
W20260812 08:01:28.123956 28790 catalog_manager.cc:4777] TS c7639accfbc34302a08107439ffc089f (127.26.116.65:46523): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9e9917dc860840faa401ac20dc686c98: Network error: Client connection negotiation failed: client connection to 127.26.116.65:46523: connect: Connection refused (error 111)
W20260812 08:01:28.131333 28789 connection.cc:573] client connection to 127.26.116.66:39037 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:01:28.131807 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 29436
I20260812 08:01:28.144090 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 28500
I20260812 08:01:28.159417 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 28628
I20260812 08:01:28.174700 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 28765
2026-08-12T08:01:28Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestDeleteTableSync/0 (11650 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestKUDU1374/0
2026-08-12T08:01:28Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:28Z Disabled control of system clock
I20260812 08:01:28.219779 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:46719
--webserver_interface=127.26.116.126
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:41221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:01:28.324862 29857 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:28.325110 29857 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:28.325151 29857 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:28.328500 29857 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:28.328572 29857 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:28.328594 29857 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:28.328612 29857 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:28.332350 29857 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:41221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:46719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.116.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.29857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:28.333403 29857 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:28.334439 29857 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:28.340363 29871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.340416 29866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.340478 29857 server_base.cc:1061] running on GCE node
W20260812 08:01:28.340361 29867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.341141 29857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:28.342044 29857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:28.343271 29857 hybrid_clock.cc:648] HybridClock initialized: now 1786521688343256 us; error 35 us; skew 500 ppm
I20260812 08:01:28.344986 29857 webserver.cc:533] Webserver started at http://127.26.116.126:44173/ using document root <none> and password file <none>
I20260812 08:01:28.345603 29857 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:28.345688 29857 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:28.345913 29857 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:28.347532 29857 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/data/instance:
uuid: "9e1ec014d708404a867994d2dd6f9750"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.348026 29857 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance:
uuid: "9e1ec014d708404a867994d2dd6f9750"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.351343 29857 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:28.353487 29882 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.354460 29857 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:28.354600 29857 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/wal
uuid: "9e1ec014d708404a867994d2dd6f9750"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.354708 29857 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:28.368722 29857 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:28.369462 29857 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:28.369673 29857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:28.377588 29981 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.126:46719 every 8 connection(s)
I20260812 08:01:28.377604 29857 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.126:46719
I20260812 08:01:28.378646 29857 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:28.381567 29982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:28.384925 29982 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:28.385963 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 29857
I20260812 08:01:28.386096 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance
I20260812 08:01:28.386776 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:45429
--webserver_interface=127.26.116.125
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:41221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:28.400120 29982 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:28.401403 29883 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
W20260812 08:01:28.402392 29982 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:45429: Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
I20260812 08:01:28.451644 29982 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } attempt: 1
W20260812 08:01:28.453429 29982 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:45429: Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
W20260812 08:01:28.495816 29986 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:28.496068 29986 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:28.496162 29986 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:28.499419 29986 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:28.499513 29986 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:28.499552 29986 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:28.499588 29986 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:28.503496 29986 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:41221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:45429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.116.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.29986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:28.504603 29986 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:28.505702 29986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:28.510922 29995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.510918 29994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.510918 29997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.511121 29986 server_base.cc:1061] running on GCE node
I20260812 08:01:28.511734 29986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:28.512552 29986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:28.513752 29986 hybrid_clock.cc:648] HybridClock initialized: now 1786521688513737 us; error 29 us; skew 500 ppm
I20260812 08:01:28.515517 29986 webserver.cc:533] Webserver started at http://127.26.116.125:46853/ using document root <none> and password file <none>
I20260812 08:01:28.516073 29986 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:28.516158 29986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:28.516369 29986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:28.517865 29986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/data/instance:
uuid: "c180d98740bb4d32b6b19909f1a6eb1c"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.518388 29986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance:
uuid: "c180d98740bb4d32b6b19909f1a6eb1c"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.521519 29986 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 08:01:28.521652 29982 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } attempt: 2
W20260812 08:01:28.523023 29982 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:45429: Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
I20260812 08:01:28.524008 30005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.524976 29986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:01:28.525120 29986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/wal
uuid: "c180d98740bb4d32b6b19909f1a6eb1c"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.525219 29986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:28.543455 29986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:28.544094 29986 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:28.544283 29986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:28.551393 29986 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.125:45429
I20260812 08:01:28.551402 30103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.125:45429 every 8 connection(s)
I20260812 08:01:28.552372 29986 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
I20260812 08:01:28.553457 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 29986
I20260812 08:01:28.553567 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance
I20260812 08:01:28.554322 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:36019
--webserver_interface=127.26.116.124
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:41221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:28.555763 30105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:28.559346 30105 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:28.568274 30105 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:28.574487 30105 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:28.575433 30007 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.124:36019: connect: Connection refused (error 111)
W20260812 08:01:28.576318 30105 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:36019: Network error: Client connection negotiation failed: client connection to 127.26.116.124:36019: connect: Connection refused (error 111)
I20260812 08:01:28.614219 29982 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } attempt: 3
I20260812 08:01:28.619143 29982 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:28.620591 29982 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:36019: Network error: Client connection negotiation failed: client connection to 127.26.116.124:36019: connect: Connection refused (error 111)
I20260812 08:01:28.625523 30105 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } attempt: 1
W20260812 08:01:28.626930 30105 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:36019: Network error: Client connection negotiation failed: client connection to 127.26.116.124:36019: connect: Connection refused (error 111)
I20260812 08:01:28.651855 29982 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } attempt: 1
W20260812 08:01:28.653404 29982 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:36019: Network error: Client connection negotiation failed: client connection to 127.26.116.124:36019: connect: Connection refused (error 111)
W20260812 08:01:28.666287 30107 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:28.666572 30107 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:28.666664 30107 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:28.670077 30107 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:28.670169 30107 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:28.670207 30107 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:28.670267 30107 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:28.674248 30107 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:41221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:36019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.116.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.30107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:28.675511 30107 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:28.676689 30107 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:28.682284 30125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:28.682286 30122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.682354 30107 server_base.cc:1061] running on GCE node
W20260812 08:01:28.682286 30123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:28.683146 30107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:28.684060 30107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:28.685232 30107 hybrid_clock.cc:648] HybridClock initialized: now 1786521688685223 us; error 30 us; skew 500 ppm
I20260812 08:01:28.687001 30107 webserver.cc:533] Webserver started at http://127.26.116.124:42793/ using document root <none> and password file <none>
I20260812 08:01:28.687635 30107 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:28.687697 30107 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:28.687932 30107 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:28.689468 30107 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/data/instance:
uuid: "1a4676b769374972b8540a702f8f3086"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.689951 30107 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance:
uuid: "1a4676b769374972b8540a702f8f3086"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.693192 30107 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:28.695086 30105 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } attempt: 2
I20260812 08:01:28.695147 30134 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:28.696343 30107 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:28.696452 30107 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/wal
uuid: "1a4676b769374972b8540a702f8f3086"
format_stamp: "Formatted at 2026-08-12 08:01:28 on dist-test-slave-92m1"
I20260812 08:01:28.696550 30107 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 08:01:28.696612 30105 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:36019: Network error: Client connection negotiation failed: client connection to 127.26.116.124:36019: connect: Connection refused (error 111)
I20260812 08:01:28.728569 29982 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } attempt: 2
W20260812 08:01:28.730202 29982 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:36019: Network error: Client connection negotiation failed: client connection to 127.26.116.124:36019: connect: Connection refused (error 111)
I20260812 08:01:28.732946 30107 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:28.733611 30107 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:28.733762 30107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:28.741183 30228 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.124:36019 every 8 connection(s)
I20260812 08:01:28.741187 30107 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.124:36019
I20260812 08:01:28.742237 30107 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
I20260812 08:01:28.745265 30230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:28.748894 30230 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:28.751526 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 30107
I20260812 08:01:28.751634 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance
I20260812 08:01:28.758960 30230 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:28.763773 30230 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:28.770052 30230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086: Bootstrap starting.
I20260812 08:01:28.772529 30230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:28.773277 30230 log.cc:826] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:28.775059 30230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086: No bootstrap required, opened a new log
I20260812 08:01:28.777704 30230 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.777899 30230 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:28.778000 30230 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4676b769374972b8540a702f8f3086, State: Initialized, Role: FOLLOWER
I20260812 08:01:28.778463 30230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.778923 30249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.779064 30249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.779603 30230 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:01:28.784451 30266 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:28.784545 30266 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:28.783355 30107 master_runner.cc:187] Error getting master registration for 127.26.116.126:46719: OK, instance_id { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" instance_seqno: 1786521688375424 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:28.785615 30107 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:28.787778 30105 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } attempt: 3
I20260812 08:01:28.795083 30105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c: Bootstrap starting.
I20260812 08:01:28.797372 30105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:28.798336 30105 log.cc:826] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:28.800146 30105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c: No bootstrap required, opened a new log
I20260812 08:01:28.803323 30105 raft_consensus.cc:359] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.803473 30105 raft_consensus.cc:385] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:28.803529 30105 raft_consensus.cc:740] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c180d98740bb4d32b6b19909f1a6eb1c, State: Initialized, Role: FOLLOWER
I20260812 08:01:28.803995 30105 consensus_queue.cc:260] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.804474 30273 sys_catalog.cc:455] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.804601 30273 sys_catalog.cc:458] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.805198 30105 sys_catalog.cc:565] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:01:28.810424 30296 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:28.810510 30296 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:28.809571 29986 master_runner.cc:187] Error getting master registration for 127.26.116.126:46719: OK, instance_id { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" instance_seqno: 1786521688375424 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:28.811682 29986 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:28.829386 29982 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } attempt: 3
I20260812 08:01:28.836301 29982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: Bootstrap starting.
I20260812 08:01:28.839344 29982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:28.840348 29982 log.cc:826] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:28.842041 29982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: No bootstrap required, opened a new log
I20260812 08:01:28.844619 29982 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.844800 29982 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:28.844875 29982 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1ec014d708404a867994d2dd6f9750, State: Initialized, Role: FOLLOWER
I20260812 08:01:28.845347 29982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.845827 30300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.846004 30300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.846561 29982 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:01:28.854702 30317 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:28.854889 30317 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:28.856361 29857 master_runner.cc:264] No leader master found from master 9e1ec014d708404a867994d2dd6f9750
I20260812 08:01:28.856454 29857 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 08:01:28.871069 29893 tablet.cc:2406] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:28.894348 30273 raft_consensus.cc:493] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:28.894609 30273 raft_consensus.cc:515] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.895738 30273 leader_election.cc:290] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1ec014d708404a867994d2dd6f9750 (127.26.116.126:46719), 1a4676b769374972b8540a702f8f3086 (127.26.116.124:36019)
I20260812 08:01:28.896517 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4676b769374972b8540a702f8f3086" is_pre_election: true
I20260812 08:01:28.896827 30182 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c180d98740bb4d32b6b19909f1a6eb1c in term 0.
I20260812 08:01:28.897279 30007 leader_election.cc:304] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4676b769374972b8540a702f8f3086, c180d98740bb4d32b6b19909f1a6eb1c; no voters: 
I20260812 08:01:28.898065 29933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1ec014d708404a867994d2dd6f9750" is_pre_election: true
I20260812 08:01:28.898327 29933 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c180d98740bb4d32b6b19909f1a6eb1c in term 0.
I20260812 08:01:28.898918 30273 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:28.899012 30273 raft_consensus.cc:493] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:28.899080 30273 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:28.902714 30273 raft_consensus.cc:515] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.903640 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4676b769374972b8540a702f8f3086"
I20260812 08:01:28.903767 30182 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:28.904975 30182 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c180d98740bb4d32b6b19909f1a6eb1c in term 1.
I20260812 08:01:28.905316 30007 leader_election.cc:304] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4676b769374972b8540a702f8f3086, c180d98740bb4d32b6b19909f1a6eb1c; no voters: 
I20260812 08:01:28.905984 29933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1ec014d708404a867994d2dd6f9750"
I20260812 08:01:28.906126 29933 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:28.907392 29933 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c180d98740bb4d32b6b19909f1a6eb1c in term 1.
I20260812 08:01:28.908200 30273 leader_election.cc:290] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [CANDIDATE]: Term 1 election: Requested vote from peers 9e1ec014d708404a867994d2dd6f9750 (127.26.116.126:46719), 1a4676b769374972b8540a702f8f3086 (127.26.116.124:36019)
I20260812 08:01:28.908452 30273 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:28.908556 30273 raft_consensus.cc:697] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 1 LEADER]: Becoming Leader. State: Replica: c180d98740bb4d32b6b19909f1a6eb1c, State: Running, Role: LEADER
I20260812 08:01:28.908906 30273 consensus_queue.cc:237] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:28.910948 30273 sys_catalog.cc:455] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c180d98740bb4d32b6b19909f1a6eb1c. Latest consensus state: current_term: 1 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.911067 30273 sys_catalog.cc:458] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:28.911592 30322 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:28.912679 30322 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:28.917948 30182 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Refusing update from remote peer c180d98740bb4d32b6b19909f1a6eb1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:28.918677 30319 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:28.922478 30249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c180d98740bb4d32b6b19909f1a6eb1c. Latest consensus state: current_term: 1 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.922605 30249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.925997 29933 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 1 FOLLOWER]: Refusing update from remote peer c180d98740bb4d32b6b19909f1a6eb1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:28.926568 30319 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:28.930691 30300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c180d98740bb4d32b6b19909f1a6eb1c. Latest consensus state: current_term: 1 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.930814 30300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.937603 30319 sys_catalog.cc:455] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.937753 30319 sys_catalog.cc:458] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:28.939031 30300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.939163 30300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.939625 30326 mvcc.cc:204] Tried to move back new op lower bound from 7317592837800927232 to 7317592837774573568. Current Snapshot: MvccSnapshot[applied={T|T < 7317592837800927232}]
I20260812 08:01:28.940645 30273 sys_catalog.cc:455] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.940760 30273 sys_catalog.cc:458] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:28.941936 30249 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:28.942058 30249 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:28.945288 30329 mvcc.cc:204] Tried to move back new op lower bound from 7317592837800927232 to 7317592837774573568. Current Snapshot: MvccSnapshot[applied={T|T < 7317592837800927232}]
I20260812 08:01:28.945493 30327 mvcc.cc:204] Tried to move back new op lower bound from 7317592837800927232 to 7317592837774573568. Current Snapshot: MvccSnapshot[applied={T|T < 7317592837800927232}]
I20260812 08:01:28.950139 30322 catalog_manager.cc:1383] Generated new cluster ID: e0a62e2c9bbf49248389e28bfbb29dd7
I20260812 08:01:28.950235 30322 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:28.987298 30322 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:28.988461 30322 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:29.005676 30322 catalog_manager.cc:6092] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c: Generated new TSK 0
I20260812 08:01:29.006470 30322 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:29.029917 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.65:0
--local_ip_for_outbound_sockets=127.26.116.65
--webserver_interface=127.26.116.65
--webserver_port=0
--tserver_master_addrs=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--builtin_ntp_servers=127.26.116.84:41221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:01:29.153074 30335 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:29.153304 30335 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:29.153402 30335 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:29.156881 30335 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:29.157060 30335 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.65
I20260812 08:01:29.161008 30335 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:41221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.116.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--never_fsync=true
--heap_profile_path=/tmp/kudu.30335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:29.162142 30335 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:29.163317 30335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:29.170169 30345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:29.170169 30344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:29.170169 30347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:29.170462 30335 server_base.cc:1061] running on GCE node
I20260812 08:01:29.170818 30335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:29.171425 30335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:29.172587 30335 hybrid_clock.cc:648] HybridClock initialized: now 1786521689172560 us; error 29 us; skew 500 ppm
I20260812 08:01:29.174260 30335 webserver.cc:533] Webserver started at http://127.26.116.65:46199/ using document root <none> and password file <none>
I20260812 08:01:29.174865 30335 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:29.174921 30335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:29.175159 30335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:29.176725 30335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/data/instance:
uuid: "18650fa4082d4bdfa4b61398dd947a28"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.177239 30335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/wal/instance:
uuid: "18650fa4082d4bdfa4b61398dd947a28"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.180534 30335 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:29.182742 30355 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.183725 30335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:01:29.183846 30335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
uuid: "18650fa4082d4bdfa4b61398dd947a28"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.183944 30335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:29.204993 30335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:29.205694 30335 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:29.205940 30335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:29.206532 30335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:29.207882 30335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:29.207932 30335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.208000 30335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:29.208039 30335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.217311 30335 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.65:44447
I20260812 08:01:29.217355 30539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.65:44447 every 8 connection(s)
I20260812 08:01:29.218228 30335 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:29.227389 30548 heartbeater.cc:344] Connected to a master server at 127.26.116.125:45429
I20260812 08:01:29.227483 30545 heartbeater.cc:344] Connected to a master server at 127.26.116.126:46719
I20260812 08:01:29.227509 30544 heartbeater.cc:344] Connected to a master server at 127.26.116.124:36019
I20260812 08:01:29.227633 30548 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.227649 30544 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.227633 30545 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.228104 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 30335
I20260812 08:01:29.228215 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:29.228286 30544 heartbeater.cc:507] Master 127.26.116.124:36019 requested a full tablet report, sending...
I20260812 08:01:29.228272 30545 heartbeater.cc:507] Master 127.26.116.126:46719 requested a full tablet report, sending...
I20260812 08:01:29.228272 30548 heartbeater.cc:507] Master 127.26.116.125:45429 requested a full tablet report, sending...
I20260812 08:01:29.229815 29910 ts_manager.cc:194] Registered new tserver with Master: 18650fa4082d4bdfa4b61398dd947a28 (127.26.116.65:44447)
I20260812 08:01:29.229815 30160 ts_manager.cc:194] Registered new tserver with Master: 18650fa4082d4bdfa4b61398dd947a28 (127.26.116.65:44447)
I20260812 08:01:29.230444 30041 ts_manager.cc:194] Registered new tserver with Master: 18650fa4082d4bdfa4b61398dd947a28 (127.26.116.65:44447)
I20260812 08:01:29.231645 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.66:0
--local_ip_for_outbound_sockets=127.26.116.66
--webserver_interface=127.26.116.66
--webserver_port=0
--tserver_master_addrs=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--builtin_ntp_servers=127.26.116.84:41221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:29.231840 30041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.65:37589
W20260812 08:01:29.338505 30553 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:29.338729 30553 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:29.338809 30553 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:29.342248 30553 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:29.342393 30553 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.66
I20260812 08:01:29.346316 30553 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:41221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.116.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--never_fsync=true
--heap_profile_path=/tmp/kudu.30553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:29.347512 30553 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:29.348645 30553 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:29.355252 30574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:29.355296 30560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:29.355307 30569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:29.355399 30553 server_base.cc:1061] running on GCE node
I20260812 08:01:29.355885 30553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:29.356361 30553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:29.357496 30553 hybrid_clock.cc:648] HybridClock initialized: now 1786521689357479 us; error 29 us; skew 500 ppm
I20260812 08:01:29.359146 30553 webserver.cc:533] Webserver started at http://127.26.116.66:45393/ using document root <none> and password file <none>
I20260812 08:01:29.359728 30553 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:29.359815 30553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:29.360038 30553 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:29.361554 30553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/data/instance:
uuid: "75ca7cd0ac224648bc223bca8a0c398f"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.362033 30553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/wal/instance:
uuid: "75ca7cd0ac224648bc223bca8a0c398f"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.365217 30553 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 08:01:29.367733 30586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.368985 30553 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:29.369091 30553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
uuid: "75ca7cd0ac224648bc223bca8a0c398f"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.369191 30553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:29.389612 30553 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:29.390303 30553 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:29.390514 30553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:29.391111 30553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:29.392172 30553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:29.392221 30553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.392287 30553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:29.392330 30553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.402375 30553 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.66:35165
I20260812 08:01:29.402398 30776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.66:35165 every 8 connection(s)
I20260812 08:01:29.403455 30553 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:29.408370 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 30553
I20260812 08:01:29.408484 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:29.412472 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.67:0
--local_ip_for_outbound_sockets=127.26.116.67
--webserver_interface=127.26.116.67
--webserver_port=0
--tserver_master_addrs=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--builtin_ntp_servers=127.26.116.84:41221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:29.413394 30784 heartbeater.cc:344] Connected to a master server at 127.26.116.126:46719
I20260812 08:01:29.413659 30784 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.414273 30784 heartbeater.cc:507] Master 127.26.116.126:46719 requested a full tablet report, sending...
I20260812 08:01:29.414777 30787 heartbeater.cc:344] Connected to a master server at 127.26.116.125:45429
I20260812 08:01:29.414862 30787 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.415060 30787 heartbeater.cc:507] Master 127.26.116.125:45429 requested a full tablet report, sending...
I20260812 08:01:29.415105 30777 heartbeater.cc:344] Connected to a master server at 127.26.116.124:36019
I20260812 08:01:29.415235 30777 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.415439 30777 heartbeater.cc:507] Master 127.26.116.124:36019 requested a full tablet report, sending...
I20260812 08:01:29.415464 29910 ts_manager.cc:194] Registered new tserver with Master: 75ca7cd0ac224648bc223bca8a0c398f (127.26.116.66:35165)
I20260812 08:01:29.416206 30160 ts_manager.cc:194] Registered new tserver with Master: 75ca7cd0ac224648bc223bca8a0c398f (127.26.116.66:35165)
I20260812 08:01:29.416239 30041 ts_manager.cc:194] Registered new tserver with Master: 75ca7cd0ac224648bc223bca8a0c398f (127.26.116.66:35165)
I20260812 08:01:29.416994 30041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.66:35557
I20260812 08:01:29.502185 30800 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c180d98740bb4d32b6b19909f1a6eb1c)
I20260812 08:01:29.502339 30800 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:29.503337 30800 leader_election.cc:290] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e1ec014d708404a867994d2dd6f9750 (127.26.116.126:46719), c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429)
I20260812 08:01:29.503901 29933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a4676b769374972b8540a702f8f3086" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e1ec014d708404a867994d2dd6f9750" is_pre_election: true
I20260812 08:01:29.503950 30063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a4676b769374972b8540a702f8f3086" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" is_pre_election: true
I20260812 08:01:29.504582 30135 leader_election.cc:304] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a4676b769374972b8540a702f8f3086; no voters: 9e1ec014d708404a867994d2dd6f9750, c180d98740bb4d32b6b19909f1a6eb1c
I20260812 08:01:29.504994 30800 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:29.522729 30798 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:29.522984 30798 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:29.523038 30798 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:29.526422 30798 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:29.526538 30798 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.67
I20260812 08:01:29.530522 30798 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:41221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.116.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:46719,127.26.116.125:45429,127.26.116.124:36019
--never_fsync=true
--heap_profile_path=/tmp/kudu.30798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:29.531652 30798 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:29.532733 30798 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:29.538785 30817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:29.538811 30813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:29.538875 30812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:29.539062 30798 server_base.cc:1061] running on GCE node
I20260812 08:01:29.539608 30798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:29.540175 30798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:29.541369 30798 hybrid_clock.cc:648] HybridClock initialized: now 1786521689541351 us; error 30 us; skew 500 ppm
I20260812 08:01:29.543731 30798 webserver.cc:533] Webserver started at http://127.26.116.67:36705/ using document root <none> and password file <none>
I20260812 08:01:29.544466 30798 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:29.544550 30798 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:29.544776 30798 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:29.547140 30798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/data/instance:
uuid: "3d0e16430dc44509ba47cd8259b68d31"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.547765 30798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/instance:
uuid: "3d0e16430dc44509ba47cd8259b68d31"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.551599 30798 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:29.553821 30828 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.554847 30798 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:29.554988 30798 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
uuid: "3d0e16430dc44509ba47cd8259b68d31"
format_stamp: "Formatted at 2026-08-12 08:01:29 on dist-test-slave-92m1"
I20260812 08:01:29.555101 30798 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:29.574559 30798 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:29.575282 30798 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:29.575475 30798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:29.576035 30798 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:29.577064 30798 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:29.577139 30798 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.577224 30798 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:29.577275 30798 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:29.587517 30798 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.67:43785
I20260812 08:01:29.587548 31038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.67:43785 every 8 connection(s)
I20260812 08:01:29.588658 30798 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:29.591127 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 30798
I20260812 08:01:29.591266 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:29.599180 31040 heartbeater.cc:344] Connected to a master server at 127.26.116.126:46719
I20260812 08:01:29.599280 31041 heartbeater.cc:344] Connected to a master server at 127.26.116.125:45429
I20260812 08:01:29.599490 31039 heartbeater.cc:344] Connected to a master server at 127.26.116.124:36019
I20260812 08:01:29.599467 31040 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.599468 31041 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.599601 31039 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:29.600087 31041 heartbeater.cc:507] Master 127.26.116.125:45429 requested a full tablet report, sending...
I20260812 08:01:29.600080 31039 heartbeater.cc:507] Master 127.26.116.124:36019 requested a full tablet report, sending...
I20260812 08:01:29.600081 31040 heartbeater.cc:507] Master 127.26.116.126:46719 requested a full tablet report, sending...
I20260812 08:01:29.601176 30041 ts_manager.cc:194] Registered new tserver with Master: 3d0e16430dc44509ba47cd8259b68d31 (127.26.116.67:43785)
I20260812 08:01:29.601195 30160 ts_manager.cc:194] Registered new tserver with Master: 3d0e16430dc44509ba47cd8259b68d31 (127.26.116.67:43785)
I20260812 08:01:29.601264 29910 ts_manager.cc:194] Registered new tserver with Master: 3d0e16430dc44509ba47cd8259b68d31 (127.26.116.67:43785)
I20260812 08:01:29.601873 30041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.67:40653
I20260812 08:01:29.612802 27089 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:29.622599 30041 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44342:
name: "default.test_kudu_1374"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:29.623893 30041 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_kudu_1374 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:29.644287 30913 tablet_service.cc:1511] Processing CreateTablet for tablet c7a93538240c4f8baa3d49b7c17efc29 (DEFAULT_TABLE table=default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:29.644549 30661 tablet_service.cc:1511] Processing CreateTablet for tablet c7a93538240c4f8baa3d49b7c17efc29 (DEFAULT_TABLE table=default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:29.645236 30913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a93538240c4f8baa3d49b7c17efc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:29.645140 30433 tablet_service.cc:1511] Processing CreateTablet for tablet c7a93538240c4f8baa3d49b7c17efc29 (DEFAULT_TABLE table=default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:29.645537 30661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a93538240c4f8baa3d49b7c17efc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:29.646034 30433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a93538240c4f8baa3d49b7c17efc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:29.650455 31092 tablet_bootstrap.cc:492] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: Bootstrap starting.
I20260812 08:01:29.652542 31094 tablet_bootstrap.cc:492] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: Bootstrap starting.
I20260812 08:01:29.652940 31092 tablet_bootstrap.cc:654] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:29.653630 31092 log.cc:826] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:29.654592 31094 tablet_bootstrap.cc:654] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:29.655295 31092 tablet_bootstrap.cc:492] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: No bootstrap required, opened a new log
I20260812 08:01:29.655383 31094 log.cc:826] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:29.655519 31092 ts_tablet_manager.cc:1403] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:29.655609 31093 tablet_bootstrap.cc:492] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: Bootstrap starting.
I20260812 08:01:29.657186 31094 tablet_bootstrap.cc:492] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: No bootstrap required, opened a new log
I20260812 08:01:29.657375 31094 ts_tablet_manager.cc:1403] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:01:29.657821 31093 tablet_bootstrap.cc:654] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:29.658632 31093 log.cc:826] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:29.658630 31092 raft_consensus.cc:359] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.658911 31092 raft_consensus.cc:385] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:29.659026 31092 raft_consensus.cc:740] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d0e16430dc44509ba47cd8259b68d31, State: Initialized, Role: FOLLOWER
I20260812 08:01:29.659559 31092 consensus_queue.cc:260] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.660976 31041 heartbeater.cc:499] Master 127.26.116.125:45429 was elected leader, sending a full tablet report...
I20260812 08:01:29.661054 31094 raft_consensus.cc:359] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.661252 31094 raft_consensus.cc:385] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:29.661319 31094 raft_consensus.cc:740] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18650fa4082d4bdfa4b61398dd947a28, State: Initialized, Role: FOLLOWER
I20260812 08:01:29.661782 31093 tablet_bootstrap.cc:492] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: No bootstrap required, opened a new log
I20260812 08:01:29.661736 31094 consensus_queue.cc:260] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.661979 31093 ts_tablet_manager.cc:1403] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: Time spent bootstrapping tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 08:01:29.662472 30548 heartbeater.cc:499] Master 127.26.116.125:45429 was elected leader, sending a full tablet report...
I20260812 08:01:29.662696 31094 ts_tablet_manager.cc:1434] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:01:29.664369 31092 ts_tablet_manager.cc:1434] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260812 08:01:29.669275 31093 raft_consensus.cc:359] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.669466 31093 raft_consensus.cc:385] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:29.669504 31093 raft_consensus.cc:740] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75ca7cd0ac224648bc223bca8a0c398f, State: Initialized, Role: FOLLOWER
I20260812 08:01:29.669839 31093 consensus_queue.cc:260] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.670681 31093 ts_tablet_manager.cc:1434] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.005s
I20260812 08:01:29.670830 30787 heartbeater.cc:499] Master 127.26.116.125:45429 was elected leader, sending a full tablet report...
W20260812 08:01:29.719729 30549 tablet.cc:2406] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:29.785890 30266 catalog_manager.cc:1295] Loaded cluster ID: e0a62e2c9bbf49248389e28bfbb29dd7
I20260812 08:01:29.785979 30266 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086: loading cluster ID for follower catalog manager: success
I20260812 08:01:29.787930 30266 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086: acquiring CA information for follower catalog manager: success
I20260812 08:01:29.789115 30266 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 08:01:29.840533 31045 tablet.cc:2406] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:29.856442 30317 catalog_manager.cc:1295] Loaded cluster ID: e0a62e2c9bbf49248389e28bfbb29dd7
I20260812 08:01:29.856531 30317 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: loading cluster ID for follower catalog manager: success
I20260812 08:01:29.858282 30317 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: acquiring CA information for follower catalog manager: success
I20260812 08:01:29.859539 30317 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 08:01:29.904871 30791 tablet.cc:2406] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:29.941133 31099 raft_consensus.cc:493] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:29.941366 31099 raft_consensus.cc:515] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.942602 31099 leader_election.cc:290] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75ca7cd0ac224648bc223bca8a0c398f (127.26.116.66:35165), 18650fa4082d4bdfa4b61398dd947a28 (127.26.116.65:44447)
I20260812 08:01:29.946535 30690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a93538240c4f8baa3d49b7c17efc29" candidate_uuid: "3d0e16430dc44509ba47cd8259b68d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ca7cd0ac224648bc223bca8a0c398f" is_pre_election: true
I20260812 08:01:29.946537 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a93538240c4f8baa3d49b7c17efc29" candidate_uuid: "3d0e16430dc44509ba47cd8259b68d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18650fa4082d4bdfa4b61398dd947a28" is_pre_election: true
I20260812 08:01:29.946843 30690 raft_consensus.cc:2468] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d0e16430dc44509ba47cd8259b68d31 in term 0.
I20260812 08:01:29.946844 30470 raft_consensus.cc:2468] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d0e16430dc44509ba47cd8259b68d31 in term 0.
I20260812 08:01:29.947412 30832 leader_election.cc:304] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d0e16430dc44509ba47cd8259b68d31, 75ca7cd0ac224648bc223bca8a0c398f; no voters: 
I20260812 08:01:29.947717 31099 raft_consensus.cc:2804] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:29.947794 31099 raft_consensus.cc:493] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:29.947836 31099 raft_consensus.cc:3060] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:29.948805 31099 raft_consensus.cc:515] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.949224 31099 leader_election.cc:290] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [CANDIDATE]: Term 1 election: Requested vote from peers 75ca7cd0ac224648bc223bca8a0c398f (127.26.116.66:35165), 18650fa4082d4bdfa4b61398dd947a28 (127.26.116.65:44447)
I20260812 08:01:29.949600 30690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a93538240c4f8baa3d49b7c17efc29" candidate_uuid: "3d0e16430dc44509ba47cd8259b68d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75ca7cd0ac224648bc223bca8a0c398f"
I20260812 08:01:29.949611 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a93538240c4f8baa3d49b7c17efc29" candidate_uuid: "3d0e16430dc44509ba47cd8259b68d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18650fa4082d4bdfa4b61398dd947a28"
I20260812 08:01:29.949705 30690 raft_consensus.cc:3060] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:29.949743 30470 raft_consensus.cc:3060] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:29.950599 30690 raft_consensus.cc:2468] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d0e16430dc44509ba47cd8259b68d31 in term 1.
I20260812 08:01:29.950616 30470 raft_consensus.cc:2468] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d0e16430dc44509ba47cd8259b68d31 in term 1.
I20260812 08:01:29.950912 30832 leader_election.cc:304] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d0e16430dc44509ba47cd8259b68d31, 75ca7cd0ac224648bc223bca8a0c398f; no voters: 
I20260812 08:01:29.951113 31099 raft_consensus.cc:2804] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:29.951371 31099 raft_consensus.cc:697] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [term 1 LEADER]: Becoming Leader. State: Replica: 3d0e16430dc44509ba47cd8259b68d31, State: Running, Role: LEADER
I20260812 08:01:29.951876 31099 consensus_queue.cc:237] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } }
I20260812 08:01:29.955793 30039 catalog_manager.cc:5719] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d0e16430dc44509ba47cd8259b68d31 (127.26.116.67). New cstate: current_term: 1 leader_uuid: "3d0e16430dc44509ba47cd8259b68d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d0e16430dc44509ba47cd8259b68d31" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 43785 } health_report { overall_health: HEALTHY } } }
I20260812 08:01:30.418525 31099 consensus_queue.cc:1048] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75ca7cd0ac224648bc223bca8a0c398f" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 35165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:30.425591 31110 consensus_queue.cc:1048] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18650fa4082d4bdfa4b61398dd947a28" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 44447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:30.460381 31121 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c180d98740bb4d32b6b19909f1a6eb1c)
I20260812 08:01:30.460501 31127 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c180d98740bb4d32b6b19909f1a6eb1c)
I20260812 08:01:30.460551 31121 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:30.460682 31127 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:30.461125 31121 leader_election.cc:290] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e1ec014d708404a867994d2dd6f9750 (127.26.116.126:46719), c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429)
I20260812 08:01:30.461660 29933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a4676b769374972b8540a702f8f3086" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "9e1ec014d708404a867994d2dd6f9750" is_pre_election: true
I20260812 08:01:30.461678 30063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a4676b769374972b8540a702f8f3086" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" is_pre_election: true
I20260812 08:01:30.461788 29933 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4676b769374972b8540a702f8f3086 in term 1.
I20260812 08:01:30.461818 31127 leader_election.cc:290] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429), 1a4676b769374972b8540a702f8f3086 (127.26.116.124:36019)
I20260812 08:01:30.462175 30135 leader_election.cc:304] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4676b769374972b8540a702f8f3086, 9e1ec014d708404a867994d2dd6f9750; no voters: 
I20260812 08:01:30.462256 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e1ec014d708404a867994d2dd6f9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1a4676b769374972b8540a702f8f3086" is_pre_election: true
I20260812 08:01:30.462407 30182 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1ec014d708404a867994d2dd6f9750 in term 1.
I20260812 08:01:30.462404 30063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e1ec014d708404a867994d2dd6f9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" is_pre_election: true
I20260812 08:01:30.462520 31121 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:30.462581 31121 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c180d98740bb4d32b6b19909f1a6eb1c)
I20260812 08:01:30.462634 31121 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:30.462812 29885 leader_election.cc:304] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4676b769374972b8540a702f8f3086, 9e1ec014d708404a867994d2dd6f9750; no voters: 
I20260812 08:01:30.463068 31127 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:30.463146 31127 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c180d98740bb4d32b6b19909f1a6eb1c)
I20260812 08:01:30.463219 31127 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:30.463889 31121 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:30.464329 31121 leader_election.cc:290] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1ec014d708404a867994d2dd6f9750 (127.26.116.126:46719), c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429)
I20260812 08:01:30.464356 31127 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:30.464658 29933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a4676b769374972b8540a702f8f3086" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "9e1ec014d708404a867994d2dd6f9750"
I20260812 08:01:30.464708 30063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a4676b769374972b8540a702f8f3086" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c180d98740bb4d32b6b19909f1a6eb1c"
I20260812 08:01:30.464812 29933 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a4676b769374972b8540a702f8f3086 in current term 2: Already voted for candidate 9e1ec014d708404a867994d2dd6f9750 in this term.
I20260812 08:01:30.464833 31127 leader_election.cc:290] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 2 election: Requested vote from peers c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429), 1a4676b769374972b8540a702f8f3086 (127.26.116.124:36019)
I20260812 08:01:30.465221 30135 leader_election.cc:304] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a4676b769374972b8540a702f8f3086; no voters: 9e1ec014d708404a867994d2dd6f9750, c180d98740bb4d32b6b19909f1a6eb1c
I20260812 08:01:30.465255 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e1ec014d708404a867994d2dd6f9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1a4676b769374972b8540a702f8f3086"
I20260812 08:01:30.465420 30182 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e1ec014d708404a867994d2dd6f9750 in current term 2: Already voted for candidate 1a4676b769374972b8540a702f8f3086 in this term.
I20260812 08:01:30.465498 31121 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 08:01:30.465669 30063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e1ec014d708404a867994d2dd6f9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c180d98740bb4d32b6b19909f1a6eb1c"
I20260812 08:01:30.465973 29883 leader_election.cc:304] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e1ec014d708404a867994d2dd6f9750; no voters: 1a4676b769374972b8540a702f8f3086, c180d98740bb4d32b6b19909f1a6eb1c
I20260812 08:01:30.466126 31127 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 08:01:30.475580 29933 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 2 FOLLOWER]: Rejecting Update request from peer c180d98740bb4d32b6b19909f1a6eb1c for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:30.476091 31128 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 }, Status: INVALID_TERM, Last received: 1.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:30.476462 31129 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:01:30.476523 31129 raft_consensus.cc:740] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c180d98740bb4d32b6b19909f1a6eb1c, State: Running, Role: LEADER
I20260812 08:01:30.476742 31129 consensus_queue.cc:260] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:30.476991 31129 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:30.638020 30296 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:31.063403 31132 raft_consensus.cc:493] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:31.063588 31132 raft_consensus.cc:515] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:31.064143 31132 leader_election.cc:290] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e1ec014d708404a867994d2dd6f9750 (127.26.116.126:46719), 1a4676b769374972b8540a702f8f3086 (127.26.116.124:36019)
I20260812 08:01:31.064571 29933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "9e1ec014d708404a867994d2dd6f9750" is_pre_election: true
I20260812 08:01:31.064646 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1a4676b769374972b8540a702f8f3086" is_pre_election: true
I20260812 08:01:31.064760 29933 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c180d98740bb4d32b6b19909f1a6eb1c in term 2.
I20260812 08:01:31.064877 30182 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c180d98740bb4d32b6b19909f1a6eb1c in term 2.
I20260812 08:01:31.065202 30006 leader_election.cc:304] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e1ec014d708404a867994d2dd6f9750, c180d98740bb4d32b6b19909f1a6eb1c; no voters: 
I20260812 08:01:31.065435 31132 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:01:31.065500 31132 raft_consensus.cc:493] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:31.065534 31132 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:31.066408 31132 raft_consensus.cc:515] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:31.066778 31132 leader_election.cc:290] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [CANDIDATE]: Term 3 election: Requested vote from peers 9e1ec014d708404a867994d2dd6f9750 (127.26.116.126:46719), 1a4676b769374972b8540a702f8f3086 (127.26.116.124:36019)
I20260812 08:01:31.067134 29933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "9e1ec014d708404a867994d2dd6f9750"
I20260812 08:01:31.067219 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1a4676b769374972b8540a702f8f3086"
I20260812 08:01:31.067301 29933 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:31.067337 30182 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:31.068387 29933 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c180d98740bb4d32b6b19909f1a6eb1c in term 3.
I20260812 08:01:31.068387 30182 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c180d98740bb4d32b6b19909f1a6eb1c in term 3.
I20260812 08:01:31.068709 30007 leader_election.cc:304] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4676b769374972b8540a702f8f3086, c180d98740bb4d32b6b19909f1a6eb1c; no voters: 
I20260812 08:01:31.068889 31132 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:01:31.069123 31132 raft_consensus.cc:697] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [term 3 LEADER]: Becoming Leader. State: Replica: c180d98740bb4d32b6b19909f1a6eb1c, State: Running, Role: LEADER
I20260812 08:01:31.069298 31132 consensus_queue.cc:237] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:31.069998 31133 sys_catalog.cc:455] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c180d98740bb4d32b6b19909f1a6eb1c. Latest consensus state: current_term: 3 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:31.070113 31133 sys_catalog.cc:458] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:31.070358 31137 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:31.071687 31137 catalog_manager.cc:679] Loaded metadata for table default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33]
I20260812 08:01:31.072645 31137 tablet_loader.cc:96] loaded metadata for tablet c7a93538240c4f8baa3d49b7c17efc29 (table default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33])
I20260812 08:01:31.072852 31137 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:31.073302 31137 catalog_manager.cc:1295] Loaded cluster ID: e0a62e2c9bbf49248389e28bfbb29dd7
I20260812 08:01:31.073377 31137 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:31.074092 31137 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:31.074487 31137 catalog_manager.cc:6103] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c: Loaded TSK: 0
I20260812 08:01:31.074899 31137 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:31.087008 30097 generic_service.cc:175] {username='slave'} at 127.0.0.1:44316 changed flags via RPC: catalog_manager_fail_ts_rpcs from 'false' to 'true'
I20260812 08:01:31.088868 30040 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44342:
table { table_name: "default.test_kudu_1374" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "new_col" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
I20260812 08:01:31.091743 29933 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 3 FOLLOWER]: Refusing update from remote peer c180d98740bb4d32b6b19909f1a6eb1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 9. (index mismatch)
I20260812 08:01:31.091743 30182 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 3 FOLLOWER]: Refusing update from remote peer c180d98740bb4d32b6b19909f1a6eb1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 9. (index mismatch)
I20260812 08:01:31.092303 31133 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:31.092530 31132 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:31.094175 31140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c180d98740bb4d32b6b19909f1a6eb1c. Latest consensus state: current_term: 3 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:31.094308 31140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:31.095381 31133 sys_catalog.cc:455] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:31.095508 31133 sys_catalog.cc:458] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:31.095185 31147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c180d98740bb4d32b6b19909f1a6eb1c. Latest consensus state: current_term: 3 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:31.095693 31147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:01:31.095922 30040 catalog_manager.cc:5979] Failed to send alter table request: Runtime error: Async RPCs configured to fail
I20260812 08:01:31.096060 31140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:31.096190 31140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:31.096503 31132 sys_catalog.cc:455] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:31.096606 31132 sys_catalog.cc:458] T 00000000000000000000000000000000 P c180d98740bb4d32b6b19909f1a6eb1c [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:31.096964 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 29986
I20260812 08:01:31.105984 31147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:31.106122 31147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:01:31.116504 30140 connection.cc:573] server connection from 127.0.0.1:42124 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:01:31.116916 29883 connection.cc:573] server connection from 127.0.0.1:41494 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:01:31.118438 31052 master_proxy_rpc.cc:203] Re-attempting IsAlterTableInProgres request to leader Master (127.26.116.125:45429)
W20260812 08:01:31.429363 30787 heartbeater.cc:646] Failed to heartbeat to 127.26.116.125:45429 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
W20260812 08:01:31.434136 30548 heartbeater.cc:646] Failed to heartbeat to 127.26.116.125:45429 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
W20260812 08:01:31.545980 31041 heartbeater.cc:646] Failed to heartbeat to 127.26.116.125:45429 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
I20260812 08:01:31.596287 31140 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c180d98740bb4d32b6b19909f1a6eb1c)
I20260812 08:01:31.596448 31140 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:31.597023 31140 leader_election.cc:290] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429), 1a4676b769374972b8540a702f8f3086 (127.26.116.124:36019)
I20260812 08:01:31.597586 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e1ec014d708404a867994d2dd6f9750" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "1a4676b769374972b8540a702f8f3086" is_pre_election: true
I20260812 08:01:31.597769 30182 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1ec014d708404a867994d2dd6f9750 in term 3.
I20260812 08:01:31.597836 31147 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c180d98740bb4d32b6b19909f1a6eb1c)
I20260812 08:01:31.597913 31147 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:31.598133 29885 leader_election.cc:304] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4676b769374972b8540a702f8f3086, 9e1ec014d708404a867994d2dd6f9750; no voters: 
I20260812 08:01:31.598361 31147 leader_election.cc:290] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e1ec014d708404a867994d2dd6f9750 (127.26.116.126:46719), c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429)
I20260812 08:01:31.598527 31140 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260812 08:01:31.598537 29883 leader_election.cc:336] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429): Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
I20260812 08:01:31.598619 31140 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c180d98740bb4d32b6b19909f1a6eb1c)
I20260812 08:01:31.598690 31140 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:31.598920 29933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a4676b769374972b8540a702f8f3086" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "9e1ec014d708404a867994d2dd6f9750" is_pre_election: true
W20260812 08:01:31.599236 30135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
I20260812 08:01:31.599906 31140 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:31.600147 29933 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a4676b769374972b8540a702f8f3086 in current term 4: Already voted for candidate 9e1ec014d708404a867994d2dd6f9750 in this term.
I20260812 08:01:31.600296 31140 leader_election.cc:290] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 4 election: Requested vote from peers c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429), 1a4676b769374972b8540a702f8f3086 (127.26.116.124:36019)
W20260812 08:01:31.600684 30135 leader_election.cc:336] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429): Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
I20260812 08:01:31.600659 30182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e1ec014d708404a867994d2dd6f9750" candidate_term: 4 candidate_status { last_received { term: 3 index: 9 } } ignore_live_leader: false dest_uuid: "1a4676b769374972b8540a702f8f3086"
I20260812 08:01:31.600850 30182 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:31.600935 30135 leader_election.cc:304] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a4676b769374972b8540a702f8f3086; no voters: 9e1ec014d708404a867994d2dd6f9750, c180d98740bb4d32b6b19909f1a6eb1c
I20260812 08:01:31.601783 30182 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1ec014d708404a867994d2dd6f9750 in term 4.
W20260812 08:01:31.601837 29883 leader_election.cc:336] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429): Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111)
I20260812 08:01:31.602005 31147 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:01:31.602079 29885 leader_election.cc:304] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a4676b769374972b8540a702f8f3086, 9e1ec014d708404a867994d2dd6f9750; no voters: c180d98740bb4d32b6b19909f1a6eb1c
I20260812 08:01:31.602308 31140 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 08:01:31.602528 31140 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [term 4 LEADER]: Becoming Leader. State: Replica: 9e1ec014d708404a867994d2dd6f9750, State: Running, Role: LEADER
I20260812 08:01:31.602840 31140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 3.9, Last appended by leader: 9, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } }
I20260812 08:01:31.603804 31172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e1ec014d708404a867994d2dd6f9750. Latest consensus state: current_term: 4 leader_uuid: "9e1ec014d708404a867994d2dd6f9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:31.603905 31172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:31.604195 31173 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:31.605545 31173 catalog_manager.cc:679] Loaded metadata for table default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33]
I20260812 08:01:31.606472 31173 tablet_loader.cc:96] loaded metadata for tablet c7a93538240c4f8baa3d49b7c17efc29 (table default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33])
I20260812 08:01:31.606673 31173 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:31.607039 31173 catalog_manager.cc:1295] Loaded cluster ID: e0a62e2c9bbf49248389e28bfbb29dd7
I20260812 08:01:31.607087 31173 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:31.607631 31173 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:31.607980 31173 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: Loaded TSK: 0
I20260812 08:01:31.608491 31173 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 08:01:32.049278 29883 consensus_peers.cc:597] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 -> Peer c180d98740bb4d32b6b19909f1a6eb1c (127.26.116.125:45429): Couldn't send request to peer c180d98740bb4d32b6b19909f1a6eb1c. Status: Network error: Client connection negotiation failed: client connection to 127.26.116.125:45429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:01:32.070258 30182 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [term 4 FOLLOWER]: Refusing update from remote peer 9e1ec014d708404a867994d2dd6f9750: Log matching property violated. Preceding OpId in replica: term: 3 index: 9. Preceding OpId from leader: term: 4 index: 10. (index mismatch)
I20260812 08:01:32.070886 31172 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 08:01:32.072152 31147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e1ec014d708404a867994d2dd6f9750. Latest consensus state: current_term: 4 leader_uuid: "9e1ec014d708404a867994d2dd6f9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:32.072266 31147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:32.075820 31140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "9e1ec014d708404a867994d2dd6f9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:32.075973 31140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:32.075907 31147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "9e1ec014d708404a867994d2dd6f9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1ec014d708404a867994d2dd6f9750" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 46719 } } peers { permanent_uuid: "c180d98740bb4d32b6b19909f1a6eb1c" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 45429 } } peers { permanent_uuid: "1a4676b769374972b8540a702f8f3086" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 36019 } } }
I20260812 08:01:32.076042 31147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a4676b769374972b8540a702f8f3086 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:32.431509 30784 heartbeater.cc:499] Master 127.26.116.126:46719 was elected leader, sending a full tablet report...
I20260812 08:01:32.433087 29910 catalog_manager.cc:5811] TS 75ca7cd0ac224648bc223bca8a0c398f (127.26.116.66:35165) does not have the latest schema for tablet c7a93538240c4f8baa3d49b7c17efc29 (table default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33]). Expected version 1 got 0
I20260812 08:01:32.435649 30545 heartbeater.cc:499] Master 127.26.116.126:46719 was elected leader, sending a full tablet report...
I20260812 08:01:32.437043 29910 catalog_manager.cc:5811] TS 18650fa4082d4bdfa4b61398dd947a28 (127.26.116.65:44447) does not have the latest schema for tablet c7a93538240c4f8baa3d49b7c17efc29 (table default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33]). Expected version 1 got 0
I20260812 08:01:32.444602 31201 tablet.cc:1724] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    13:new_col INT32 NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 08:01:32.444885 31205 tablet.cc:1724] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    13:new_col INT32 NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 08:01:32.445501 31201 tablet.cc:1622] T c7a93538240c4f8baa3d49b7c17efc29 P 3d0e16430dc44509ba47cd8259b68d31: MemRowSet was empty: no flush needed.
I20260812 08:01:32.445479 31207 tablet.cc:1724] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    13:new_col INT32 NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 08:01:32.445824 31205 tablet.cc:1622] T c7a93538240c4f8baa3d49b7c17efc29 P 75ca7cd0ac224648bc223bca8a0c398f: MemRowSet was empty: no flush needed.
I20260812 08:01:32.446146 31207 tablet.cc:1622] T c7a93538240c4f8baa3d49b7c17efc29 P 18650fa4082d4bdfa4b61398dd947a28: MemRowSet was empty: no flush needed.
I20260812 08:01:32.447584 31040 heartbeater.cc:499] Master 127.26.116.126:46719 was elected leader, sending a full tablet report...
I20260812 08:01:32.455245 29910 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 9e1ec014d708404a867994d2dd6f9750: default.test_kudu_1374 [id=948d665bbdea45b188ecbbd09ba2de33] alter complete (version 1)
I20260812 08:01:32.669340 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 30335
I20260812 08:01:32.681000 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 30553
I20260812 08:01:32.695051 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 30798
I20260812 08:01:32.708714 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 29857
I20260812 08:01:32.727682 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 30107
2026-08-12T08:01:32Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestKUDU1374/0 (4551 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestMasterPermanentFailure/0
2026-08-12T08:01:32Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:32Z Disabled control of system clock
I20260812 08:01:32.769970 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:44773
--webserver_interface=127.26.116.126
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:01:32.874092 31220 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:32.874344 31220 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:32.874387 31220 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:32.878157 31220 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:32.878229 31220 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:32.878252 31220 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:32.878269 31220 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:32.882149 31220 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:44773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.116.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.31220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:32.883224 31220 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:32.884274 31220 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:32.889529 31228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:32.889588 31233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:32.889593 31229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:32.889832 31220 server_base.cc:1061] running on GCE node
I20260812 08:01:32.890359 31220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:32.891252 31220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:32.892408 31220 hybrid_clock.cc:648] HybridClock initialized: now 1786521692892394 us; error 29 us; skew 500 ppm
I20260812 08:01:32.894155 31220 webserver.cc:533] Webserver started at http://127.26.116.126:34831/ using document root <none> and password file <none>
I20260812 08:01:32.894730 31220 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:32.894816 31220 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:32.895035 31220 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:32.896556 31220 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/instance:
uuid: "815fd2931e984818b4644ca5c9729cd4"
format_stamp: "Formatted at 2026-08-12 08:01:32 on dist-test-slave-92m1"
I20260812 08:01:32.897047 31220 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance:
uuid: "815fd2931e984818b4644ca5c9729cd4"
format_stamp: "Formatted at 2026-08-12 08:01:32 on dist-test-slave-92m1"
I20260812 08:01:32.900177 31220 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:32.902180 31244 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:32.903064 31220 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:32.903232 31220 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
uuid: "815fd2931e984818b4644ca5c9729cd4"
format_stamp: "Formatted at 2026-08-12 08:01:32 on dist-test-slave-92m1"
I20260812 08:01:32.903337 31220 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:32.912932 31220 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:32.913579 31220 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:32.913766 31220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:32.921164 31220 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.126:44773
I20260812 08:01:32.921176 31338 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.126:44773 every 8 connection(s)
I20260812 08:01:32.922165 31220 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:32.925086 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:32.925278 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 31220
I20260812 08:01:32.925405 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance
I20260812 08:01:32.926021 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:34993
--webserver_interface=127.26.116.125
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:32.929100 31339 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:32.941519 31339 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:32.942339 31246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.125:34993: connect: Connection refused (error 111)
W20260812 08:01:32.943338 31339 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:34993: Network error: Client connection negotiation failed: client connection to 127.26.116.125:34993: connect: Connection refused (error 111)
I20260812 08:01:32.992643 31339 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } attempt: 1
W20260812 08:01:32.994382 31339 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:34993: Network error: Client connection negotiation failed: client connection to 127.26.116.125:34993: connect: Connection refused (error 111)
W20260812 08:01:33.041386 31342 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:33.041631 31342 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:33.041675 31342 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:33.045388 31342 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:33.045463 31342 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:33.045487 31342 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:33.045508 31342 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:33.049763 31342 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:34993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.116.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.31342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:33.050912 31342 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:33.052109 31342 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:33.058254 31359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:33.058276 31354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:33.058279 31352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:33.058612 31342 server_base.cc:1061] running on GCE node
I20260812 08:01:33.059190 31342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:33.060242 31342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:33.061416 31342 hybrid_clock.cc:648] HybridClock initialized: now 1786521693061393 us; error 40 us; skew 500 ppm
I20260812 08:01:33.062592 31339 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } attempt: 2
I20260812 08:01:33.063566 31342 webserver.cc:533] Webserver started at http://127.26.116.125:42401/ using document root <none> and password file <none>
I20260812 08:01:33.064231 31342 fs_manager.cc:362] Metadata directory not provided
W20260812 08:01:33.064208 31339 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.125:34993: Network error: Client connection negotiation failed: client connection to 127.26.116.125:34993: connect: Connection refused (error 111)
I20260812 08:01:33.064312 31342 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:33.064509 31342 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:33.066128 31342 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/instance:
uuid: "2f1d4089ea8140dfab33d71b320df9df"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.066610 31342 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance:
uuid: "2f1d4089ea8140dfab33d71b320df9df"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.070182 31342 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:01:33.072510 31367 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:33.073633 31342 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:33.073770 31342 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
uuid: "2f1d4089ea8140dfab33d71b320df9df"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.073873 31342 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:33.098554 31342 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:33.099395 31342 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:33.099632 31342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:33.107764 31342 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.125:34993
I20260812 08:01:33.107764 31453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.125:34993 every 8 connection(s)
I20260812 08:01:33.108875 31342 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
I20260812 08:01:33.111649 31454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:33.113729 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 31342
I20260812 08:01:33.113816 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance
I20260812 08:01:33.114447 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:43465
--webserver_interface=127.26.116.124
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:01:33.115109 31454 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:33.123761 31454 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:33.129745 31454 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:33.130519 31368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111)
W20260812 08:01:33.131419 31454 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:43465: Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111)
I20260812 08:01:33.155424 31339 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } attempt: 3
I20260812 08:01:33.160372 31339 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } has no permanent_uuid. Determining permanent_uuid...
W20260812 08:01:33.161795 31339 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:43465: Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111)
I20260812 08:01:33.180656 31454 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } attempt: 1
W20260812 08:01:33.182274 31454 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:43465: Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111)
I20260812 08:01:33.192975 31339 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } attempt: 1
W20260812 08:01:33.194792 31339 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:43465: Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111)
W20260812 08:01:33.229823 31458 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:33.230193 31458 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:33.230273 31458 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:33.236065 31458 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:33.236140 31458 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:33.236161 31458 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:33.236181 31458 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:33.240381 31458 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:43465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.116.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.31458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:33.241554 31458 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:33.242687 31458 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:33.248665 31473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:33.248658 31476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:33.248662 31474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:33.248821 31458 server_base.cc:1061] running on GCE node
I20260812 08:01:33.249503 31458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:33.250481 31458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:33.250474 31454 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } attempt: 2
I20260812 08:01:33.251665 31458 hybrid_clock.cc:648] HybridClock initialized: now 1786521693251645 us; error 43 us; skew 500 ppm
W20260812 08:01:33.251924 31454 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:43465: Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111)
I20260812 08:01:33.253468 31458 webserver.cc:533] Webserver started at http://127.26.116.124:33583/ using document root <none> and password file <none>
I20260812 08:01:33.254026 31458 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:33.254084 31458 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:33.254243 31458 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:33.255842 31458 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/instance:
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.256291 31458 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance:
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.259616 31458 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:33.261936 31485 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:33.262967 31458 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:33.263134 31458 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.263283 31458 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:33.270021 31339 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } attempt: 2
W20260812 08:01:33.271624 31339 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.26.116.124:43465: Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111)
I20260812 08:01:33.289350 31458 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:33.290056 31458 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:33.290218 31458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:33.298136 31566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.124:43465 every 8 connection(s)
I20260812 08:01:33.298148 31458 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.124:43465
I20260812 08:01:33.299312 31458 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
I20260812 08:01:33.302282 31567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:33.302769 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 31458
I20260812 08:01:33.302892 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance
I20260812 08:01:33.306854 31567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:33.315857 31567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:33.319909 31567 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } has no permanent_uuid. Determining permanent_uuid...
I20260812 08:01:33.325317 31567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Bootstrap starting.
I20260812 08:01:33.327494 31567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:33.328191 31567 log.cc:826] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:33.329810 31567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: No bootstrap required, opened a new log
I20260812 08:01:33.332867 31567 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.333017 31567 raft_consensus.cc:385] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:33.333051 31567 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e668bf917446e1a1f724f2782788aa, State: Initialized, Role: FOLLOWER
I20260812 08:01:33.333379 31567 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.333774 31582 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.333874 31582 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:33.334363 31567 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:01:33.339326 31601 catalog_manager.cc:1594] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:33.339411 31601 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:33.338333 31458 master_runner.cc:187] Error getting master registration for 127.26.116.126:44773: OK, instance_id { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" instance_seqno: 1786521692919071 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:33.340592 31458 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:33.343099 31454 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } attempt: 3
I20260812 08:01:33.349012 31454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Bootstrap starting.
I20260812 08:01:33.351608 31454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:33.352319 31454 log.cc:826] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:33.353888 31454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: No bootstrap required, opened a new log
I20260812 08:01:33.356767 31454 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.356937 31454 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:33.357018 31454 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f1d4089ea8140dfab33d71b320df9df, State: Initialized, Role: FOLLOWER
I20260812 08:01:33.357465 31454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.357946 31609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.358057 31609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:33.358601 31454 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: configured and running, proceeding with master startup.
W20260812 08:01:33.363765 31630 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:01:33.363901 31630 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:01:33.363116 31342 master_runner.cc:187] Error getting master registration for 127.26.116.126:44773: OK, instance_id { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" instance_seqno: 1786521692919071 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 08:01:33.365365 31342 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:01:33.366601 31609 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:33.366748 31609 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.367690 31609 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:33.368296 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:01:33.368563 31525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 0.
I20260812 08:01:33.368985 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:01:33.369230 31609 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:33.369302 31609 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:33.369344 31609 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:33.370421 31609 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.370785 31609 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 1 election: Requested vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:33.370823 31339 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } attempt: 3
I20260812 08:01:33.372830 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa"
I20260812 08:01:33.372946 31525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:33.374044 31525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 1.
I20260812 08:01:33.374643 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:01:33.376127 31609 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:33.376345 31609 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 1 LEADER]: Becoming Leader. State: Replica: 2f1d4089ea8140dfab33d71b320df9df, State: Running, Role: LEADER
I20260812 08:01:33.376643 31609 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.378234 31609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f1d4089ea8140dfab33d71b320df9df. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.378333 31609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:33.379643 31635 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:33.380612 31635 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:33.382899 31339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Bootstrap starting.
I20260812 08:01:33.385550 31339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:33.386430 31339 log.cc:826] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:33.389371 31339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: No bootstrap required, opened a new log
I20260812 08:01:33.390401 31525 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Refusing update from remote peer 2f1d4089ea8140dfab33d71b320df9df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:33.391074 31609 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:33.394908 31582 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f1d4089ea8140dfab33d71b320df9df. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.395038 31582 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:33.397593 31339 raft_consensus.cc:359] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.397960 31339 raft_consensus.cc:385] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:33.398171 31339 raft_consensus.cc:740] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Initialized, Role: FOLLOWER
I20260812 08:01:33.398998 31339 consensus_queue.cc:260] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:33.400462 31633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.400595 31633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:33.401610 31282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:01:33.401845 31582 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.401942 31582 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:33.401919 31281 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:33.402032 31286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:01:33.402336 31636 mvcc.cc:204] Tried to move back new op lower bound from 7317592856118943744 to 7317592856073568256. Current Snapshot: MvccSnapshot[applied={T|T < 7317592856118943744}]
I20260812 08:01:33.402709 31640 mvcc.cc:204] Tried to move back new op lower bound from 7317592856118943744 to 7317592856073568256. Current Snapshot: MvccSnapshot[applied={T|T < 7317592856118943744}]
I20260812 08:01:33.402907 31339 sys_catalog.cc:565] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:33.403389 31281 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 1 FOLLOWER]: Refusing update from remote peer 2f1d4089ea8140dfab33d71b320df9df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:01:33.404192 31609 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:33.406003 31635 catalog_manager.cc:1383] Generated new cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:01:33.406066 31635 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:33.409101 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.409217 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:33.409297 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f1d4089ea8140dfab33d71b320df9df. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.409343 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:33.409392 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.409437 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:01:33.415066 31252 tablet.cc:2406] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:33.418872 31609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:33.418998 31609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:33.420938 31635 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:33.421789 31669 mvcc.cc:204] Tried to move back new op lower bound from 7317592856118943744 to 7317592856073568256. Current Snapshot: MvccSnapshot[applied={T|T < 7317592856118943744}]
I20260812 08:01:33.422066 31635 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:33.438045 31666 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:01:33.438148 31666 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: loading cluster ID for follower catalog manager: success
I20260812 08:01:33.440609 31666 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: acquiring CA information for follower catalog manager: success
I20260812 08:01:33.441924 31666 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:33.442093 31635 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Generated new TSK 0
I20260812 08:01:33.442687 31635 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:33.451448 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.65:0
--local_ip_for_outbound_sockets=127.26.116.65
--webserver_interface=127.26.116.65
--webserver_port=0
--tserver_master_addrs=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 08:01:33.621810 31683 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:33.622150 31683 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:33.622252 31683 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:33.627352 31683 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:33.627563 31683 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.65
I20260812 08:01:33.633662 31683 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.116.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--never_fsync=true
--heap_profile_path=/tmp/kudu.31683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:33.635139 31683 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:33.636843 31683 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:33.645247 31703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:33.645948 31683 server_base.cc:1061] running on GCE node
W20260812 08:01:33.645677 31693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:33.645735 31696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:33.646766 31683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:33.647517 31683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:33.648728 31683 hybrid_clock.cc:648] HybridClock initialized: now 1786521693648688 us; error 52 us; skew 500 ppm
I20260812 08:01:33.651185 31683 webserver.cc:533] Webserver started at http://127.26.116.65:38329/ using document root <none> and password file <none>
I20260812 08:01:33.652072 31683 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:33.652161 31683 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:33.652400 31683 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:33.654803 31683 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/data/instance:
uuid: "e2b7a4d926554fb784ee7b1d94f86813"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.655596 31683 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/wal/instance:
uuid: "e2b7a4d926554fb784ee7b1d94f86813"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.661464 31683 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.002s
I20260812 08:01:33.665160 31711 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:33.666706 31683 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:33.666851 31683 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
uuid: "e2b7a4d926554fb784ee7b1d94f86813"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.666988 31683 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:33.691567 31683 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:33.692229 31683 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:33.692379 31683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:33.692947 31683 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:33.693961 31683 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:33.694010 31683 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:33.694051 31683 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:33.694067 31683 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:33.703473 31683 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.65:45579
I20260812 08:01:33.703495 31896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.65:45579 every 8 connection(s)
I20260812 08:01:33.704663 31683 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/data/info.pb
I20260812 08:01:33.710902 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 31683
I20260812 08:01:33.711036 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-0/wal/instance
I20260812 08:01:33.715049 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.66:0
--local_ip_for_outbound_sockets=127.26.116.66
--webserver_interface=127.26.116.66
--webserver_port=0
--tserver_master_addrs=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:33.721063 31903 heartbeater.cc:344] Connected to a master server at 127.26.116.125:34993
I20260812 08:01:33.721021 31897 heartbeater.cc:344] Connected to a master server at 127.26.116.124:43465
I20260812 08:01:33.721129 31899 heartbeater.cc:344] Connected to a master server at 127.26.116.126:44773
I20260812 08:01:33.721356 31899 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:33.721354 31903 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:33.721352 31897 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:33.722110 31899 heartbeater.cc:507] Master 127.26.116.126:44773 requested a full tablet report, sending...
I20260812 08:01:33.722090 31897 heartbeater.cc:507] Master 127.26.116.124:43465 requested a full tablet report, sending...
I20260812 08:01:33.722085 31903 heartbeater.cc:507] Master 127.26.116.125:34993 requested a full tablet report, sending...
I20260812 08:01:33.723788 31269 ts_manager.cc:194] Registered new tserver with Master: e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579)
I20260812 08:01:33.723806 31391 ts_manager.cc:194] Registered new tserver with Master: e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579)
I20260812 08:01:33.723806 31511 ts_manager.cc:194] Registered new tserver with Master: e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579)
I20260812 08:01:33.725194 31391 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.65:54493
W20260812 08:01:33.827260 31912 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:33.827512 31912 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:33.827612 31912 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:33.831043 31912 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:33.831199 31912 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.66
I20260812 08:01:33.835302 31912 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.116.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--never_fsync=true
--heap_profile_path=/tmp/kudu.31912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:33.836560 31912 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:33.837888 31912 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:33.844399 31919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:33.844401 31918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:33.844401 31921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:33.845072 31912 server_base.cc:1061] running on GCE node
I20260812 08:01:33.845474 31912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:33.846047 31912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:33.847250 31912 hybrid_clock.cc:648] HybridClock initialized: now 1786521693847229 us; error 29 us; skew 500 ppm
I20260812 08:01:33.849136 31912 webserver.cc:533] Webserver started at http://127.26.116.66:37607/ using document root <none> and password file <none>
I20260812 08:01:33.849766 31912 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:33.849828 31912 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:33.850109 31912 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:33.851902 31912 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/data/instance:
uuid: "2ea7421a364e447a932edf99c67546c5"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.852442 31912 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/wal/instance:
uuid: "2ea7421a364e447a932edf99c67546c5"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.855999 31912 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:33.858510 31931 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:33.859628 31912 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:33.859771 31912 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
uuid: "2ea7421a364e447a932edf99c67546c5"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:33.859890 31912 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:33.878662 31912 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:33.879539 31912 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:33.879751 31912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:33.880374 31912 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:33.881531 31912 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:33.881608 31912 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:33.881660 31912 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:33.881685 31912 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:33.892033 31912 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.66:42831
I20260812 08:01:33.892119 32138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.66:42831 every 8 connection(s)
I20260812 08:01:33.893149 31912 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/data/info.pb
I20260812 08:01:33.902153 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 31912
I20260812 08:01:33.902279 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-1/wal/instance
I20260812 08:01:33.903416 32141 heartbeater.cc:344] Connected to a master server at 127.26.116.126:44773
I20260812 08:01:33.903681 32141 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:33.903929 32139 heartbeater.cc:344] Connected to a master server at 127.26.116.124:43465
I20260812 08:01:33.904012 32139 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:33.904330 32141 heartbeater.cc:507] Master 127.26.116.126:44773 requested a full tablet report, sending...
I20260812 08:01:33.904327 32139 heartbeater.cc:507] Master 127.26.116.124:43465 requested a full tablet report, sending...
I20260812 08:01:33.904881 32145 heartbeater.cc:344] Connected to a master server at 127.26.116.125:34993
I20260812 08:01:33.904965 32145 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:33.905157 32145 heartbeater.cc:507] Master 127.26.116.125:34993 requested a full tablet report, sending...
I20260812 08:01:33.905536 31510 ts_manager.cc:194] Registered new tserver with Master: 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:01:33.905804 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.116.67:0
--local_ip_for_outbound_sockets=127.26.116.67
--webserver_interface=127.26.116.67
--webserver_port=0
--tserver_master_addrs=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 08:01:33.906266 31269 ts_manager.cc:194] Registered new tserver with Master: 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:01:33.906266 31391 ts_manager.cc:194] Registered new tserver with Master: 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:01:33.906971 31391 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.66:43245
W20260812 08:01:34.020552 32153 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:34.021297 32153 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:34.021591 32153 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:34.025456 32153 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:34.025627 32153 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.116.67
I20260812 08:01:34.029866 32153 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.116.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.116.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--never_fsync=true
--heap_profile_path=/tmp/kudu.32153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.116.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:34.031111 32153 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:34.032431 32153 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:34.039422 32165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:34.039423 32162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:34.039825 32169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:34.039952 32153 server_base.cc:1061] running on GCE node
I20260812 08:01:34.040323 32153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:34.040865 32153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:34.042104 32153 hybrid_clock.cc:648] HybridClock initialized: now 1786521694042078 us; error 35 us; skew 500 ppm
I20260812 08:01:34.044224 32153 webserver.cc:533] Webserver started at http://127.26.116.67:43041/ using document root <none> and password file <none>
I20260812 08:01:34.044935 32153 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:34.045006 32153 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:34.045182 32153 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:34.046800 32153 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/data/instance:
uuid: "3785b50895f74e12b7723aa0162c02c5"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-92m1"
I20260812 08:01:34.047379 32153 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/instance:
uuid: "3785b50895f74e12b7723aa0162c02c5"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-92m1"
I20260812 08:01:34.051080 32153 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:34.053654 32178 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.054768 32153 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:34.054875 32153 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
uuid: "3785b50895f74e12b7723aa0162c02c5"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-92m1"
I20260812 08:01:34.054961 32153 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:34.071343 32153 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:34.072034 32153 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:34.072189 32153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:34.072820 32153 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:34.074170 32153 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:34.074221 32153 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.074263 32153 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:34.074278 32153 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.084776 32153 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.67:39239
I20260812 08:01:34.084805 32382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.67:39239 every 8 connection(s)
I20260812 08:01:34.085829 32153 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/data/info.pb
I20260812 08:01:34.093753 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 32153
I20260812 08:01:34.093904 27089 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/ts-2/wal/instance
I20260812 08:01:34.095489 32389 heartbeater.cc:344] Connected to a master server at 127.26.116.126:44773
I20260812 08:01:34.095749 32389 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:34.095757 32390 heartbeater.cc:344] Connected to a master server at 127.26.116.125:34993
I20260812 08:01:34.095894 32390 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:34.096444 32390 heartbeater.cc:507] Master 127.26.116.125:34993 requested a full tablet report, sending...
I20260812 08:01:34.096448 32389 heartbeater.cc:507] Master 127.26.116.126:44773 requested a full tablet report, sending...
I20260812 08:01:34.097070 32383 heartbeater.cc:344] Connected to a master server at 127.26.116.124:43465
I20260812 08:01:34.097159 32383 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:34.097375 32383 heartbeater.cc:507] Master 127.26.116.124:43465 requested a full tablet report, sending...
I20260812 08:01:34.097723 31391 ts_manager.cc:194] Registered new tserver with Master: 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:01:34.098275 31511 ts_manager.cc:194] Registered new tserver with Master: 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:01:34.098425 31391 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.26.116.67:43977
I20260812 08:01:34.098976 31269 ts_manager.cc:194] Registered new tserver with Master: 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:01:34.114225 27089 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:34.124373 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 31220
W20260812 08:01:34.226260 31899 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:44773 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.116.126:44773: connect: Connection refused (error 111)
I20260812 08:01:34.226960 31903 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
I20260812 08:01:34.261950 32414 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:34.262238 32414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260812 08:01:34.264202 32414 dir_manager.cc:729] IO error: Could not lock instance file. Make sure that Kudu is not already running and you are not trying to run Kudu with a different user than before: lock /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/data/block_manager_instance: Resource temporarily unavailable (error 11)
W20260812 08:01:34.264282 32414 dir_manager.cc:730] Proceeding without lock
I20260812 08:01:34.267112 32414 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:34.267356 32414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:01:34.280231 27089 master_failover-itest.cc:413] tablet: 00000000000000000000000000000000, peers: 815fd2931e984818b4644ca5c9729cd4 2f1d4089ea8140dfab33d71b320df9df b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:34.340704 31601 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:01:34.340794 31601 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: loading cluster ID for follower catalog manager: success
I20260812 08:01:34.342420 31601 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: acquiring CA information for follower catalog manager: success
I20260812 08:01:34.343483 31601 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:34.397437 32426 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:34.397701 32426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:34.405135 32426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/instance:
uuid: "815fd2931e984818b4644ca5c9729cd4"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-92m1"
I20260812 08:01:34.408581 32426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal/instance:
uuid: "815fd2931e984818b4644ca5c9729cd4"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-92m1"
W20260812 08:01:34.408615 32141 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:44773 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.116.126:44773: connect: Connection refused (error 111)
I20260812 08:01:34.408784 32145 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
I20260812 08:01:34.418632 32426 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.004s	sys 0.000s
I20260812 08:01:34.430823 32437 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:01:34.431039 32437 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:34.432255 32437 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:01:34.433081 31408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
W20260812 08:01:34.433202 31487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.126:44773: connect: Connection refused (error 111)
W20260812 08:01:34.433087 31370 consensus_peers.cc:597] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df -> Peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Couldn't send request to peer 815fd2931e984818b4644ca5c9729cd4. Status: Network error: Client connection negotiation failed: client connection to 127.26.116.126:44773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:01:34.434370 31487 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Network error: Client connection negotiation failed: client connection to 127.26.116.126:44773: connect: Connection refused (error 111)
I20260812 08:01:34.434451 31487 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4
I20260812 08:01:34.434743 32437 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:34.546383 32447 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:34.546639 32447 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:34.551509 32447 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:01:34.553781 32462 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.554662 32447 fs_report.cc:389] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:34.555100 32447 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:34.555173 32447 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
uuid: "815fd2931e984818b4644ca5c9729cd4"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-92m1"
W20260812 08:01:34.561225 32467 tool_action_local_replica.cc:343] Start to copy tablet 00000000000000000000000000000000
I20260812 08:01:34.562201 32467 tablet_copy_client.cc:323] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: tablet copy: Beginning tablet copy session from remote peer at address 127.26.116.124:43465
I20260812 08:01:34.570961 31542 tablet_copy_service.cc:140] P b5e668bf917446e1a1f724f2782788aa: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 815fd2931e984818b4644ca5c9729cd4 ({username='slave'} at 127.0.0.1:49808)
I20260812 08:01:34.571103 31542 tablet_copy_service.cc:161] P b5e668bf917446e1a1f724f2782788aa: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 815fd2931e984818b4644ca5c9729cd4 at {username='slave'} at 127.0.0.1:49808: session id = 815fd2931e984818b4644ca5c9729cd4-00000000000000000000000000000000
I20260812 08:01:34.572324 31542 tablet_copy_source_session.cc:215] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:01:34.575881 32467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 08:01:34.584594 32467 tablet_copy_client.cc:806] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: tablet copy: Starting download of 0 data blocks...
I20260812 08:01:34.586179 32467 tablet_copy_client.cc:670] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: tablet copy: Starting download of 1 WAL segments...
I20260812 08:01:34.590616 32467 tablet_copy_client.cc:538] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:01:34.595499 32467 tool_action_local_replica.cc:343] Tablet 00000000000000000000000000000000 copy succeed.
I20260812 08:01:34.595593 32467 tool_action_local_replica.cc:343] 1/1 tablets, 1844 bytes copied, include 0 failed tablets.
I20260812 08:01:34.596342 31542 tablet_copy_service.cc:342] P b5e668bf917446e1a1f724f2782788aa: Request end of tablet copy session 815fd2931e984818b4644ca5c9729cd4-00000000000000000000000000000000 received from {username='slave'} at 127.0.0.1:49808
I20260812 08:01:34.596451 31542 tablet_copy_service.cc:434] P b5e668bf917446e1a1f724f2782788aa: ending tablet copy session 815fd2931e984818b4644ca5c9729cd4-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 815fd2931e984818b4644ca5c9729cd4
I20260812 08:01:34.600412 32390 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
W20260812 08:01:34.600533 32389 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:44773 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.116.126:44773: connect: Connection refused (error 111)
I20260812 08:01:34.611130 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:44773
--webserver_interface=127.26.116.126
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 08:01:34.731662 32479 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:34.731935 32479 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:34.732084 32479 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:34.736035 32479 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:34.736105 32479 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:34.736159 32479 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:34.736212 32479 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:34.740922 32479 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.126:44773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.116.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.32479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:34.742144 32479 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:34.743444 32479 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:34.749697 32494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:34.749758 32489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:34.749792 32491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:34.749960 32479 server_base.cc:1061] running on GCE node
I20260812 08:01:34.750496 32479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:34.751461 32479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:34.752688 32479 hybrid_clock.cc:648] HybridClock initialized: now 1786521694752652 us; error 54 us; skew 500 ppm
I20260812 08:01:34.754966 32479 webserver.cc:533] Webserver started at http://127.26.116.126:34031/ using document root <none> and password file <none>
I20260812 08:01:34.755842 32479 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:34.755957 32479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:34.761005 32479 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:01:34.764075 32505 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:34.765728 32479 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:01:34.765911 32479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
uuid: "815fd2931e984818b4644ca5c9729cd4"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-92m1"
I20260812 08:01:34.766382 32479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:34.781469 32479 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:34.782259 32479 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:34.782480 32479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:34.790925 32610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.126:44773 every 8 connection(s)
I20260812 08:01:34.790922 32479 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.126:44773
I20260812 08:01:34.792279 32479 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/info.pb
I20260812 08:01:34.796692 32616 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:01:34.798538 32616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Bootstrap starting.
I20260812 08:01:34.798667 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 32479
I20260812 08:01:34.800189 31391 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56392:
name: "default.table_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:34.801296 31391 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:34.805011 32616 log.cc:826] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:34.813987 32616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:01:34.814429 32616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Bootstrap complete.
I20260812 08:01:34.818845 32616 raft_consensus.cc:359] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:34.819361 32616 raft_consensus.cc:740] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Initialized, Role: FOLLOWER
I20260812 08:01:34.820029 32616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:34.821439 32616 sys_catalog.cc:565] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:34.824105 32025 tablet_service.cc:1511] Processing CreateTablet for tablet fdbfffc974504dd0a6b0d397b66a6bbf (DEFAULT_TABLE table=default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:34.825217 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbfffc974504dd0a6b0d397b66a6bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:34.825628 31792 tablet_service.cc:1511] Processing CreateTablet for tablet fdbfffc974504dd0a6b0d397b66a6bbf (DEFAULT_TABLE table=default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:34.826604 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbfffc974504dd0a6b0d397b66a6bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:34.828670 32646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:34.828819 32646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:34.829237 32659 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:01:34.829293 32659 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: loading cluster ID for follower catalog manager: success
I20260812 08:01:34.831558 32272 tablet_service.cc:1511] Processing CreateTablet for tablet fdbfffc974504dd0a6b0d397b66a6bbf (DEFAULT_TABLE table=default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:34.832787 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbfffc974504dd0a6b0d397b66a6bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:34.833149 32659 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: acquiring CA information for follower catalog manager: success
I20260812 08:01:34.834213 32667 tablet_bootstrap.cc:492] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:01:34.834663 32659 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:34.837116 32667 tablet_bootstrap.cc:654] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:34.838620 32667 log.cc:826] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:34.841197 32667 tablet_bootstrap.cc:492] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:01:34.841486 32667 ts_tablet_manager.cc:1403] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.008s	user 0.000s	sys 0.005s
I20260812 08:01:34.846103 32667 raft_consensus.cc:359] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:34.846393 32667 raft_consensus.cc:385] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:34.846463 32667 raft_consensus.cc:740] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:01:34.847090 32674 tablet_bootstrap.cc:492] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:01:34.847081 32667 consensus_queue.cc:260] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:34.848304 32667 ts_tablet_manager.cc:1434] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260812 08:01:34.850665 32674 tablet_bootstrap.cc:654] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:34.851845 32674 log.cc:826] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:34.856189 32669 tablet_bootstrap.cc:492] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:01:34.857975 31899 heartbeater.cc:344] Connected to a master server at 127.26.116.126:44773
I20260812 08:01:34.859841 32669 tablet_bootstrap.cc:654] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:34.859838 32541 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" instance_seqno: 1786521693700776) as {username='slave'} at 127.26.116.65:39431; Asking this server to re-register.
I20260812 08:01:34.860706 32674 tablet_bootstrap.cc:492] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:01:34.860937 32669 log.cc:826] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:34.861050 31899 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:34.861001 32674 ts_tablet_manager.cc:1403] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.000s
I20260812 08:01:34.862253 32541 ts_manager.cc:194] Registered new tserver with Master: e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579)
I20260812 08:01:34.864706 32674 raft_consensus.cc:359] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:34.864996 32674 raft_consensus.cc:385] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:34.865114 32674 raft_consensus.cc:740] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:01:34.865798 32674 consensus_queue.cc:260] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:34.866334 32669 tablet_bootstrap.cc:492] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:01:34.866920 32674 ts_tablet_manager.cc:1434] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:01:34.867599 32669 ts_tablet_manager.cc:1403] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.000s
I20260812 08:01:34.872961 32669 raft_consensus.cc:359] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:34.873229 32669 raft_consensus.cc:385] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:34.873287 32669 raft_consensus.cc:740] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:01:34.873917 32669 consensus_queue.cc:260] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:34.874890 32669 ts_tablet_manager.cc:1434] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 08:01:34.875094 32389 heartbeater.cc:344] Connected to a master server at 127.26.116.126:44773
I20260812 08:01:34.878140 32541 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" instance_seqno: 1786521694081552) as {username='slave'} at 127.26.116.67:60139; Asking this server to re-register.
I20260812 08:01:34.878568 32389 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:34.879459 32541 ts_manager.cc:194] Registered new tserver with Master: 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:01:34.880365 32141 heartbeater.cc:344] Connected to a master server at 127.26.116.126:44773
I20260812 08:01:34.881147 32541 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2ea7421a364e447a932edf99c67546c5" instance_seqno: 1786521693889371) as {username='slave'} at 127.26.116.66:59697; Asking this server to re-register.
I20260812 08:01:34.881558 32141 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:34.882360 32541 ts_manager.cc:194] Registered new tserver with Master: 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:01:34.895351 32675 raft_consensus.cc:493] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:34.895591 32675 raft_consensus.cc:515] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
W20260812 08:01:34.896020 32147 tablet.cc:2406] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:01:34.896955 32675 leader_election.cc:290] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:01:34.901661 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbfffc974504dd0a6b0d397b66a6bbf" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5" is_pre_election: true
I20260812 08:01:34.902082 32059 raft_consensus.cc:2468] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:01:34.902248 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbfffc974504dd0a6b0d397b66a6bbf" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:01:34.902478 32310 raft_consensus.cc:2468] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:01:34.902635 31715 leader_election.cc:304] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:01:34.902912 32675 raft_consensus.cc:2804] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:34.902976 32675 raft_consensus.cc:493] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:34.903018 32675 raft_consensus.cc:3060] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:34.904171 32675 raft_consensus.cc:515] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:34.904600 32675 leader_election.cc:290] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Requested vote from peers 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:01:34.904999 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbfffc974504dd0a6b0d397b66a6bbf" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:01:34.905041 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbfffc974504dd0a6b0d397b66a6bbf" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5"
I20260812 08:01:34.905160 32059 raft_consensus.cc:3060] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:34.905153 32310 raft_consensus.cc:3060] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:34.906123 32310 raft_consensus.cc:2468] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:01:34.906244 32059 raft_consensus.cc:2468] T fdbfffc974504dd0a6b0d397b66a6bbf P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:01:34.906484 31712 leader_election.cc:304] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:01:34.906682 32675 raft_consensus.cc:2804] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:34.906973 32675 raft_consensus.cc:697] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [term 1 LEADER]: Becoming Leader. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Running, Role: LEADER
I20260812 08:01:34.907349 32675 consensus_queue.cc:237] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:34.912505 31391 catalog_manager.cc:5719] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65). New cstate: current_term: 1 leader_uuid: "e2b7a4d926554fb784ee7b1d94f86813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } }
I20260812 08:01:34.920521 32624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:34.920692 32624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:34.928169 32646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f1d4089ea8140dfab33d71b320df9df. Latest consensus state: current_term: 1 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:34.928318 32646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:01:34.951305 31756 tablet_service.cc:3018] Rejecting scan request for tablet fdbfffc974504dd0a6b0d397b66a6bbf: Uninitialized: clean time has not yet been initialized
W20260812 08:01:34.956980 31905 tablet.cc:2406] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:35.088019 32392 tablet.cc:2406] T fdbfffc974504dd0a6b0d397b66a6bbf P 3785b50895f74e12b7723aa0162c02c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:35.153781 31756 tablet_service.cc:3018] Rejecting scan request for tablet fdbfffc974504dd0a6b0d397b66a6bbf: Uninitialized: clean time has not yet been initialized
I20260812 08:01:35.344537 32675 consensus_queue.cc:1048] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:35.352809 32675 consensus_queue.cc:1048] T fdbfffc974504dd0a6b0d397b66a6bbf P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:35.417882 32722 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:01:35.418040 32722 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:35.418598 32722 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:01:35.419521 31408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:35.423343 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:01:35.424036 31487 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4
I20260812 08:01:35.424226 32722 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:35.425196 32646 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:01:35.425350 32646 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:35.426532 32646 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:35.426946 31408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:35.426998 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:01:35.427114 31525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 1.
I20260812 08:01:35.427588 32506 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df
I20260812 08:01:35.427868 32646 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:35.427954 32646 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:01:35.428025 32646 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:35.429778 32646 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:35.430208 32646 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 2 election: Requested vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:35.430536 31408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:01:35.430634 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa"
I20260812 08:01:35.430737 31525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:35.431653 31525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 2.
I20260812 08:01:35.431959 32506 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df
I20260812 08:01:35.432126 32646 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:01:35.432296 32646 raft_consensus.cc:697] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 2 LEADER]: Becoming Leader. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Running, Role: LEADER
I20260812 08:01:35.432583 32646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:35.433910 32725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 2 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:35.434109 32725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:35.434600 32729 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:35.434754 31525 raft_consensus.cc:1240] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 2 FOLLOWER]: Rejecting Update request from peer 2f1d4089ea8140dfab33d71b320df9df for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:35.435313 32728 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 }, Status: INVALID_TERM, Last received: 1.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:35.435616 32728 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:01:35.435681 32728 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f1d4089ea8140dfab33d71b320df9df, State: Running, Role: LEADER
I20260812 08:01:35.435909 32728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:35.436254 32728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:35.436774 32729 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:01:35.437897 32729 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:01:35.438046 32729 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:35.438457 32729 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:01:35.438503 32729 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:35.439045 32729 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:35.439500 32729 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Loaded TSK: 0
I20260812 08:01:35.440124 32729 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 08:01:35.558300 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.615s	user 0.002s	sys 0.000s
W20260812 08:01:35.570822 32399 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.125:34993)
I20260812 08:01:35.820851 31630 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:01:35.865943 32728 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:35.866066 32728 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:35.866566 32728 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:35.866972 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:01:35.867163 31525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 2.
I20260812 08:01:35.867486 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:01:35.867749 32728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:01:35.867806 32728 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:35.867853 32728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:35.868726 32728 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:35.869158 32728 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 3 election: Requested vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:35.869535 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa"
I20260812 08:01:35.869674 31525 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:35.870522 31525 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 3.
I20260812 08:01:35.870826 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:01:35.871037 32728 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:01:35.871161 32728 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 3 LEADER]: Becoming Leader. State: Replica: 2f1d4089ea8140dfab33d71b320df9df, State: Running, Role: LEADER
I20260812 08:01:35.871343 32728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:35.872016 32730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f1d4089ea8140dfab33d71b320df9df. Latest consensus state: current_term: 3 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:35.872128 32730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:35.872435 32740 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:35.873674 32740 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:01:35.874480 32740 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:01:35.874725 32740 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:35.875258 32740 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:01:35.875311 32740 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:35.876035 32740 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:35.876451 32740 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Loaded TSK: 0
I20260812 08:01:35.876861 32740 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:36.426434 31525 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Refusing update from remote peer 2f1d4089ea8140dfab33d71b320df9df: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
I20260812 08:01:36.426955 32730 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:36.428314 32750 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f1d4089ea8140dfab33d71b320df9df. Latest consensus state: current_term: 3 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:36.428442 32750 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:36.429540 32754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:36.429662 32754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:36.429981 32750 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:36.430097 32750 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:36.469564 31903 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
I20260812 08:01:36.859892 32145 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
I20260812 08:01:36.862462 32390 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
W20260812 08:01:36.975222 31370 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.552s (SENT)
W20260812 08:01:37.002800 31370 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.567s (SENT)
I20260812 08:01:37.780738 32761 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:01:37.780884 32761 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:37.781394 32761 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:01:37.781977 31408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
W20260812 08:01:38.596107 32736 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:01:35.571127 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.26.116.126:44773 (local address 127.0.0.1:51614)
0812 08:01:35.571392 (+   265us) negotiation.cc:107] Waiting for socket to connect
0812 08:01:35.571408 (+    16us) client_negotiation.cc:175] Beginning negotiation
0812 08:01:35.571504 (+    96us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 08:01:38.595513 (+3024009us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.26.116.126:44773: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":93,"threads_started":1}
I20260812 08:01:38.603983 31391 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56392:
name: "default.table_0_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:38.604521 31391 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:38.613801 31792 tablet_service.cc:1511] Processing CreateTablet for tablet c95b91c169244ddc9740b5b3b2364db5 (DEFAULT_TABLE table=default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:38.613987 32025 tablet_service.cc:1511] Processing CreateTablet for tablet c95b91c169244ddc9740b5b3b2364db5 (DEFAULT_TABLE table=default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:38.614187 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95b91c169244ddc9740b5b3b2364db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:38.614179 32272 tablet_service.cc:1511] Processing CreateTablet for tablet c95b91c169244ddc9740b5b3b2364db5 (DEFAULT_TABLE table=default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:38.614334 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95b91c169244ddc9740b5b3b2364db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:38.614459 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95b91c169244ddc9740b5b3b2364db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:38.616750   310 tablet_bootstrap.cc:492] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:01:38.616844   309 tablet_bootstrap.cc:492] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:01:38.616937   308 tablet_bootstrap.cc:492] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:01:38.617821   310 tablet_bootstrap.cc:654] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:38.617861   309 tablet_bootstrap.cc:654] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:38.617864   308 tablet_bootstrap.cc:654] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:38.619026   308 tablet_bootstrap.cc:492] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:01:38.619036   310 tablet_bootstrap.cc:492] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:01:38.619107   308 ts_tablet_manager.cc:1403] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:38.619148   310 ts_tablet_manager.cc:1403] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:38.619590   309 tablet_bootstrap.cc:492] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:01:38.619666   309 ts_tablet_manager.cc:1403] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:38.619784   310 raft_consensus.cc:359] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.619915   310 raft_consensus.cc:385] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:38.619956   310 raft_consensus.cc:740] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:01:38.620098   310 consensus_queue.cc:260] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.620262   309 raft_consensus.cc:359] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.620386   309 raft_consensus.cc:385] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:38.620437   309 raft_consensus.cc:740] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:01:38.620486   310 ts_tablet_manager.cc:1434] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:01:38.620596   309 consensus_queue.cc:260] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.620893   309 ts_tablet_manager.cc:1434] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20260812 08:01:38.621963   308 raft_consensus.cc:359] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.622081   308 raft_consensus.cc:385] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:38.622129   308 raft_consensus.cc:740] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:01:38.622280   308 consensus_queue.cc:260] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.622627   308 ts_tablet_manager.cc:1434] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:38.665588   315 raft_consensus.cc:493] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:38.665719   315 raft_consensus.cc:515] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.666786   315 leader_election.cc:290] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:01:38.670841 31830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95b91c169244ddc9740b5b3b2364db5" candidate_uuid: "3785b50895f74e12b7723aa0162c02c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813" is_pre_election: true
I20260812 08:01:38.670859 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95b91c169244ddc9740b5b3b2364db5" candidate_uuid: "3785b50895f74e12b7723aa0162c02c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5" is_pre_election: true
I20260812 08:01:38.671015 32059 raft_consensus.cc:2468] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3785b50895f74e12b7723aa0162c02c5 in term 0.
I20260812 08:01:38.671062 31830 raft_consensus.cc:2468] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3785b50895f74e12b7723aa0162c02c5 in term 0.
I20260812 08:01:38.671497 32182 leader_election.cc:304] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, 3785b50895f74e12b7723aa0162c02c5; no voters: 
I20260812 08:01:38.671783   315 raft_consensus.cc:2804] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:38.671849   315 raft_consensus.cc:493] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:38.671876   315 raft_consensus.cc:3060] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:38.673295   315 raft_consensus.cc:515] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.673696   315 leader_election.cc:290] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [CANDIDATE]: Term 1 election: Requested vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:01:38.674041 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95b91c169244ddc9740b5b3b2364db5" candidate_uuid: "3785b50895f74e12b7723aa0162c02c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5"
I20260812 08:01:38.674041 31830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95b91c169244ddc9740b5b3b2364db5" candidate_uuid: "3785b50895f74e12b7723aa0162c02c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813"
I20260812 08:01:38.674165 31830 raft_consensus.cc:3060] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:38.674165 32059 raft_consensus.cc:3060] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:38.675127 31830 raft_consensus.cc:2468] T c95b91c169244ddc9740b5b3b2364db5 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3785b50895f74e12b7723aa0162c02c5 in term 1.
I20260812 08:01:38.675125 32059 raft_consensus.cc:2468] T c95b91c169244ddc9740b5b3b2364db5 P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3785b50895f74e12b7723aa0162c02c5 in term 1.
I20260812 08:01:38.675436 32182 leader_election.cc:304] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:01:38.675577   315 raft_consensus.cc:2804] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:38.675772   315 raft_consensus.cc:697] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [term 1 LEADER]: Becoming Leader. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Running, Role: LEADER
I20260812 08:01:38.676093   315 consensus_queue.cc:237] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:38.678485 31388 catalog_manager.cc:5719] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67). New cstate: current_term: 1 leader_uuid: "3785b50895f74e12b7723aa0162c02c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: HEALTHY } } }
W20260812 08:01:38.700701 32232 tablet_service.cc:3018] Rejecting scan request for tablet c95b91c169244ddc9740b5b3b2364db5: Uninitialized: clean time has not yet been initialized
W20260812 08:01:38.902839 32232 tablet_service.cc:3018] Rejecting scan request for tablet c95b91c169244ddc9740b5b3b2364db5: Uninitialized: clean time has not yet been initialized
W20260812 08:01:39.182682 31487 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.700s (SENT)
I20260812 08:01:39.182807 31487 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4
I20260812 08:01:39.183111   336 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 08:01:39.271669   337 consensus_queue.cc:1048] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:39.276805   342 consensus_queue.cc:1048] T c95b91c169244ddc9740b5b3b2364db5 P 3785b50895f74e12b7723aa0162c02c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:01:39.307660 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.614s	user 0.002s	sys 0.000s
W20260812 08:01:39.310796   352 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:01:39.309527 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:51614 (local address 127.26.116.126:44773)
0812 08:01:39.309971 (+   444us) server_negotiation.cc:207] Beginning negotiation
0812 08:01:39.309976 (+     5us) server_negotiation.cc:400] Waiting for connection header
0812 08:01:39.309991 (+    15us) server_negotiation.cc:408] Connection header received
0812 08:01:39.310068 (+    77us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 08:01:39.310071 (+     3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 08:01:39.310166 (+    95us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 08:01:39.310336 (+   170us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51614: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":98,"threads_started":1}
W20260812 08:01:39.311792 32523 catalog_manager.cc:5552] Ignoring report from unknown tablet c95b91c169244ddc9740b5b3b2364db5
I20260812 08:01:39.315128 32552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:01:39.315137 32547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:01:39.316334 32535 catalog_manager.cc:5552] Ignoring report from unknown tablet c95b91c169244ddc9740b5b3b2364db5
I20260812 08:01:39.316344 31899 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:01:39.316628 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:01:39.316857 32553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:01:39.317050 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:01:39.317234 32389 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:01:39.317412 32556 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 08:01:39.317471 32556 raft_consensus.cc:740] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Running, Role: LEADER
I20260812 08:01:39.317652 32556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.8, Last appended by leader: 8, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:39.317798 31525 raft_consensus.cc:1240] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Rejecting Update request from peer 815fd2931e984818b4644ca5c9729cd4 for earlier term 2. Current term is 3. Ops: []
I20260812 08:01:39.317878 32556 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:39.318411 32141 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:01:39.319142 32556 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 3 FOLLOWER]: Refusing update from remote peer 2f1d4089ea8140dfab33d71b320df9df: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 3 index: 8. (term mismatch)
I20260812 08:01:39.319239 32556 pending_rounds.cc:85] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Aborting all ops after (but not including) 7
I20260812 08:01:39.319300 32556 pending_rounds.cc:107] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Aborting uncommitted NO_OP operation due to leader change: 2.8
I20260812 08:01:39.319353 32556 raft_consensus.cc:2889] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 08:01:39.319660 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:01:39.320612 32558 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 3.
I20260812 08:01:39.782785   354 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:01:39.782940   354 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:39.783450   354 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:01:39.783993 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 11 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:01:39.784190 32555 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 3.
I20260812 08:01:39.784490 31487 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:01:39.784662   354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:01:39.784726   354 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:01:39.784756   354 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:39.785630   354 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:39.785975   354 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 election: Requested vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:01:39.786275 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 11 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:01:39.786422 32555 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:39.787370 32555 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 4.
I20260812 08:01:39.787693 31487 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:01:39.787873   354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 4 FOLLOWER]: Leader election won for term 4
I20260812 08:01:39.788076   354 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 4 LEADER]: Becoming Leader. State: Replica: b5e668bf917446e1a1f724f2782788aa, State: Running, Role: LEADER
I20260812 08:01:39.788381   354 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 3.11, Last appended by leader: 11, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:39.789701   355 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e668bf917446e1a1f724f2782788aa. Latest consensus state: current_term: 4 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:39.789808   355 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:39.790096   357 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:39.791487   357 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]
I20260812 08:01:39.791734   357 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:01:39.792563   357 tablet_loader.cc:96] loaded metadata for tablet c95b91c169244ddc9740b5b3b2364db5 (table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352])
I20260812 08:01:39.792762   357 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:01:39.792845   357 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:39.793174   357 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:01:39.793216   357 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:39.793689   357 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:39.794027   357 catalog_manager.cc:6103] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Loaded TSK: 0
I20260812 08:01:39.794549   357 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:40.255640 32555 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Refusing update from remote peer b5e668bf917446e1a1f724f2782788aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 4 index: 12. (index mismatch)
I20260812 08:01:40.256279   355 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:01:40.258874   367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:40.258973   362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e668bf917446e1a1f724f2782788aa. Latest consensus state: current_term: 4 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:40.259085   367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:40.259117   362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:40.259881   363 mvcc.cc:204] Tried to move back new op lower bound from 7317592877790842880 to 7317592866290671616. Current Snapshot: MvccSnapshot[applied={T|T < 7317592877790842880}]
I20260812 08:01:40.260004   355 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:40.260129   355 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:40.260717   362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:40.260820   362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:40.315312 32383 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
W20260812 08:01:40.548725 31487 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.761s (SENT) [suppressed 1 similar messages]
I20260812 08:01:40.761247   375 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:01:40.761407   375 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:40.761981   375 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:40.762490 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:01:40.780611 31897 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
I20260812 08:01:40.782800 32139 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
W20260812 08:01:41.311343 31487 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.761s (SENT)
W20260812 08:01:41.421566 32507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.658s (SENT)
W20260812 08:01:41.758599 31487 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.985s (SENT)
W20260812 08:01:42.081415 32507 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.658s (SENT)
I20260812 08:01:42.081539 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:42.081902   380 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 08:01:43.118497   381 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:01:43.118646   381 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:43.119182   381 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:43.119690 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:01:44.152485 32507 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.515s (SENT)
I20260812 08:01:44.152611 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:44.152966   385 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 08:01:45.560717   386 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:01:45.560865   386 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:45.561288   386 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:45.561697 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:01:46.745711 32507 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.591s (SENT)
I20260812 08:01:46.745843 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:46.746233   390 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 08:01:48.655246   391 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:01:48.655395   391 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:48.655978   391 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:48.656507 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:01:49.156467 32507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.500s (SENT) [suppressed 2 similar messages]
W20260812 08:01:49.321162 32399 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.125:34993)
I20260812 08:01:49.324198 31509 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52510:
name: "default.table_0_1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:49.325320 31509 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0_1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:49.341473 32025 tablet_service.cc:1511] Processing CreateTablet for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (DEFAULT_TABLE table=default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:49.341437 32272 tablet_service.cc:1511] Processing CreateTablet for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (DEFAULT_TABLE table=default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:49.341892 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c24d7cc55a4b4d966ab1a77c67b1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:49.341892 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c24d7cc55a4b4d966ab1a77c67b1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:49.343472 31792 tablet_service.cc:1511] Processing CreateTablet for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (DEFAULT_TABLE table=default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:49.343807 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c24d7cc55a4b4d966ab1a77c67b1da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:49.344692   419 tablet_bootstrap.cc:492] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:01:49.346273   421 tablet_bootstrap.cc:492] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:01:49.346611   420 tablet_bootstrap.cc:492] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:01:49.346678   419 tablet_bootstrap.cc:654] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:49.347436   421 tablet_bootstrap.cc:654] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:49.347828   420 tablet_bootstrap.cc:654] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:49.349149   420 tablet_bootstrap.cc:492] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:01:49.349291   420 ts_tablet_manager.cc:1403] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:49.349304   421 tablet_bootstrap.cc:492] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:01:49.349368   421 ts_tablet_manager.cc:1403] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:01:49.349679   421 raft_consensus.cc:359] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.349762   421 raft_consensus.cc:385] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:49.349785   421 raft_consensus.cc:740] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:01:49.349702   420 raft_consensus.cc:359] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.349823   420 raft_consensus.cc:385] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:49.349869   420 raft_consensus.cc:740] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:01:49.349929   421 consensus_queue.cc:260] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.349992   420 consensus_queue.cc:260] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.350219   421 ts_tablet_manager.cc:1434] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:01:49.350288   420 ts_tablet_manager.cc:1434] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:01:49.351543   419 tablet_bootstrap.cc:492] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:01:49.351634   419 ts_tablet_manager.cc:1403] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.007s	user 0.000s	sys 0.002s
I20260812 08:01:49.352200   419 raft_consensus.cc:359] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.352326   419 raft_consensus.cc:385] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:49.352370   419 raft_consensus.cc:740] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:01:49.352563   419 consensus_queue.cc:260] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.353348   419 ts_tablet_manager.cc:1434] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:01:49.552750   339 raft_consensus.cc:493] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:49.552899   339 raft_consensus.cc:515] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.553436   339 leader_election.cc:290] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:01:49.553936 31830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c24d7cc55a4b4d966ab1a77c67b1da" candidate_uuid: "3785b50895f74e12b7723aa0162c02c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813" is_pre_election: true
I20260812 08:01:49.553946 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c24d7cc55a4b4d966ab1a77c67b1da" candidate_uuid: "3785b50895f74e12b7723aa0162c02c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5" is_pre_election: true
I20260812 08:01:49.554108 31830 raft_consensus.cc:2468] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3785b50895f74e12b7723aa0162c02c5 in term 0.
I20260812 08:01:49.554117 32059 raft_consensus.cc:2468] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3785b50895f74e12b7723aa0162c02c5 in term 0.
I20260812 08:01:49.554541 32180 leader_election.cc:304] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:01:49.554757   339 raft_consensus.cc:2804] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:49.554837   339 raft_consensus.cc:493] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:49.554893   339 raft_consensus.cc:3060] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:49.555858   339 raft_consensus.cc:515] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.556279   339 leader_election.cc:290] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [CANDIDATE]: Term 1 election: Requested vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:01:49.556615 31830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c24d7cc55a4b4d966ab1a77c67b1da" candidate_uuid: "3785b50895f74e12b7723aa0162c02c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813"
I20260812 08:01:49.556684 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c24d7cc55a4b4d966ab1a77c67b1da" candidate_uuid: "3785b50895f74e12b7723aa0162c02c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5"
I20260812 08:01:49.556730 31830 raft_consensus.cc:3060] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:49.556845 32059 raft_consensus.cc:3060] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:49.557565 31830 raft_consensus.cc:2468] T 80c24d7cc55a4b4d966ab1a77c67b1da P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3785b50895f74e12b7723aa0162c02c5 in term 1.
I20260812 08:01:49.557718 32059 raft_consensus.cc:2468] T 80c24d7cc55a4b4d966ab1a77c67b1da P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3785b50895f74e12b7723aa0162c02c5 in term 1.
I20260812 08:01:49.557940 32180 leader_election.cc:304] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:01:49.558161   339 raft_consensus.cc:2804] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:49.558320   339 raft_consensus.cc:697] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [term 1 LEADER]: Becoming Leader. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Running, Role: LEADER
I20260812 08:01:49.558482   339 consensus_queue.cc:237] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:01:49.560659 31509 catalog_manager.cc:5719] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67). New cstate: current_term: 1 leader_uuid: "3785b50895f74e12b7723aa0162c02c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: HEALTHY } } }
W20260812 08:01:49.572320 32232 tablet_service.cc:3018] Rejecting scan request for tablet 80c24d7cc55a4b4d966ab1a77c67b1da: Uninitialized: clean time has not yet been initialized
W20260812 08:01:49.657632 32507 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.500s (SENT)
I20260812 08:01:49.657783 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:49.658156   434 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 08:01:49.774219 32232 tablet_service.cc:3018] Rejecting scan request for tablet 80c24d7cc55a4b4d966ab1a77c67b1da: Uninitialized: clean time has not yet been initialized
I20260812 08:01:49.939500   339 consensus_queue.cc:1048] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:49.943362   429 consensus_queue.cc:1048] T 80c24d7cc55a4b4d966ab1a77c67b1da P 3785b50895f74e12b7723aa0162c02c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:01:50.177212 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.607s	user 0.001s	sys 0.001s
W20260812 08:01:50.179380 31377 catalog_manager.cc:5552] Ignoring report from unknown tablet 80c24d7cc55a4b4d966ab1a77c67b1da
I20260812 08:01:50.179477 31405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.179790 31405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 11 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:01:50.180002 31405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 11 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.180419 31405 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 3 LEADER]: Stepping down as leader of term 3
I20260812 08:01:50.180481 31405 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f1d4089ea8140dfab33d71b320df9df, State: Running, Role: LEADER
I20260812 08:01:50.180613 31405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 3.11, Last appended by leader: 11, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:50.180768 31405 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:50.181524 31404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.181747 31402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.181900 31401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.182008 31405 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 4 FOLLOWER]: Refusing update from remote peer b5e668bf917446e1a1f724f2782788aa: Log matching property violated. Preceding OpId in replica: term: 3 index: 11. Preceding OpId from leader: term: 4 index: 12. (index mismatch)
I20260812 08:01:50.182037 31400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.182189 31398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.182296 31398 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 4.
I20260812 08:01:50.182526 31395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.182600 31395 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 4.
I20260812 08:01:50.182725 31393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 11 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.182797 31393 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 4.
I20260812 08:01:50.182919 31392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 11 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:01:50.183867 31392 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 4.
I20260812 08:01:50.179397 31408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 12 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.184199 31408 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 4.
I20260812 08:01:50.536645   455 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:01:50.536784   455 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:50.537442   455 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:50.537918 31408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 15 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:01:50.538061 31408 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 4.
I20260812 08:01:50.538378 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4; no voters: 
I20260812 08:01:50.538641   455 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 08:01:50.538697   455 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:01:50.538726   455 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:01:50.539603   455 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:50.539975   455 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 election: Requested vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:50.540366 31408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 15 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:01:50.540505 31408 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:01:50.541383 31408 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 5.
I20260812 08:01:50.541703 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4; no voters: 
I20260812 08:01:50.541863   455 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 08:01:50.542028   455 raft_consensus.cc:697] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 5 LEADER]: Becoming Leader. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Running, Role: LEADER
I20260812 08:01:50.542191   455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 4.15, Last appended by leader: 15, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:50.542858   456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:50.542980   456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:50.543269   458 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:50.544296   458 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]
I20260812 08:01:50.544596   458 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]
I20260812 08:01:50.544929   458 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:01:50.545511   458 tablet_loader.cc:96] loaded metadata for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54])
I20260812 08:01:50.545737   458 tablet_loader.cc:96] loaded metadata for tablet c95b91c169244ddc9740b5b3b2364db5 (table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352])
I20260812 08:01:50.545935   458 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:01:50.546135   458 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:50.546520   458 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:01:50.546594   458 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:50.547137   458 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:50.547554   458 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Loaded TSK: 0
I20260812 08:01:50.547811   458 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:50.992980 31408 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Refusing update from remote peer 815fd2931e984818b4644ca5c9729cd4: Log matching property violated. Preceding OpId in replica: term: 3 index: 11. Preceding OpId from leader: term: 5 index: 16. (index mismatch)
I20260812 08:01:50.993602   456 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 08:01:50.996644   466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:50.996661   459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:50.996968   466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:50.996994   459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:50.997495   455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:50.997628   455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:50.997833   459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:01:50.997989   459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:01:51.448395 31899 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:01:51.450096 32141 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:01:51.470361 32389 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:01:51.498528   476 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:01:51.498667   476 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:51.499375   476 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:51.499751 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:01:51.849100 32506 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.653s (SENT)
W20260812 08:01:52.006518 31368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.506s (SENT) [suppressed 5 similar messages]
W20260812 08:01:52.017884 32506 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.739s (SENT)
W20260812 08:01:52.514120 31368 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.506s (SENT)
I20260812 08:01:52.514230 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:52.514575   486 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:53.084738   488 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:01:53.084874   488 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:53.085386   488 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:53.085863 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:01:54.106664 31368 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.509s (SENT)
I20260812 08:01:54.106791 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:54.107152   493 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:54.882298   496 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:01:54.882503   496 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:54.883041   496 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:54.883563 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:01:56.110308 31368 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.612s (SENT)
I20260812 08:01:56.110455 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:56.110896   501 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:56.934051   508 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:01:56.934206   508 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:56.934660   508 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:56.935135 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:01:57.667577 31368 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.731s (SENT) [suppressed 2 similar messages]
W20260812 08:01:58.400439 31368 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.731s (SENT)
I20260812 08:01:58.400571 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:58.400976   514 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:58.972548   516 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:01:58.972710   516 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:01:58.973227   516 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:01:58.973708 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:01:59.995761 31368 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.510s (SENT)
I20260812 08:01:59.995885 31368 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:01:59.996182   522 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 08:02:00.191105 32398 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.124:43465)
I20260812 08:02:00.192970 32538 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51622:
name: "default.table_0_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:00.195873 32538 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:00.210835 32272 tablet_service.cc:1511] Processing CreateTablet for tablet 2385c69cd90e40478e2b5af3af44f0b4 (DEFAULT_TABLE table=default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:00.210877 32025 tablet_service.cc:1511] Processing CreateTablet for tablet 2385c69cd90e40478e2b5af3af44f0b4 (DEFAULT_TABLE table=default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:00.211181 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2385c69cd90e40478e2b5af3af44f0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:00.211191 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2385c69cd90e40478e2b5af3af44f0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:00.213333   550 tablet_bootstrap.cc:492] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:00.213984   551 tablet_bootstrap.cc:492] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:00.213991 31792 tablet_service.cc:1511] Processing CreateTablet for tablet 2385c69cd90e40478e2b5af3af44f0b4 (DEFAULT_TABLE table=default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:00.214249 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2385c69cd90e40478e2b5af3af44f0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:00.214931   551 tablet_bootstrap.cc:654] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:00.216101   550 tablet_bootstrap.cc:654] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:00.216120   551 tablet_bootstrap.cc:492] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:00.216200   551 ts_tablet_manager.cc:1403] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:02:00.216475   555 tablet_bootstrap.cc:492] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:00.216663   551 raft_consensus.cc:359] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.216786   551 raft_consensus.cc:385] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:00.216825   551 raft_consensus.cc:740] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:00.216984   551 consensus_queue.cc:260] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.217324   551 ts_tablet_manager.cc:1434] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:00.217350   550 tablet_bootstrap.cc:492] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:00.217424   550 ts_tablet_manager.cc:1403] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260812 08:02:00.217928   555 tablet_bootstrap.cc:654] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:00.217908   550 raft_consensus.cc:359] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.218114   550 raft_consensus.cc:385] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:00.218214   550 raft_consensus.cc:740] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:00.218425   550 consensus_queue.cc:260] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.218829   550 ts_tablet_manager.cc:1434] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:00.221560   555 tablet_bootstrap.cc:492] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:00.221659   555 ts_tablet_manager.cc:1403] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.000s
I20260812 08:02:00.222100   555 raft_consensus.cc:359] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.222184   555 raft_consensus.cc:385] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:00.222205   555 raft_consensus.cc:740] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:00.222297   555 consensus_queue.cc:260] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.222488   555 ts_tablet_manager.cc:1434] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:00.297639 32759 raft_consensus.cc:493] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:00.297798 32759 raft_consensus.cc:515] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.298363 32759 leader_election.cc:290] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:02:00.298854 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385c69cd90e40478e2b5af3af44f0b4" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5" is_pre_election: true
I20260812 08:02:00.298852 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385c69cd90e40478e2b5af3af44f0b4" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:00.299027 32059 raft_consensus.cc:2468] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:00.299039 32310 raft_consensus.cc:2468] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:00.299463 31712 leader_election.cc:304] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:00.299649 32759 raft_consensus.cc:2804] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:00.299714 32759 raft_consensus.cc:493] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:00.299744 32759 raft_consensus.cc:3060] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:00.300639 32759 raft_consensus.cc:515] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.301041 32759 leader_election.cc:290] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Requested vote from peers 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:02:00.301388 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385c69cd90e40478e2b5af3af44f0b4" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:00.301451 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2385c69cd90e40478e2b5af3af44f0b4" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5"
I20260812 08:02:00.301522 32310 raft_consensus.cc:3060] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:00.301590 32059 raft_consensus.cc:3060] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:00.302577 32059 raft_consensus.cc:2468] T 2385c69cd90e40478e2b5af3af44f0b4 P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:00.302639 32310 raft_consensus.cc:2468] T 2385c69cd90e40478e2b5af3af44f0b4 P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:00.302856 31715 leader_election.cc:304] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:00.303052 32759 raft_consensus.cc:2804] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:00.303323 32759 raft_consensus.cc:697] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 LEADER]: Becoming Leader. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Running, Role: LEADER
I20260812 08:02:00.303490 32759 consensus_queue.cc:237] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:00.305181 32538 catalog_manager.cc:5719] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65). New cstate: current_term: 1 leader_uuid: "e2b7a4d926554fb784ee7b1d94f86813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: HEALTHY } } }
W20260812 08:02:00.331265 31756 tablet_service.cc:3018] Rejecting scan request for tablet 2385c69cd90e40478e2b5af3af44f0b4: Uninitialized: clean time has not yet been initialized
W20260812 08:02:00.533483 31756 tablet_service.cc:3018] Rejecting scan request for tablet 2385c69cd90e40478e2b5af3af44f0b4: Uninitialized: clean time has not yet been initialized
I20260812 08:02:00.759938 32759 consensus_queue.cc:1048] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:00.764313   561 consensus_queue.cc:1048] T 2385c69cd90e40478e2b5af3af44f0b4 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:00.936554 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.608s	user 0.001s	sys 0.001s
I20260812 08:02:00.937203 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 31342
I20260812 08:02:00.940264   404 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 08:02:00.942865 31523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 15 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa"
I20260812 08:02:00.943449 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 15 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.943537 31519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 15 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.943701 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 5 candidate_status { last_received { term: 4 index: 15 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa"
I20260812 08:02:00.944494 31521 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 4 LEADER]: Stepping down as leader of term 4
I20260812 08:02:00.944555 31521 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b5e668bf917446e1a1f724f2782788aa, State: Running, Role: LEADER
I20260812 08:02:00.944716 31521 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 4.15, Last appended by leader: 15, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:00.944851 31521 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:02:00.945848 31523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.946062 31521 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Refusing update from remote peer 815fd2931e984818b4644ca5c9729cd4: Log matching property violated. Preceding OpId in replica: term: 4 index: 15. Preceding OpId from leader: term: 5 index: 16. (index mismatch)
I20260812 08:02:00.946106 31513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.946185 31525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.946249 32555 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 5 LEADER]: Rejecting Update request from peer b5e668bf917446e1a1f724f2782788aa for earlier term 4. Current term is 5. Ops: []
I20260812 08:02:00.946259 31516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.946265 31519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.946444 31523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.946192 31513 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 5.
I20260812 08:02:00.946589 31512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.946708 31512 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 5.
I20260812 08:02:00.946617 31515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.946960 31515 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 5.
I20260812 08:02:00.946722 31518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.949188 31518 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 5.
I20260812 08:02:00.949546 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 16 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:00.949656 31520 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 5.
I20260812 08:02:00.950042   521 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260812 08:02:00.952816   404 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:00.952936   404 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:00.953226   581 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:00.953379   581 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:00.959636 31491 connection.cc:573] server connection from 127.0.0.1:52492 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:00.959941 31487 connection.cc:573] client connection to 127.26.116.125:34993 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:00.960043 31487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
I20260812 08:02:00.960131 31458 master_runner.cc:217] Error getting master consensus for 127.26.116.125:34993: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:00.960265 31458 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 08:02:01.075922   592 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:01.076120   592 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260812 08:02:01.077879   592 dir_manager.cc:729] IO error: Could not lock instance file. Make sure that Kudu is not already running and you are not trying to run Kudu with a different user than before: lock /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/data/block_manager_instance: Resource temporarily unavailable (error 11)
W20260812 08:02:01.077940   592 dir_manager.cc:730] Proceeding without lock
I20260812 08:02:01.080519   592 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.001s
I20260812 08:02:01.080729   592 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:01:33 on dist-test-slave-92m1"
I20260812 08:02:01.096158 27089 master_failover-itest.cc:413] tablet: 00000000000000000000000000000000, peers: 815fd2931e984818b4644ca5c9729cd4 2f1d4089ea8140dfab33d71b320df9df b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:01.207110   603 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:01.207389   603 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:01.213092   603 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/instance:
uuid: "2f1d4089ea8140dfab33d71b320df9df"
format_stamp: "Formatted at 2026-08-12 08:02:01 on dist-test-slave-92m1"
I20260812 08:02:01.216184   603 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal/instance:
uuid: "2f1d4089ea8140dfab33d71b320df9df"
format_stamp: "Formatted at 2026-08-12 08:02:01 on dist-test-slave-92m1"
I20260812 08:02:01.224174   603 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.000s	sys 0.004s
W20260812 08:02:01.340965 32507 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.116.125:34993: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260812 08:02:01.341804 32507 consensus_peers.cc:597] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 -> Peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Couldn't send request to peer 2f1d4089ea8140dfab33d71b320df9df. Status: Network error: Client connection negotiation failed: client connection to 127.26.116.125:34993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:01.348737   612 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:01.348974   612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:01.353346   612 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:01.355436   628 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:01.356189   612 fs_report.cc:389] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:01.356583   612 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:01.356652   612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
uuid: "2f1d4089ea8140dfab33d71b320df9df"
format_stamp: "Formatted at 2026-08-12 08:02:01 on dist-test-slave-92m1"
W20260812 08:02:01.362421   633 tool_action_local_replica.cc:343] Start to copy tablet 00000000000000000000000000000000
I20260812 08:02:01.363260   633 tablet_copy_client.cc:323] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: tablet copy: Beginning tablet copy session from remote peer at address 127.26.116.124:43465
I20260812 08:02:01.371124 31542 tablet_copy_service.cc:140] P b5e668bf917446e1a1f724f2782788aa: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2f1d4089ea8140dfab33d71b320df9df ({username='slave'} at 127.0.0.1:41664)
I20260812 08:02:01.371280 31542 tablet_copy_service.cc:161] P b5e668bf917446e1a1f724f2782788aa: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2f1d4089ea8140dfab33d71b320df9df at {username='slave'} at 127.0.0.1:41664: session id = 2f1d4089ea8140dfab33d71b320df9df-00000000000000000000000000000000
I20260812 08:02:01.372076 31542 tablet_copy_source_session.cc:215] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:01.375080   633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 08:02:01.382591   633 tablet_copy_client.cc:806] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:01.383924   633 tablet_copy_client.cc:670] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:01.387431   633 tablet_copy_client.cc:538] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:01.391872   633 tool_action_local_replica.cc:343] Tablet 00000000000000000000000000000000 copy succeed.
I20260812 08:02:01.391924   633 tool_action_local_replica.cc:343] 1/1 tablets, 6742 bytes copied, include 0 failed tablets.
I20260812 08:02:01.392515 31542 tablet_copy_service.cc:342] P b5e668bf917446e1a1f724f2782788aa: Request end of tablet copy session 2f1d4089ea8140dfab33d71b320df9df-00000000000000000000000000000000 received from {username='slave'} at 127.0.0.1:41664
I20260812 08:02:01.392640 31542 tablet_copy_service.cc:434] P b5e668bf917446e1a1f724f2782788aa: ending tablet copy session 2f1d4089ea8140dfab33d71b320df9df-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2f1d4089ea8140dfab33d71b320df9df
I20260812 08:02:01.405817 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:34993
--webserver_interface=127.26.116.125
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:02:01.443753   521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:01.443940   521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
W20260812 08:02:01.511188   645 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:01.511456   645 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:01.511528   645 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:01.514696   645 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:01.514751   645 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:01.514771   645 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:01.514789   645 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:01.518481   645 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.125:34993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.116.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:01.519445   645 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:01.520462   645 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:01.525979   665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:01.526048   645 server_base.cc:1061] running on GCE node
W20260812 08:02:01.526000   662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:01.525988   663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:01.526749   645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:01.527575   645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:01.528714   645 hybrid_clock.cc:648] HybridClock initialized: now 1786521721528697 us; error 32 us; skew 500 ppm
I20260812 08:02:01.530318   645 webserver.cc:533] Webserver started at http://127.26.116.125:42375/ using document root <none> and password file <none>
I20260812 08:02:01.530839   645 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:01.530897   645 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:01.534088   645 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:01.535921   675 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:01.536844   645 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:01.536974   645 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
uuid: "2f1d4089ea8140dfab33d71b320df9df"
format_stamp: "Formatted at 2026-08-12 08:02:01 on dist-test-slave-92m1"
I20260812 08:02:01.537362   645 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:01.557758   645 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:01.558473   645 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:01.558674   645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:01.566316   775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.125:34993 every 8 connection(s)
I20260812 08:02:01.566321   645 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.125:34993
I20260812 08:02:01.567471   645 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-1/data/info.pb
I20260812 08:02:01.571168   776 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:02:01.571797 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 645
I20260812 08:02:01.573190   776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Bootstrap starting.
I20260812 08:02:01.573151 32538 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51622:
name: "default.table_1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:01.573706 32538 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:01.580857   776 log.cc:826] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:01.583117 31792 tablet_service.cc:1511] Processing CreateTablet for tablet cdd1a0db7b19430aa4f00dbc4498bf8d (DEFAULT_TABLE table=default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:01.583473 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd1a0db7b19430aa4f00dbc4498bf8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:01.583784 32025 tablet_service.cc:1511] Processing CreateTablet for tablet cdd1a0db7b19430aa4f00dbc4498bf8d (DEFAULT_TABLE table=default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:01.583880 32272 tablet_service.cc:1511] Processing CreateTablet for tablet cdd1a0db7b19430aa4f00dbc4498bf8d (DEFAULT_TABLE table=default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:01.584067 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd1a0db7b19430aa4f00dbc4498bf8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:01.584141 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd1a0db7b19430aa4f00dbc4498bf8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:01.586329   790 tablet_bootstrap.cc:492] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:01.586762   793 tablet_bootstrap.cc:492] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:01.587522   789 tablet_bootstrap.cc:492] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:01.587733   793 tablet_bootstrap.cc:654] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:01.587793   790 tablet_bootstrap.cc:654] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:01.588495   789 tablet_bootstrap.cc:654] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:01.588824   793 tablet_bootstrap.cc:492] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:01.588857   790 tablet_bootstrap.cc:492] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:01.588912   793 ts_tablet_manager.cc:1403] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:01.588922   790 ts_tablet_manager.cc:1403] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:01.589325   790 raft_consensus.cc:359] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.589325   793 raft_consensus.cc:359] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.589424   790 raft_consensus.cc:385] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:01.589424   793 raft_consensus.cc:385] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:01.589457   793 raft_consensus.cc:740] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:01.589457   790 raft_consensus.cc:740] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:01.589581   793 consensus_queue.cc:260] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.589603   790 consensus_queue.cc:260] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.589710   789 tablet_bootstrap.cc:492] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:01.589789   789 ts_tablet_manager.cc:1403] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:01.589866   793 ts_tablet_manager.cc:1434] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:01.589968   790 ts_tablet_manager.cc:1434] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:01.590220   789 raft_consensus.cc:359] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.590313   789 raft_consensus.cc:385] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:01.590345   789 raft_consensus.cc:740] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:01.590471   789 consensus_queue.cc:260] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.590767   789 ts_tablet_manager.cc:1434] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:01.600961 32390 heartbeater.cc:344] Connected to a master server at 127.26.116.125:34993
I20260812 08:02:01.601681   776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=0 applied=19 ignored=0} inserts{seen=11 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:01.602047   776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Bootstrap complete.
I20260812 08:02:01.603627 32145 heartbeater.cc:344] Connected to a master server at 127.26.116.125:34993
I20260812 08:02:01.604841 31903 heartbeater.cc:344] Connected to a master server at 127.26.116.125:34993
I20260812 08:02:01.606361   776 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:01.606806   776 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f1d4089ea8140dfab33d71b320df9df, State: Initialized, Role: FOLLOWER
I20260812 08:02:01.607302   776 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 19, Last appended: 5.19, Last appended by leader: 19, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:01.607730   807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:01.607828   807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:01.608318   776 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:01.613461   828 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:02:01.613523   828 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: loading cluster ID for follower catalog manager: success
I20260812 08:02:01.616068   828 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: acquiring CA information for follower catalog manager: success
I20260812 08:02:01.617296   828 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:02:01.665138   800 raft_consensus.cc:493] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:01.665289   800 raft_consensus.cc:515] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.666491   800 leader_election.cc:290] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:01.670993 31830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1a0db7b19430aa4f00dbc4498bf8d" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813" is_pre_election: true
I20260812 08:02:01.671178 31830 raft_consensus.cc:2468] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 0.
I20260812 08:02:01.671257 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1a0db7b19430aa4f00dbc4498bf8d" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:01.671396 32310 raft_consensus.cc:2468] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 0.
I20260812 08:02:01.671629 31935 leader_election.cc:304] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:01.671871   800 raft_consensus.cc:2804] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:01.671980   800 raft_consensus.cc:493] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:01.672046   800 raft_consensus.cc:3060] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:01.672950   800 raft_consensus.cc:515] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.673333   800 leader_election.cc:290] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 election: Requested vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:01.673750 31830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1a0db7b19430aa4f00dbc4498bf8d" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813"
I20260812 08:02:01.673852 31830 raft_consensus.cc:3060] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:01.674649 31830 raft_consensus.cc:2468] T cdd1a0db7b19430aa4f00dbc4498bf8d P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 1.
I20260812 08:02:01.674937 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd1a0db7b19430aa4f00dbc4498bf8d" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:01.674973 31935 leader_election.cc:304] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:01.675056 32310 raft_consensus.cc:3060] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:01.675140   800 raft_consensus.cc:2804] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:01.675374   800 raft_consensus.cc:697] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Running, Role: LEADER
I20260812 08:02:01.675684   800 consensus_queue.cc:237] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:01.676153 32310 raft_consensus.cc:2468] T cdd1a0db7b19430aa4f00dbc4498bf8d P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 1.
I20260812 08:02:01.678959 32538 catalog_manager.cc:5719] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ea7421a364e447a932edf99c67546c5 (127.26.116.66). New cstate: current_term: 1 leader_uuid: "2ea7421a364e447a932edf99c67546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:01.679045   717 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2ea7421a364e447a932edf99c67546c5" instance_seqno: 1786521693889371) as {username='slave'} at 127.26.116.66:47913; Asking this server to re-register.
I20260812 08:02:01.680413 32145 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:01.681851   717 ts_manager.cc:194] Registered new tserver with Master: 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
W20260812 08:02:01.695960 31992 tablet_service.cc:3018] Rejecting scan request for tablet cdd1a0db7b19430aa4f00dbc4498bf8d: Uninitialized: clean time has not yet been initialized
I20260812 08:02:01.897650   521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:01.897855   521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
W20260812 08:02:01.898353 31992 tablet_service.cc:3018] Rejecting scan request for tablet cdd1a0db7b19430aa4f00dbc4498bf8d: Uninitialized: clean time has not yet been initialized
I20260812 08:02:01.905650   807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:01.905798   807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:02.104306   717 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" instance_seqno: 1786521694081552) as {username='slave'} at 127.26.116.67:42193; Asking this server to re-register.
I20260812 08:02:02.104779 32390 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:02.105635   717 ts_manager.cc:194] Registered new tserver with Master: 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:02.108310   717 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" instance_seqno: 1786521693700776) as {username='slave'} at 127.26.116.65:58903; Asking this server to re-register.
I20260812 08:02:02.108744 31903 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:02.109687   717 ts_manager.cc:194] Registered new tserver with Master: e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579)
I20260812 08:02:02.147444   800 consensus_queue.cc:1048] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:02.151865   800 consensus_queue.cc:1048] T cdd1a0db7b19430aa4f00dbc4498bf8d P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:02.184486   865 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:02.184669   865 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:02.185323   865 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:02.185828 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:02.188967   730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:02.189524 31487 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4
I20260812 08:02:02.189688   865 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 08:02:02.302616 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.614s	user 0.001s	sys 0.001s
I20260812 08:02:02.403555   807 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:02.403806   807 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:02.404948   807 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:02.405486 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:02.765211   871 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:02.765398   871 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:02.765905   871 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:02.766463   730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:02.766670   730 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 5.
I20260812 08:02:02.767040 31487 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:02:02.767289   871 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 08:02:02.767350   871 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Starting leader election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:02.767380   871 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 5 FOLLOWER]: Advancing to term 6
I20260812 08:02:02.768258   871 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:02.768563   871 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 6 election: Requested vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:02.768998   730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:02:02.769102   730 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 5 FOLLOWER]: Advancing to term 6
I20260812 08:02:02.770750   730 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 6.
I20260812 08:02:02.771031 31487 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:02:02.771271   871 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 6 FOLLOWER]: Leader election won for term 6
I20260812 08:02:02.771458   871 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 6 LEADER]: Becoming Leader. State: Replica: b5e668bf917446e1a1f724f2782788aa, State: Running, Role: LEADER
I20260812 08:02:02.771623   871 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 5.22, Last appended by leader: 22, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:02.772240   872 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e668bf917446e1a1f724f2782788aa. Latest consensus state: current_term: 6 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:02.772349   872 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:02.772590   877 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:02.773617   877 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]
I20260812 08:02:02.773886   877 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c]
I20260812 08:02:02.774099   877 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]
I20260812 08:02:02.774323   877 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5]
I20260812 08:02:02.774529   877 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:02:02.775099   877 tablet_loader.cc:96] loaded metadata for tablet 2385c69cd90e40478e2b5af3af44f0b4 (table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5])
I20260812 08:02:02.775344   877 tablet_loader.cc:96] loaded metadata for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54])
I20260812 08:02:02.775542   877 tablet_loader.cc:96] loaded metadata for tablet c95b91c169244ddc9740b5b3b2364db5 (table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352])
I20260812 08:02:02.775741   877 tablet_loader.cc:96] loaded metadata for tablet cdd1a0db7b19430aa4f00dbc4498bf8d (table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c])
I20260812 08:02:02.775931   877 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:02:02.776139   877 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:02.776530   877 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:02:02.776580   877 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:02.777133   877 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:02.777536   877 catalog_manager.cc:6103] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Loaded TSK: 0
I20260812 08:02:02.777797   877 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 08:02:02.938691   680 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.532s (SENT)
I20260812 08:02:03.240193   730 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Refusing update from remote peer b5e668bf917446e1a1f724f2782788aa: Log matching property violated. Preceding OpId in replica: term: 5 index: 22. Preceding OpId from leader: term: 6 index: 23. (index mismatch)
I20260812 08:02:03.240829   872 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260812 08:02:03.242162   879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e668bf917446e1a1f724f2782788aa. Latest consensus state: current_term: 6 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:03.242293   879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:03.243381   871 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:03.243512   871 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:03.243794   879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:03.243907   879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:03.473524   680 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.532s (SENT)
I20260812 08:02:03.473758   680 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:03.474092   879 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:02:03.546851 32139 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
I20260812 08:02:03.656456 31897 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
I20260812 08:02:03.658910 32383 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
W20260812 08:02:03.857189 31487 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.542s (SENT)
W20260812 08:02:04.071631 31487 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.651s (SENT)
I20260812 08:02:04.154043   891 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:04.154211   891 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:04.154721   891 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:04.155319 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:05.611689   680 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.727s (SENT)
I20260812 08:02:05.611821   680 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:05.612210   908 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 08:02:06.397893   912 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:06.398032   912 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:06.398609   912 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:06.399128 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:07.702850   680 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.651s (SENT)
I20260812 08:02:07.702960   680 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:07.703426   919 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 08:02:08.498024   921 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:08.498162   921 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:08.498569   921 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:08.499009 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:09.180128   680 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.681s (SENT) [suppressed 2 similar messages]
W20260812 08:02:09.862641   680 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.681s (SENT)
I20260812 08:02:09.862751   680 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:09.863113   928 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 08:02:10.479040   931 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:10.479249   931 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:10.479812   931 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:10.480355 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:11.599598   680 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.559s (SENT)
I20260812 08:02:11.599712   680 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:11.600037   940 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 08:02:12.315654 32399 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.126:44773)
I20260812 08:02:12.317998 31499 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52510:
name: "default.table_1_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:12.318558 31499 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:12.327883 32025 tablet_service.cc:1511] Processing CreateTablet for tablet 376519db6a5c4b3b833f976c2c7c1d3d (DEFAULT_TABLE table=default.table_1_0 [id=e97000987e314ec6867154729c559c3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:12.328016 31792 tablet_service.cc:1511] Processing CreateTablet for tablet 376519db6a5c4b3b833f976c2c7c1d3d (DEFAULT_TABLE table=default.table_1_0 [id=e97000987e314ec6867154729c559c3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:12.328083 32272 tablet_service.cc:1511] Processing CreateTablet for tablet 376519db6a5c4b3b833f976c2c7c1d3d (DEFAULT_TABLE table=default.table_1_0 [id=e97000987e314ec6867154729c559c3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:12.328238 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376519db6a5c4b3b833f976c2c7c1d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:12.328370 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376519db6a5c4b3b833f976c2c7c1d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:12.328372 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376519db6a5c4b3b833f976c2c7c1d3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:12.330147   955 tablet_bootstrap.cc:492] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:12.330555   959 tablet_bootstrap.cc:492] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:12.331108   956 tablet_bootstrap.cc:492] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:12.331296   955 tablet_bootstrap.cc:654] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:12.331682   959 tablet_bootstrap.cc:654] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:12.332136   956 tablet_bootstrap.cc:654] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:12.332594   955 tablet_bootstrap.cc:492] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:12.332707   955 ts_tablet_manager.cc:1403] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:02:12.332885   959 tablet_bootstrap.cc:492] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:12.333033   959 ts_tablet_manager.cc:1403] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:02:12.333222   955 raft_consensus.cc:359] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.333348   956 tablet_bootstrap.cc:492] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:12.333398   955 raft_consensus.cc:385] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:12.333483   955 raft_consensus.cc:740] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:12.333567   959 raft_consensus.cc:359] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.333699   959 raft_consensus.cc:385] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:12.333673   955 consensus_queue.cc:260] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.333745   959 raft_consensus.cc:740] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:12.333910   959 consensus_queue.cc:260] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.333972   955 ts_tablet_manager.cc:1434] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:12.334210   959 ts_tablet_manager.cc:1434] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:12.336665   956 ts_tablet_manager.cc:1403] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.006s	user 0.002s	sys 0.000s
I20260812 08:02:12.337194   956 raft_consensus.cc:359] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.337337   956 raft_consensus.cc:385] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:12.337421   956 raft_consensus.cc:740] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:12.337592   956 consensus_queue.cc:260] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.337877   956 ts_tablet_manager.cc:1434] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:12.363577   902 raft_consensus.cc:493] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:12.363729   902 raft_consensus.cc:515] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.364197   902 leader_election.cc:290] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:12.364638 31829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376519db6a5c4b3b833f976c2c7c1d3d" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813" is_pre_election: true
I20260812 08:02:12.364684 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376519db6a5c4b3b833f976c2c7c1d3d" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:12.364816 32310 raft_consensus.cc:2468] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 0.
I20260812 08:02:12.364816 31829 raft_consensus.cc:2468] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 0.
I20260812 08:02:12.365177 31935 leader_election.cc:304] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:12.365346   902 raft_consensus.cc:2804] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:12.365410   902 raft_consensus.cc:493] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:12.365458   902 raft_consensus.cc:3060] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:12.366329   902 raft_consensus.cc:515] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.366669   902 leader_election.cc:290] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 election: Requested vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:12.367038 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376519db6a5c4b3b833f976c2c7c1d3d" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:12.367038 31829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376519db6a5c4b3b833f976c2c7c1d3d" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813"
I20260812 08:02:12.367165 31829 raft_consensus.cc:3060] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:12.367165 32310 raft_consensus.cc:3060] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:12.368264 32310 raft_consensus.cc:2468] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 1.
I20260812 08:02:12.368309 31829 raft_consensus.cc:2468] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 1.
I20260812 08:02:12.368611 31935 leader_election.cc:304] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:12.368836   902 raft_consensus.cc:2804] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:12.369067   902 raft_consensus.cc:697] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Running, Role: LEADER
I20260812 08:02:12.369230   902 consensus_queue.cc:237] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:12.370929 31508 catalog_manager.cc:5719] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ea7421a364e447a932edf99c67546c5 (127.26.116.66). New cstate: current_term: 1 leader_uuid: "2ea7421a364e447a932edf99c67546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } }
W20260812 08:02:12.382192 31992 tablet_service.cc:3018] Rejecting scan request for tablet 376519db6a5c4b3b833f976c2c7c1d3d: Uninitialized: clean time has not yet been initialized
W20260812 08:02:12.395747 32392 tablet.cc:2406] T 376519db6a5c4b3b833f976c2c7c1d3d P 3785b50895f74e12b7723aa0162c02c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:12.450991 32147 tablet.cc:2406] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:12.514590 31905 tablet.cc:2406] T 376519db6a5c4b3b833f976c2c7c1d3d P e2b7a4d926554fb784ee7b1d94f86813: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:12.584339 31992 tablet_service.cc:3018] Rejecting scan request for tablet 376519db6a5c4b3b833f976c2c7c1d3d: Uninitialized: clean time has not yet been initialized
I20260812 08:02:12.775965   902 consensus_queue.cc:1048] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:12.779453   902 consensus_queue.cc:1048] T 376519db6a5c4b3b833f976c2c7c1d3d P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:12.875015   973 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:12.875191   973 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:12.875701   973 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:12.876148 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 26 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:12.987349 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.607s	user 0.001s	sys 0.001s
I20260812 08:02:12.990767 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:02:12.991001   647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:12.991060 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.991128   647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:12.991148 32556 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 08:02:12.991190 32556 raft_consensus.cc:740] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Running, Role: LEADER
I20260812 08:02:12.991372 32556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 5.22, Last appended by leader: 22, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:12.991506 32556 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 5 FOLLOWER]: Advancing to term 6
I20260812 08:02:12.992518 32553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:02:12.992902 32556 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Refusing update from remote peer b5e668bf917446e1a1f724f2782788aa: Log matching property violated. Preceding OpId in replica: term: 5 index: 22. Preceding OpId from leader: term: 6 index: 23. (index mismatch)
I20260812 08:02:12.995340 32552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.995462 32552 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 6.
I20260812 08:02:12.995491 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.995584 32555 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 6.
I20260812 08:02:12.995663 32552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 26 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.995714 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.995739 32552 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 6.
I20260812 08:02:12.995870 32553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.995919 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.995963 32553 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 6.
I20260812 08:02:12.995877 32547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.996124 32549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.996152 32547 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 6.
I20260812 08:02:12.996603 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.996660 32545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.996708 32543 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 6.
I20260812 08:02:12.996662 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 23 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.997155 32558 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 6.
I20260812 08:02:12.997876   974 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
W20260812 08:02:12.998060   978 catalog_manager.cc:1445] Failed waiting for node to catch up after master election: Illegal state: Node 815fd2931e984818b4644ca5c9729cd4 not leader. Raft Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:12.998250 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 6 candidate_status { last_received { term: 5 index: 22 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:12.998329 32556 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 6.
I20260812 08:02:13.000089 31520 raft_consensus.cc:1240] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 6 LEADER]: Rejecting Update request from peer 815fd2931e984818b4644ca5c9729cd4 for earlier term 5. Current term is 6. Ops: []
I20260812 08:02:13.000281 31499 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52510:
name: "default.table_1_1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:13.000765 31499 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1_1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:13.001848   647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:13.001885   975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e668bf917446e1a1f724f2782788aa. Latest consensus state: current_term: 6 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:13.001945   647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:13.001971   975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:13.003053   974 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:13.003165   974 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:13.010308 31792 tablet_service.cc:1511] Processing CreateTablet for tablet d1e4c47b3db54346b8b5fa4f45e4a034 (DEFAULT_TABLE table=default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:13.010308 32025 tablet_service.cc:1511] Processing CreateTablet for tablet d1e4c47b3db54346b8b5fa4f45e4a034 (DEFAULT_TABLE table=default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:13.010453 32272 tablet_service.cc:1511] Processing CreateTablet for tablet d1e4c47b3db54346b8b5fa4f45e4a034 (DEFAULT_TABLE table=default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:13.010632 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e4c47b3db54346b8b5fa4f45e4a034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:13.010632 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e4c47b3db54346b8b5fa4f45e4a034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:13.010804 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e4c47b3db54346b8b5fa4f45e4a034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:13.012789   996 tablet_bootstrap.cc:492] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:13.013236   997 tablet_bootstrap.cc:492] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:13.013952   996 tablet_bootstrap.cc:654] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:13.014187   997 tablet_bootstrap.cc:654] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:13.014843   998 tablet_bootstrap.cc:492] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:13.015261   996 tablet_bootstrap.cc:492] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:13.015316   997 tablet_bootstrap.cc:492] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:13.015407   996 ts_tablet_manager.cc:1403] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:13.015429   997 ts_tablet_manager.cc:1403] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:13.016026   998 tablet_bootstrap.cc:654] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:13.016316   997 raft_consensus.cc:359] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.016317   996 raft_consensus.cc:359] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.016453   996 raft_consensus.cc:385] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:13.016453   997 raft_consensus.cc:385] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:13.016530   997 raft_consensus.cc:740] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:13.016548   996 raft_consensus.cc:740] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:13.016695   997 consensus_queue.cc:260] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.016702   996 consensus_queue.cc:260] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.017006   997 ts_tablet_manager.cc:1434] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:13.017032   996 ts_tablet_manager.cc:1434] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:13.017266   998 tablet_bootstrap.cc:492] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:13.017352   998 ts_tablet_manager.cc:1403] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:13.017846   998 raft_consensus.cc:359] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.017966   998 raft_consensus.cc:385] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:13.018003   998 raft_consensus.cc:740] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:13.018133   998 consensus_queue.cc:260] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.018427   998 ts_tablet_manager.cc:1434] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:13.076050   618 raft_consensus.cc:493] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:13.076229   618 raft_consensus.cc:515] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.076700   618 leader_election.cc:290] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:13.077191 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4c47b3db54346b8b5fa4f45e4a034" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:13.077193 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4c47b3db54346b8b5fa4f45e4a034" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5" is_pre_election: true
I20260812 08:02:13.077348 32310 raft_consensus.cc:2468] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:13.077348 32059 raft_consensus.cc:2468] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:13.077729 31715 leader_election.cc:304] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:13.077942   618 raft_consensus.cc:2804] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:13.078011   618 raft_consensus.cc:493] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:13.078042   618 raft_consensus.cc:3060] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:13.078989   618 raft_consensus.cc:515] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.079406   618 leader_election.cc:290] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Requested vote from peers 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:13.079810 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4c47b3db54346b8b5fa4f45e4a034" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:13.079890 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4c47b3db54346b8b5fa4f45e4a034" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5"
I20260812 08:02:13.079964 32310 raft_consensus.cc:3060] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:13.080049 32059 raft_consensus.cc:3060] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:13.080837 32310 raft_consensus.cc:2468] T d1e4c47b3db54346b8b5fa4f45e4a034 P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:13.080848 32059 raft_consensus.cc:2468] T d1e4c47b3db54346b8b5fa4f45e4a034 P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:13.081195 31712 leader_election.cc:304] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:13.081384   618 raft_consensus.cc:2804] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:13.081624   618 raft_consensus.cc:697] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 LEADER]: Becoming Leader. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Running, Role: LEADER
I20260812 08:02:13.081791   618 consensus_queue.cc:237] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:13.083879 31508 catalog_manager.cc:5719] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65). New cstate: current_term: 1 leader_uuid: "e2b7a4d926554fb784ee7b1d94f86813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } }
W20260812 08:02:13.093441 31756 tablet_service.cc:3018] Rejecting scan request for tablet d1e4c47b3db54346b8b5fa4f45e4a034: Uninitialized: clean time has not yet been initialized
W20260812 08:02:13.295468 31756 tablet_service.cc:3018] Rejecting scan request for tablet d1e4c47b3db54346b8b5fa4f45e4a034: Uninitialized: clean time has not yet been initialized
I20260812 08:02:13.481215   618 consensus_queue.cc:1048] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:13.485766  1006 consensus_queue.cc:1048] T d1e4c47b3db54346b8b5fa4f45e4a034 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:13.511600 32507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:13.588600  1023 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:13.588759  1023 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:13.589465  1023 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:13.589949 31520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 7 candidate_status { last_received { term: 6 index: 29 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:13.698140 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.607s	user 0.001s	sys 0.000s
I20260812 08:02:13.699589   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 7 candidate_status { last_received { term: 6 index: 29 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:13.699735   729 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 6.
I20260812 08:02:13.700130   730 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Rejecting Update request from peer 815fd2931e984818b4644ca5c9729cd4 for earlier term 5. Current term is 6. Ops: []
I20260812 08:02:13.700297   680 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4; no voters: b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:13.700917 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4; no voters: b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:13.701207  1023 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 08:02:13.701268  1023 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:13.701328  1023 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 6 FOLLOWER]: Advancing to term 7
I20260812 08:02:13.702631  1023 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:13.703037  1023 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 7 election: Requested vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:13.704695   730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 7 candidate_status { last_received { term: 6 index: 29 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:02:13.706290  1029 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 08:02:13.706408  1029 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Starting leader election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:13.706507  1029 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 6 FOLLOWER]: Advancing to term 7
I20260812 08:02:13.707739  1029 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:13.708304  1029 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 election: Requested vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:13.708803 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 7 candidate_status { last_received { term: 6 index: 27 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
W20260812 08:02:14.286791   678 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.578s (SENT) [suppressed 1 similar messages]
W20260812 08:02:14.448642 32506 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.743s (SENT)
W20260812 08:02:14.866084   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.578s (SENT)
I20260812 08:02:14.866205   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:14.866652  1041 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260812 08:02:15.194162 32506 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.743s (SENT)
I20260812 08:02:15.194269 32506 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:15.194597  1042 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 08:02:15.505333  1045 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:15.505448  1045 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:15.505983  1045 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:15.506318 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 8 candidate_status { last_received { term: 6 index: 27 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:15.506472 32556 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f1d4089ea8140dfab33d71b320df9df for term 8 because replica has last-logged OpId of term: 6 index: 29, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 27.
I20260812 08:02:15.906082  1046 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:15.906210  1046 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:15.906757  1046 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:15.907284   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 8 candidate_status { last_received { term: 6 index: 29 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:15.907452   729 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 7.
I20260812 08:02:15.907862 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4; no voters: 
I20260812 08:02:15.908061  1046 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 08:02:15.908125  1046 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:15.908154  1046 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 7 FOLLOWER]: Advancing to term 8
I20260812 08:02:15.909093  1046 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:15.909472  1046 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 8 election: Requested vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:15.909821   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 8 candidate_status { last_received { term: 6 index: 29 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:02:15.909955   729 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 7 FOLLOWER]: Advancing to term 8
I20260812 08:02:15.910785   729 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 8.
I20260812 08:02:15.911096 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4; no voters: 
I20260812 08:02:15.911291  1046 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 08:02:15.911497  1046 raft_consensus.cc:697] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 8 LEADER]: Becoming Leader. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Running, Role: LEADER
I20260812 08:02:15.911664  1046 consensus_queue.cc:237] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 6.29, Last appended by leader: 29, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:15.912305  1047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 8 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:15.912423  1047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:15.912681  1052 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:15.913549  1052 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]
I20260812 08:02:15.913791  1052 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c]
I20260812 08:02:15.914018  1052 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]
I20260812 08:02:15.914238  1052 catalog_manager.cc:679] Loaded metadata for table default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed]
I20260812 08:02:15.914441  1052 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5]
I20260812 08:02:15.914657  1052 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:02:15.914898  1052 catalog_manager.cc:679] Loaded metadata for table default.table_1_0 [id=e97000987e314ec6867154729c559c3b]
I20260812 08:02:15.915580  1052 tablet_loader.cc:96] loaded metadata for tablet 2385c69cd90e40478e2b5af3af44f0b4 (table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5])
I20260812 08:02:15.915793  1052 tablet_loader.cc:96] loaded metadata for tablet 376519db6a5c4b3b833f976c2c7c1d3d (table default.table_1_0 [id=e97000987e314ec6867154729c559c3b])
I20260812 08:02:15.916002  1052 tablet_loader.cc:96] loaded metadata for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54])
I20260812 08:02:15.916196  1052 tablet_loader.cc:96] loaded metadata for tablet c95b91c169244ddc9740b5b3b2364db5 (table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352])
I20260812 08:02:15.916388  1052 tablet_loader.cc:96] loaded metadata for tablet cdd1a0db7b19430aa4f00dbc4498bf8d (table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c])
I20260812 08:02:15.916585  1052 tablet_loader.cc:96] loaded metadata for tablet d1e4c47b3db54346b8b5fa4f45e4a034 (table default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed])
I20260812 08:02:15.916785  1052 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:02:15.916963  1052 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:15.917358  1052 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:02:15.917402  1052 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:15.917979  1052 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:15.918388  1052 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Loaded TSK: 0
I20260812 08:02:15.918625  1052 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:16.389163   729 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Refusing update from remote peer 815fd2931e984818b4644ca5c9729cd4: Log matching property violated. Preceding OpId in replica: term: 6 index: 27. Preceding OpId from leader: term: 8 index: 30. (index mismatch)
I20260812 08:02:16.389743  1047 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 26, Time since last communication: 0.000s
I20260812 08:02:16.391692  1054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 8 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:16.391886  1054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:16.393414  1046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:16.393551  1046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:16.393579  1054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:16.393724  1054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:16.494611 31899 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:02:16.495069 32389 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:02:16.716784 32141 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
W20260812 08:02:17.322590 32506 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.705s (SENT)
W20260812 08:02:17.703405   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 1.097s (SENT)
I20260812 08:02:17.703526   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:17.703863  1067 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 08:02:18.116287 32506 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 1.103s (SENT)
I20260812 08:02:18.367409  1070 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:18.367542  1070 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:18.368171  1070 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:18.368628 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 30 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:19.618316   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.623s (SENT)
I20260812 08:02:19.618448   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:19.618813  1075 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 08:02:20.371704  1079 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:20.371832  1079 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:20.372233  1079 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:20.372664 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 30 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:21.066669   678 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.693s (SENT) [suppressed 2 similar messages]
W20260812 08:02:21.761245   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.693s (SENT)
I20260812 08:02:21.761373   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:21.761775  1083 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 08:02:22.727185  1086 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:22.727380  1086 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:22.727869  1086 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:22.728276 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 30 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:23.710822 32398 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.124:43465)
I20260812 08:02:23.712635 32540 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51622:
name: "default.table_1_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:23.713161 32540 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:23.722043 31792 tablet_service.cc:1511] Processing CreateTablet for tablet bcd70c2d16324db1bc8271a76f3181fb (DEFAULT_TABLE table=default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:23.722383 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd70c2d16324db1bc8271a76f3181fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:23.722332 32272 tablet_service.cc:1511] Processing CreateTablet for tablet bcd70c2d16324db1bc8271a76f3181fb (DEFAULT_TABLE table=default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:23.722347 32025 tablet_service.cc:1511] Processing CreateTablet for tablet bcd70c2d16324db1bc8271a76f3181fb (DEFAULT_TABLE table=default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:23.722612 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd70c2d16324db1bc8271a76f3181fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:23.722678 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd70c2d16324db1bc8271a76f3181fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:23.724606  1114 tablet_bootstrap.cc:492] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:23.725051  1116 tablet_bootstrap.cc:492] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:23.725594  1115 tablet_bootstrap.cc:492] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:23.725973  1114 tablet_bootstrap.cc:654] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:23.726251  1116 tablet_bootstrap.cc:654] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:23.726774  1115 tablet_bootstrap.cc:654] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:23.727371  1114 tablet_bootstrap.cc:492] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:23.727481  1114 ts_tablet_manager.cc:1403] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:23.727501  1116 tablet_bootstrap.cc:492] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:23.727583  1116 ts_tablet_manager.cc:1403] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:23.727996  1114 raft_consensus.cc:359] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.728125  1114 raft_consensus.cc:385] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:23.728124  1115 tablet_bootstrap.cc:492] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:23.728160  1114 raft_consensus.cc:740] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:23.728209  1115 ts_tablet_manager.cc:1403] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:23.728258  1116 raft_consensus.cc:359] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.728309  1114 consensus_queue.cc:260] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.728369  1116 raft_consensus.cc:385] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:23.728404  1116 raft_consensus.cc:740] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:23.728546  1116 consensus_queue.cc:260] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.728646  1114 ts_tablet_manager.cc:1434] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:23.728814  1116 ts_tablet_manager.cc:1434] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:23.730820  1115 raft_consensus.cc:359] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.730942  1115 raft_consensus.cc:385] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:23.730975  1115 raft_consensus.cc:740] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:23.731145  1115 consensus_queue.cc:260] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.731498  1115 ts_tablet_manager.cc:1434] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.000s
I20260812 08:02:23.743336  1006 raft_consensus.cc:493] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:23.743449  1006 raft_consensus.cc:515] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.743919  1006 leader_election.cc:290] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:02:23.744213 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd70c2d16324db1bc8271a76f3181fb" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:23.744302 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd70c2d16324db1bc8271a76f3181fb" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5" is_pre_election: true
I20260812 08:02:23.744352 32310 raft_consensus.cc:2468] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:23.744427 32059 raft_consensus.cc:2468] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:23.744707 31712 leader_election.cc:304] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:23.744894  1006 raft_consensus.cc:2804] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:23.744951  1006 raft_consensus.cc:493] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:23.744987  1006 raft_consensus.cc:3060] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:23.745783  1006 raft_consensus.cc:515] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.746091  1006 leader_election.cc:290] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Requested vote from peers 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:02:23.746388 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd70c2d16324db1bc8271a76f3181fb" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:23.746501 32310 raft_consensus.cc:3060] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:23.746431 32059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcd70c2d16324db1bc8271a76f3181fb" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5"
I20260812 08:02:23.746683 32059 raft_consensus.cc:3060] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:23.747598 32310 raft_consensus.cc:2468] T bcd70c2d16324db1bc8271a76f3181fb P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:23.747812 32059 raft_consensus.cc:2468] T bcd70c2d16324db1bc8271a76f3181fb P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:23.747892 31712 leader_election.cc:304] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:23.748039  1006 raft_consensus.cc:2804] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:23.748215  1006 raft_consensus.cc:697] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [term 1 LEADER]: Becoming Leader. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Running, Role: LEADER
I20260812 08:02:23.748364  1006 consensus_queue.cc:237] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:23.749984 32535 catalog_manager.cc:5719] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65). New cstate: current_term: 1 leader_uuid: "e2b7a4d926554fb784ee7b1d94f86813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: UNKNOWN } } }
W20260812 08:02:23.757618 31756 tablet_service.cc:3018] Rejecting scan request for tablet bcd70c2d16324db1bc8271a76f3181fb: Uninitialized: clean time has not yet been initialized
W20260812 08:02:23.959463 31756 tablet_service.cc:3018] Rejecting scan request for tablet bcd70c2d16324db1bc8271a76f3181fb: Uninitialized: clean time has not yet been initialized
W20260812 08:02:24.159679   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.714s (SENT)
I20260812 08:02:24.159806   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:24.160137  1129 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 08:02:24.193877  1006 consensus_queue.cc:1048] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:24.198022  1134 consensus_queue.cc:1048] T bcd70c2d16324db1bc8271a76f3181fb P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:24.362226 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.001s	sys 0.001s
I20260812 08:02:24.362850 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 31458
W20260812 08:02:24.378245 32180 connection.cc:573] client connection to 127.26.116.124:43465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:24.378239 32398 connection.cc:573] client connection to 127.26.116.124:43465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:24.378274 31935 connection.cc:573] client connection to 127.26.116.124:43465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:24.378538 32506 connection.cc:573] client connection to 127.26.116.124:43465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:24.378602   678 connection.cc:573] client connection to 127.26.116.124:43465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:24.378628 32506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 2 similar messages]
W20260812 08:02:24.378991   680 connection.cc:573] server connection from 127.0.0.1:42152 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:24.379110 31712 connection.cc:573] client connection to 127.26.116.124:43465 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:24.380178 32506 consensus_peers.cc:597] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 -> Peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Couldn't send request to peer b5e668bf917446e1a1f724f2782788aa. Status: Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:24.493726  1153 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:24.493932  1153 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260812 08:02:24.495823  1153 dir_manager.cc:729] IO error: Could not lock instance file. Make sure that Kudu is not already running and you are not trying to run Kudu with a different user than before: lock /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data/data/block_manager_instance: Resource temporarily unavailable (error 11)
W20260812 08:02:24.495885  1153 dir_manager.cc:730] Proceeding without lock
I20260812 08:02:24.498648  1153 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:24.498878  1153 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-0/wal
uuid: "815fd2931e984818b4644ca5c9729cd4"
format_stamp: "Formatted at 2026-08-12 08:01:34 on dist-test-slave-92m1"
I20260812 08:02:24.511691 27089 master_failover-itest.cc:413] tablet: 00000000000000000000000000000000, peers: 815fd2931e984818b4644ca5c9729cd4 2f1d4089ea8140dfab33d71b320df9df b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:24.625423  1163 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:24.625646  1163 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:24.632056  1163 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/instance:
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:02:24 on dist-test-slave-92m1"
I20260812 08:02:24.635236  1163 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal/instance:
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:02:24 on dist-test-slave-92m1"
I20260812 08:02:24.643778  1163 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.000s
I20260812 08:02:24.772496  1173 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:24.772737  1173 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:24.777485  1173 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:24.779736  1185 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:24.780556  1173 fs_report.cc:389] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:24.780922  1173 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:24.780962  1173 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:02:24 on dist-test-slave-92m1"
W20260812 08:02:24.786373  1188 tool_action_local_replica.cc:343] Start to copy tablet 00000000000000000000000000000000
I20260812 08:02:24.787415  1188 tablet_copy_client.cc:323] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: tablet copy: Beginning tablet copy session from remote peer at address 127.26.116.126:44773
I20260812 08:02:24.796135 32579 tablet_copy_service.cc:140] P 815fd2931e984818b4644ca5c9729cd4: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b5e668bf917446e1a1f724f2782788aa ({username='slave'} at 127.0.0.1:33458)
I20260812 08:02:24.796262 32579 tablet_copy_service.cc:161] P 815fd2931e984818b4644ca5c9729cd4: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b5e668bf917446e1a1f724f2782788aa at {username='slave'} at 127.0.0.1:33458: session id = b5e668bf917446e1a1f724f2782788aa-00000000000000000000000000000000
I20260812 08:02:24.797400 32579 tablet_copy_source_session.cc:215] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:02:24.800976  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 08:02:24.809643  1188 tablet_copy_client.cc:806] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: tablet copy: Starting download of 0 data blocks...
I20260812 08:02:24.811100  1188 tablet_copy_client.cc:670] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: tablet copy: Starting download of 1 WAL segments...
I20260812 08:02:24.815096  1188 tablet_copy_client.cc:538] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:24.820010  1188 tool_action_local_replica.cc:343] Tablet 00000000000000000000000000000000 copy succeed.
I20260812 08:02:24.820071  1188 tool_action_local_replica.cc:343] 1/1 tablets, 11118 bytes copied, include 0 failed tablets.
I20260812 08:02:24.820883 32579 tablet_copy_service.cc:342] P 815fd2931e984818b4644ca5c9729cd4: Request end of tablet copy session b5e668bf917446e1a1f724f2782788aa-00000000000000000000000000000000 received from {username='slave'} at 127.0.0.1:33458
I20260812 08:02:24.821015 32579 tablet_copy_service.cc:434] P 815fd2931e984818b4644ca5c9729cd4: ending tablet copy session b5e668bf917446e1a1f724f2782788aa-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:24.833457 27089 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
/tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:43465
--webserver_interface=127.26.116.124
--webserver_port=0
--builtin_ntp_servers=127.26.116.84:46109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 08:02:24.871851  1216 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:24.871981  1216 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:24.872521  1216 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:24.873008 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 33 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:24.874011   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Network error: Client connection negotiation failed: client connection to 127.26.116.124:43465: connect: Connection refused (error 111)
I20260812 08:02:24.874117   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:24.874253  1216 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260812 08:02:24.943656  1214 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:24.943907  1214 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:24.943976  1214 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:24.947248  1214 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:24.947340  1214 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:24.947378  1214 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:24.947439  1214 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:24.951313  1214 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.116.84:46109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.116.126:44773,127.26.116.125:34993,127.26.116.124:43465
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.116.124:43465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.116.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:24.952857  1214 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:24.954169  1214 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:24.960476  1228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:24.960464  1234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:24.960465  1229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:24.960734  1214 server_base.cc:1061] running on GCE node
I20260812 08:02:24.961264  1214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:24.962296  1214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:24.963481  1214 hybrid_clock.cc:648] HybridClock initialized: now 1786521744963449 us; error 51 us; skew 500 ppm
I20260812 08:02:24.965390  1214 webserver.cc:533] Webserver started at http://127.26.116.124:40809/ using document root <none> and password file <none>
I20260812 08:02:24.965996  1214 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:24.966097  1214 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:24.969681  1214 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:24.971627  1247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:24.972571  1214 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:24.972718  1214 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data,/tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
uuid: "b5e668bf917446e1a1f724f2782788aa"
format_stamp: "Formatted at 2026-08-12 08:02:24 on dist-test-slave-92m1"
I20260812 08:02:24.973126  1214 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:24.995405  1214 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:24.996129  1214 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:24.996333  1214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:25.004248  1327 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.116.124:43465 every 8 connection(s)
I20260812 08:02:25.004261  1214 rpc_server.cc:307] RPC server started. Bound to: 127.26.116.124:43465
I20260812 08:02:25.005476  1214 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskWKFVVJ/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786521664033832-27089-0/minicluster-data/master-2/data/info.pb
I20260812 08:02:25.009430  1328 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:02:25.010254 27089 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu as pid 1214
I20260812 08:02:25.011271  1328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Bootstrap starting.
I20260812 08:02:25.011497 32540 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51622:
name: "default.table_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:25.011981 32540 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:25.019932  1328 log.cc:826] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:25.021345 31792 tablet_service.cc:1511] Processing CreateTablet for tablet ca31138e8f2d4590a7238059a969499c (DEFAULT_TABLE table=default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:25.021685 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca31138e8f2d4590a7238059a969499c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:25.021934 32025 tablet_service.cc:1511] Processing CreateTablet for tablet ca31138e8f2d4590a7238059a969499c (DEFAULT_TABLE table=default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:25.022221 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca31138e8f2d4590a7238059a969499c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:25.023748 32272 tablet_service.cc:1511] Processing CreateTablet for tablet ca31138e8f2d4590a7238059a969499c (DEFAULT_TABLE table=default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:25.024044 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca31138e8f2d4590a7238059a969499c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:25.024397  1345 tablet_bootstrap.cc:492] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:25.024677  1349 tablet_bootstrap.cc:492] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:25.025486  1345 tablet_bootstrap.cc:654] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:25.025780  1349 tablet_bootstrap.cc:654] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:25.026528  1353 tablet_bootstrap.cc:492] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:25.026618  1345 tablet_bootstrap.cc:492] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:25.026698  1345 ts_tablet_manager.cc:1403] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:25.027170  1345 raft_consensus.cc:359] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.027303  1345 raft_consensus.cc:385] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:25.027336  1345 raft_consensus.cc:740] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:25.027484  1345 consensus_queue.cc:260] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.027762  1353 tablet_bootstrap.cc:654] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:25.027796  1345 ts_tablet_manager.cc:1434] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:25.028945  1353 tablet_bootstrap.cc:492] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:25.028980  1349 tablet_bootstrap.cc:492] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:25.029026  1353 ts_tablet_manager.cc:1403] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:25.029062  1349 ts_tablet_manager.cc:1403] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260812 08:02:25.029510  1353 raft_consensus.cc:359] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.029533  1349 raft_consensus.cc:359] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.029624  1353 raft_consensus.cc:385] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:25.029661  1353 raft_consensus.cc:740] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:25.029663  1349 raft_consensus.cc:385] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:25.029702  1349 raft_consensus.cc:740] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:25.029834  1349 consensus_queue.cc:260] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.029837  1353 consensus_queue.cc:260] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.030122  1349 ts_tablet_manager.cc:1434] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:25.030130  1353 ts_tablet_manager.cc:1434] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:25.042474 32383 heartbeater.cc:344] Connected to a master server at 127.26.116.124:43465
I20260812 08:02:25.042773 32139 heartbeater.cc:344] Connected to a master server at 127.26.116.124:43465
I20260812 08:02:25.042807 31897 heartbeater.cc:344] Connected to a master server at 127.26.116.124:43465
I20260812 08:02:25.045791  1328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Bootstrap replayed 1/1 log segments. Stats: ops{read=34 overwritten=1 applied=33 ignored=0} inserts{seen=19 ignored=0} mutations{seen=16 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:25.046260  1328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Bootstrap complete.
I20260812 08:02:25.049331  1328 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:25.049630  1328 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e668bf917446e1a1f724f2782788aa, State: Initialized, Role: FOLLOWER
I20260812 08:02:25.050057  1328 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 33, Last appended: 8.33, Last appended by leader: 33, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:25.050483  1363 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:25.050622  1363 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:25.051118  1328 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:25.056651  1380 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:02:25.056727  1380 catalog_manager.cc:1588] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: loading cluster ID for follower catalog manager: success
I20260812 08:02:25.058843  1380 catalog_manager.cc:1610] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: acquiring CA information for follower catalog manager: success
I20260812 08:02:25.060597  1380 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 08:02:25.088128  1010 raft_consensus.cc:493] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:25.088308  1010 raft_consensus.cc:515] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.088904  1010 leader_election.cc:290] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:25.089303 31829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca31138e8f2d4590a7238059a969499c" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813" is_pre_election: true
I20260812 08:02:25.089460 31829 raft_consensus.cc:2468] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 0.
I20260812 08:02:25.089422 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca31138e8f2d4590a7238059a969499c" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:25.089615 32310 raft_consensus.cc:2468] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 0.
I20260812 08:02:25.089872 31935 leader_election.cc:304] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:25.090178  1010 raft_consensus.cc:2804] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:25.090229  1010 raft_consensus.cc:493] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:25.090256  1010 raft_consensus.cc:3060] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:25.091400  1010 raft_consensus.cc:515] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.091792  1010 leader_election.cc:290] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 election: Requested vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:25.092187 31829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca31138e8f2d4590a7238059a969499c" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813"
I20260812 08:02:25.092232 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca31138e8f2d4590a7238059a969499c" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:25.092307 31829 raft_consensus.cc:3060] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:25.092325 32310 raft_consensus.cc:3060] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:25.093348 31829 raft_consensus.cc:2468] T ca31138e8f2d4590a7238059a969499c P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 1.
I20260812 08:02:25.093348 32310 raft_consensus.cc:2468] T ca31138e8f2d4590a7238059a969499c P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 1.
I20260812 08:02:25.093710 31935 leader_election.cc:304] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:25.094022  1010 raft_consensus.cc:2804] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:25.094300  1010 raft_consensus.cc:697] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Running, Role: LEADER
I20260812 08:02:25.094461  1010 consensus_queue.cc:237] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:25.096571 32540 catalog_manager.cc:5719] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ea7421a364e447a932edf99c67546c5 (127.26.116.66). New cstate: current_term: 1 leader_uuid: "2ea7421a364e447a932edf99c67546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:25.097134  1269 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2ea7421a364e447a932edf99c67546c5" instance_seqno: 1786521693889371) as {username='slave'} at 127.26.116.66:43705; Asking this server to re-register.
I20260812 08:02:25.097698 32139 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:25.099886  1269 ts_manager.cc:194] Registered new tserver with Master: 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
W20260812 08:02:25.123493 31992 tablet_service.cc:3018] Rejecting scan request for tablet ca31138e8f2d4590a7238059a969499c: Uninitialized: clean time has not yet been initialized
W20260812 08:02:25.325544 31992 tablet_service.cc:3018] Rejecting scan request for tablet ca31138e8f2d4590a7238059a969499c: Uninitialized: clean time has not yet been initialized
I20260812 08:02:25.346094  1288 raft_consensus.cc:1217] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.29->[8.30-8.36]   Dedup: 8.33->[8.34-8.36]
I20260812 08:02:25.349431  1363 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 8 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:25.349575  1363 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:25.522596  1387 consensus_queue.cc:1048] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:25.524821  1269 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" instance_seqno: 1786521694081552) as {username='slave'} at 127.26.116.67:58427; Asking this server to re-register.
I20260812 08:02:25.526036 32383 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:25.528167  1269 ts_manager.cc:194] Registered new tserver with Master: 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:25.528717  1010 consensus_queue.cc:1048] T ca31138e8f2d4590a7238059a969499c P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:25.530941  1269 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" instance_seqno: 1786521693700776) as {username='slave'} at 127.26.116.65:60783; Asking this server to re-register.
I20260812 08:02:25.532132 31897 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:25.533151  1269 ts_manager.cc:194] Registered new tserver with Master: e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579)
W20260812 08:02:25.728325 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.607s	user 0.001s	sys 0.001s
I20260812 08:02:25.846851  1363 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:25.847112  1363 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:25.848490  1363 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:25.849052   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:26.016629  1413 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:26.016798  1413 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:26.017354  1413 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:26.021024  1288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:26.021282  1288 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 8.
I20260812 08:02:26.021598   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:02:26.021885  1413 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 08:02:26.021939  1413 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Starting leader election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:26.021970  1413 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 8 FOLLOWER]: Advancing to term 9
I20260812 08:02:26.022867  1413 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:26.023284  1413 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 election: Requested vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:26.023746  1288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa"
I20260812 08:02:26.023867  1288 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 8 FOLLOWER]: Advancing to term 9
I20260812 08:02:26.025641  1288 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 9.
I20260812 08:02:26.026019   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:02:26.026328  1413 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 9 FOLLOWER]: Leader election won for term 9
I20260812 08:02:26.026536  1413 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 9 LEADER]: Becoming Leader. State: Replica: 2f1d4089ea8140dfab33d71b320df9df, State: Running, Role: LEADER
I20260812 08:02:26.026855  1413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 8.36, Last appended by leader: 36, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:26.028049  1419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f1d4089ea8140dfab33d71b320df9df. Latest consensus state: current_term: 9 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:26.028184  1419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:26.028571  1420 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:26.030529  1420 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]
I20260812 08:02:26.030902  1420 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c]
I20260812 08:02:26.031159  1420 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]
I20260812 08:02:26.031433  1420 catalog_manager.cc:679] Loaded metadata for table default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed]
I20260812 08:02:26.031695  1420 catalog_manager.cc:679] Loaded metadata for table default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b]
I20260812 08:02:26.031976  1420 catalog_manager.cc:679] Loaded metadata for table default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d]
I20260812 08:02:26.032222  1420 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5]
I20260812 08:02:26.032446  1420 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:02:26.032685  1420 catalog_manager.cc:679] Loaded metadata for table default.table_1_0 [id=e97000987e314ec6867154729c559c3b]
I20260812 08:02:26.033937  1420 tablet_loader.cc:96] loaded metadata for tablet 2385c69cd90e40478e2b5af3af44f0b4 (table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5])
I20260812 08:02:26.034250  1420 tablet_loader.cc:96] loaded metadata for tablet 376519db6a5c4b3b833f976c2c7c1d3d (table default.table_1_0 [id=e97000987e314ec6867154729c559c3b])
I20260812 08:02:26.034505  1420 tablet_loader.cc:96] loaded metadata for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54])
I20260812 08:02:26.034745  1420 tablet_loader.cc:96] loaded metadata for tablet bcd70c2d16324db1bc8271a76f3181fb (table default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d])
I20260812 08:02:26.034965  1420 tablet_loader.cc:96] loaded metadata for tablet c95b91c169244ddc9740b5b3b2364db5 (table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352])
I20260812 08:02:26.035205  1420 tablet_loader.cc:96] loaded metadata for tablet ca31138e8f2d4590a7238059a969499c (table default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b])
I20260812 08:02:26.035451  1420 tablet_loader.cc:96] loaded metadata for tablet cdd1a0db7b19430aa4f00dbc4498bf8d (table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c])
I20260812 08:02:26.035660  1420 tablet_loader.cc:96] loaded metadata for tablet d1e4c47b3db54346b8b5fa4f45e4a034 (table default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed])
I20260812 08:02:26.035856  1420 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:02:26.035991  1420 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:26.036456  1420 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:02:26.036528  1420 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:26.037266  1420 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:26.037703  1420 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df: Loaded TSK: 0
I20260812 08:02:26.038291  1420 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 08:02:26.373500  1252 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.524s (SENT)
I20260812 08:02:26.498982  1288 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Refusing update from remote peer 2f1d4089ea8140dfab33d71b320df9df: Log matching property violated. Preceding OpId in replica: term: 8 index: 36. Preceding OpId from leader: term: 9 index: 37. (index mismatch)
I20260812 08:02:26.499782  1419 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20260812 08:02:26.501123  1425 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f1d4089ea8140dfab33d71b320df9df. Latest consensus state: current_term: 9 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:26.501261  1425 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:26.502381  1413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:26.502516  1413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:26.502856  1425 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "2f1d4089ea8140dfab33d71b320df9df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:26.502972  1425 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:26.570225   680 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.551s (SENT) [suppressed 2 similar messages]
W20260812 08:02:26.900182  1252 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.524s (SENT)
I20260812 08:02:26.900339  1252 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4
I20260812 08:02:26.900686  1425 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 08:02:27.032876 32390 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
I20260812 08:02:27.036732 31903 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
I20260812 08:02:27.038779 32145 heartbeater.cc:499] Master 127.26.116.125:34993 was elected leader, sending a full tablet report...
W20260812 08:02:27.123018   680 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.551s (SENT)
W20260812 08:02:27.380012   680 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.677s (SENT)
I20260812 08:02:27.888513  1433 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:02:27.888685  1433 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:27.889185  1433 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:27.889776   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
W20260812 08:02:29.024336  1252 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.566s (SENT)
I20260812 08:02:29.024498  1252 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4
I20260812 08:02:29.024930  1440 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 08:02:29.803001  1442 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:02:29.803172  1442 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:29.803715  1442 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:29.804351   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
W20260812 08:02:30.916440  1252 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.555s (SENT)
I20260812 08:02:30.916576  1252 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4
I20260812 08:02:30.917019  1447 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 08:02:34.542594 31899 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:44773 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.126:44773 timed out after 1.000s (SENT)
I20260812 08:02:34.564196  1457 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:02:34.564327  1457 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:34.564806  1457 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:34.565263   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
W20260812 08:02:35.042687 32141 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:44773 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.126:44773 timed out after 1.000s (SENT)
W20260812 08:02:35.244282  1252 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.678s (SENT) [suppressed 2 similar messages]
W20260812 08:02:35.742079 32399 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.126:44773)
I20260812 08:02:35.744470   714 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53416:
name: "default.table_2_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:35.748061   714 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:35.763384 31792 tablet_service.cc:1511] Processing CreateTablet for tablet 80c1ee736f9e41f894b5a577f2f9d3bd (DEFAULT_TABLE table=default.table_2_0 [id=ec2bd41acdfb4d0b9593b4140037fc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:35.763739 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c1ee736f9e41f894b5a577f2f9d3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:35.764665 32025 tablet_service.cc:1511] Processing CreateTablet for tablet 80c1ee736f9e41f894b5a577f2f9d3bd (DEFAULT_TABLE table=default.table_2_0 [id=ec2bd41acdfb4d0b9593b4140037fc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:35.764976 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c1ee736f9e41f894b5a577f2f9d3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:35.766270 32272 tablet_service.cc:1511] Processing CreateTablet for tablet 80c1ee736f9e41f894b5a577f2f9d3bd (DEFAULT_TABLE table=default.table_2_0 [id=ec2bd41acdfb4d0b9593b4140037fc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:35.766574 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c1ee736f9e41f894b5a577f2f9d3bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:35.766789  1488 tablet_bootstrap.cc:492] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:35.767092  1490 tablet_bootstrap.cc:492] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:35.767966  1488 tablet_bootstrap.cc:654] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:35.768180  1490 tablet_bootstrap.cc:654] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:35.769205  1488 tablet_bootstrap.cc:492] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:35.769302  1488 ts_tablet_manager.cc:1403] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:35.769315  1497 tablet_bootstrap.cc:492] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:35.769750  1488 raft_consensus.cc:359] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.769852  1488 raft_consensus.cc:385] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:35.769877  1488 raft_consensus.cc:740] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:35.770040  1488 consensus_queue.cc:260] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.770300  1497 tablet_bootstrap.cc:654] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:35.770351  1488 ts_tablet_manager.cc:1434] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:35.770807  1490 tablet_bootstrap.cc:492] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:35.771631  1497 tablet_bootstrap.cc:492] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:35.771709  1490 ts_tablet_manager.cc:1403] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.000s
I20260812 08:02:35.771725  1497 ts_tablet_manager.cc:1403] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:35.772135  1497 raft_consensus.cc:359] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.772209  1497 raft_consensus.cc:385] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:35.772230  1497 raft_consensus.cc:740] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:35.772248  1490 raft_consensus.cc:359] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.772351  1490 raft_consensus.cc:385] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:35.772388  1490 raft_consensus.cc:740] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:35.772365  1497 consensus_queue.cc:260] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.772514  1490 consensus_queue.cc:260] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.772648  1497 ts_tablet_manager.cc:1434] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:35.773417  1490 ts_tablet_manager.cc:1434] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:35.878901  1463 raft_consensus.cc:493] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:35.879057  1463 raft_consensus.cc:515] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.879521  1463 leader_election.cc:290] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:35.879927 31830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c1ee736f9e41f894b5a577f2f9d3bd" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813" is_pre_election: true
I20260812 08:02:35.880012 32308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c1ee736f9e41f894b5a577f2f9d3bd" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:35.880089 31830 raft_consensus.cc:2468] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 0.
I20260812 08:02:35.880205 32308 raft_consensus.cc:2468] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 0.
I20260812 08:02:35.880496 31935 leader_election.cc:304] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:35.880712  1463 raft_consensus.cc:2804] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:35.880777  1463 raft_consensus.cc:493] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:35.880805  1463 raft_consensus.cc:3060] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:35.881717  1463 raft_consensus.cc:515] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.882073  1463 leader_election.cc:290] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 election: Requested vote from peers e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65:45579), 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239)
I20260812 08:02:35.882418 31830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c1ee736f9e41f894b5a577f2f9d3bd" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b7a4d926554fb784ee7b1d94f86813"
I20260812 08:02:35.882464 32308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c1ee736f9e41f894b5a577f2f9d3bd" candidate_uuid: "2ea7421a364e447a932edf99c67546c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:35.882546 31830 raft_consensus.cc:3060] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:35.882584 32308 raft_consensus.cc:3060] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:35.883503 31830 raft_consensus.cc:2468] T 80c1ee736f9e41f894b5a577f2f9d3bd P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 1.
I20260812 08:02:35.883546 32308 raft_consensus.cc:2468] T 80c1ee736f9e41f894b5a577f2f9d3bd P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ea7421a364e447a932edf99c67546c5 in term 1.
I20260812 08:02:35.883833 31935 leader_election.cc:304] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:35.884006  1463 raft_consensus.cc:2804] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:35.884109  1463 raft_consensus.cc:697] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [term 1 LEADER]: Becoming Leader. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Running, Role: LEADER
I20260812 08:02:35.884248  1463 consensus_queue.cc:237] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } }
I20260812 08:02:35.886183   717 catalog_manager.cc:5719] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ea7421a364e447a932edf99c67546c5 (127.26.116.66). New cstate: current_term: 1 leader_uuid: "2ea7421a364e447a932edf99c67546c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } }
W20260812 08:02:35.919102 31992 tablet_service.cc:3018] Rejecting scan request for tablet 80c1ee736f9e41f894b5a577f2f9d3bd: Uninitialized: clean time has not yet been initialized
W20260812 08:02:35.924563  1252 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773): Timed out: RequestConsensusVote RPC to 127.26.116.126:44773 timed out after 0.678s (SENT)
I20260812 08:02:35.924672  1252 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5e668bf917446e1a1f724f2782788aa; no voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4
I20260812 08:02:35.925042  1502 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260812 08:02:36.042819 32389 heartbeater.cc:646] Failed to heartbeat to 127.26.116.126:44773 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.116.126:44773 timed out after 1.000s (SENT)
W20260812 08:02:36.120992 31992 tablet_service.cc:3018] Rejecting scan request for tablet 80c1ee736f9e41f894b5a577f2f9d3bd: Uninitialized: clean time has not yet been initialized
I20260812 08:02:36.316490  1463 consensus_queue.cc:1048] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:36.320699  1510 consensus_queue.cc:1048] T 80c1ee736f9e41f894b5a577f2f9d3bd P 2ea7421a364e447a932edf99c67546c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:36.523857 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.607s	user 0.001s	sys 0.001s
I20260812 08:02:36.526714 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.526953 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.527091 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.527248 32543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:36.527283 32532 catalog_manager.cc:5552] Ignoring report from unknown tablet 80c1ee736f9e41f894b5a577f2f9d3bd
I20260812 08:02:36.527393 32549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.527523 32552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.527653 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.528370  1336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:36.528482  1336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:36.528604 32547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.528815 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.528894 32555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 37 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.529034 32545 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 8 LEADER]: Stepping down as leader of term 8
I20260812 08:02:36.529099 32545 raft_consensus.cc:740] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Running, Role: LEADER
I20260812 08:02:36.529268 32545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 8.36, Last appended by leader: 36, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:36.529397 32545 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 8 FOLLOWER]: Advancing to term 9
I20260812 08:02:36.528813 32553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:02:36.530251  1288 raft_consensus.cc:1240] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Rejecting Update request from peer 815fd2931e984818b4644ca5c9729cd4 for earlier term 8. Current term is 9. Ops: []
I20260812 08:02:36.530612 32545 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 9 FOLLOWER]: Refusing update from remote peer 2f1d4089ea8140dfab33d71b320df9df: Log matching property violated. Preceding OpId in replica: term: 8 index: 36. Preceding OpId from leader: term: 9 index: 37. (index mismatch)
I20260812 08:02:36.529106 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 9 candidate_status { last_received { term: 8 index: 36 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:02:36.531703 32558 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f1d4089ea8140dfab33d71b320df9df in term 9.
W20260812 08:02:36.535938  1522 catalog_manager.cc:1445] Failed waiting for node to catch up after master election: Illegal state: Node 815fd2931e984818b4644ca5c9729cd4 not leader. Raft Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:36.961630  1524 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:02:36.961807  1524 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:36.962263  1524 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:36.962741 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 40 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
I20260812 08:02:36.962909 32558 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 9.
I20260812 08:02:36.963259  1252 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:02:36.963462  1524 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 08:02:36.963538  1524 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2f1d4089ea8140dfab33d71b320df9df)
I20260812 08:02:36.963593  1524 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 9 FOLLOWER]: Advancing to term 10
I20260812 08:02:36.964624  1524 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:36.965101  1524 leader_election.cc:290] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 election: Requested vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993)
I20260812 08:02:36.965301 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 40 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4"
I20260812 08:02:36.965430 32558 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 9 FOLLOWER]: Advancing to term 10
I20260812 08:02:36.966303 32558 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e668bf917446e1a1f724f2782788aa in term 10.
I20260812 08:02:36.966629  1252 leader_election.cc:304] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa; no voters: 
I20260812 08:02:36.966792  1524 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 10 FOLLOWER]: Leader election won for term 10
I20260812 08:02:36.966989  1524 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 10 LEADER]: Becoming Leader. State: Replica: b5e668bf917446e1a1f724f2782788aa, State: Running, Role: LEADER
I20260812 08:02:36.967371  1524 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 9.40, Last appended by leader: 40, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:36.968381  1525 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e668bf917446e1a1f724f2782788aa. Latest consensus state: current_term: 10 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:36.968500  1525 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:36.968770  1527 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:36.970291  1527 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]
I20260812 08:02:36.970635  1527 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c]
I20260812 08:02:36.970916  1527 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]
I20260812 08:02:36.971156  1527 catalog_manager.cc:679] Loaded metadata for table default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed]
I20260812 08:02:36.971438  1527 catalog_manager.cc:679] Loaded metadata for table default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b]
I20260812 08:02:36.971679  1527 catalog_manager.cc:679] Loaded metadata for table default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d]
I20260812 08:02:36.971901  1527 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5]
I20260812 08:02:36.972115  1527 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:02:36.972330  1527 catalog_manager.cc:679] Loaded metadata for table default.table_1_0 [id=e97000987e314ec6867154729c559c3b]
I20260812 08:02:36.972544  1527 catalog_manager.cc:679] Loaded metadata for table default.table_2_0 [id=ec2bd41acdfb4d0b9593b4140037fc6c]
I20260812 08:02:36.973620  1527 tablet_loader.cc:96] loaded metadata for tablet 2385c69cd90e40478e2b5af3af44f0b4 (table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5])
I20260812 08:02:36.973868  1527 tablet_loader.cc:96] loaded metadata for tablet 376519db6a5c4b3b833f976c2c7c1d3d (table default.table_1_0 [id=e97000987e314ec6867154729c559c3b])
I20260812 08:02:36.974069  1527 tablet_loader.cc:96] loaded metadata for tablet 80c1ee736f9e41f894b5a577f2f9d3bd (table default.table_2_0 [id=ec2bd41acdfb4d0b9593b4140037fc6c])
I20260812 08:02:36.974261  1527 tablet_loader.cc:96] loaded metadata for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54])
I20260812 08:02:36.974447  1527 tablet_loader.cc:96] loaded metadata for tablet bcd70c2d16324db1bc8271a76f3181fb (table default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d])
I20260812 08:02:36.974632  1527 tablet_loader.cc:96] loaded metadata for tablet c95b91c169244ddc9740b5b3b2364db5 (table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352])
I20260812 08:02:36.974819  1527 tablet_loader.cc:96] loaded metadata for tablet ca31138e8f2d4590a7238059a969499c (table default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b])
I20260812 08:02:36.975004  1527 tablet_loader.cc:96] loaded metadata for tablet cdd1a0db7b19430aa4f00dbc4498bf8d (table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c])
I20260812 08:02:36.975186  1527 tablet_loader.cc:96] loaded metadata for tablet d1e4c47b3db54346b8b5fa4f45e4a034 (table default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed])
I20260812 08:02:36.975404  1527 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:02:36.975528  1527 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:36.975965  1527 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:02:36.976030  1527 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:36.976596  1527 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:36.977104  1527 catalog_manager.cc:6103] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa: Loaded TSK: 0
I20260812 08:02:36.977789  1527 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 08:02:37.079993 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.503240 32558 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Refusing update from remote peer b5e668bf917446e1a1f724f2782788aa: Log matching property violated. Preceding OpId in replica: term: 8 index: 36. Preceding OpId from leader: term: 10 index: 41. (index mismatch)
I20260812 08:02:37.503835  1531 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 36, Time since last communication: 0.000s
I20260812 08:02:37.506592  1534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e668bf917446e1a1f724f2782788aa. Latest consensus state: current_term: 10 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:37.506928  1534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:37.507123  1541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:37.507299  1541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:37.507287  1545 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 10 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:37.507640  1545 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:37.507863  1541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "b5e668bf917446e1a1f724f2782788aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:37.507974  1541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 08:02:37.599843 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:37.705668 32139 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
I20260812 08:02:37.826283 32383 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
I20260812 08:02:37.827912 31897 heartbeater.cc:499] Master 127.26.116.124:43465 was elected leader, sending a full tablet report...
W20260812 08:02:38.031105  1252 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.533s (SENT)
W20260812 08:02:38.071503  1252 leader_election.cc:336] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.552s (SENT)
W20260812 08:02:38.194128 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:38.431819  1552 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:38.431958  1552 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:38.432533  1552 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:38.432997  1288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:38.726198 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:39.017123 32507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.583s (SENT) [suppressed 1 similar messages]
W20260812 08:02:39.261929 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:39.601989 32507 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.583s (SENT)
I20260812 08:02:39.602120 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:39.602464  1555 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 08:02:39.737347 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:40.303792 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:40.878509 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:41.386951  1562 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:41.387127  1562 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:41.387785  1562 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:41.388249  1288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:41.427985 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:42.013628 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:42.427520 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:42.646363 32507 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.628s (SENT)
I20260812 08:02:42.646538 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:42.646940  1577 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 08:02:42.822610 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:43.265493 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:43.800994 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:44.255535 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:44.277055  1581 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:44.277251  1581 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:44.277751  1581 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:44.278194  1288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:44.682099 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:44.815981 32507 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.537s (SENT) [suppressed 1 similar messages]
W20260812 08:02:45.159785 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:45.354809 32507 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993): Timed out: RequestConsensusVote RPC to 127.26.116.125:34993 timed out after 0.537s (SENT)
I20260812 08:02:45.354919 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:45.355331  1592 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 08:02:45.605293 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:46.090140 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:46.472509 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:46.537060 32399 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.125:34993)
I20260812 08:02:46.538877  1269 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47666:
name: "default.table_2_1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:46.541879  1269 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2_1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:46.557539 32025 tablet_service.cc:1511] Processing CreateTablet for tablet 712d60ecc6d0431480b2a4257c7b7fd3 (DEFAULT_TABLE table=default.table_2_1 [id=6543e302d0a34fac9d0a8ea7b37a98fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:46.557928 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712d60ecc6d0431480b2a4257c7b7fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:46.558046 31792 tablet_service.cc:1511] Processing CreateTablet for tablet 712d60ecc6d0431480b2a4257c7b7fd3 (DEFAULT_TABLE table=default.table_2_1 [id=6543e302d0a34fac9d0a8ea7b37a98fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:46.558197 32272 tablet_service.cc:1511] Processing CreateTablet for tablet 712d60ecc6d0431480b2a4257c7b7fd3 (DEFAULT_TABLE table=default.table_2_1 [id=6543e302d0a34fac9d0a8ea7b37a98fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:46.558343 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712d60ecc6d0431480b2a4257c7b7fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:46.558470 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 712d60ecc6d0431480b2a4257c7b7fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:46.560274  1614 tablet_bootstrap.cc:492] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:46.560685  1616 tablet_bootstrap.cc:492] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:46.561614  1614 tablet_bootstrap.cc:654] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:46.561808  1616 tablet_bootstrap.cc:654] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:46.562544  1617 tablet_bootstrap.cc:492] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:46.562846  1614 tablet_bootstrap.cc:492] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:46.562937  1614 ts_tablet_manager.cc:1403] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:46.563699  1617 tablet_bootstrap.cc:654] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:46.563771  1616 tablet_bootstrap.cc:492] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:46.563897  1616 ts_tablet_manager.cc:1403] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:46.564262  1614 raft_consensus.cc:359] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.564409  1614 raft_consensus.cc:385] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:46.564364  1616 raft_consensus.cc:359] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.564481  1616 raft_consensus.cc:385] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:46.564536  1614 raft_consensus.cc:740] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:46.564581  1616 raft_consensus.cc:740] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:46.564729  1614 consensus_queue.cc:260] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.564745  1616 consensus_queue.cc:260] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.565608  1617 tablet_bootstrap.cc:492] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:46.565759  1617 ts_tablet_manager.cc:1403] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:46.566262  1616 ts_tablet_manager.cc:1434] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:46.566783  1617 raft_consensus.cc:359] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.566910  1617 raft_consensus.cc:385] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:46.566943  1617 raft_consensus.cc:740] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:46.567127  1617 consensus_queue.cc:260] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.569677  1614 ts_tablet_manager.cc:1434] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.000s
I20260812 08:02:46.570520  1617 ts_tablet_manager.cc:1434] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
W20260812 08:02:46.581648 31905 tablet.cc:2406] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:46.679738  1580 raft_consensus.cc:493] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:46.679904  1580 raft_consensus.cc:515] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.680529  1580 leader_election.cc:290] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:02:46.681008 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712d60ecc6d0431480b2a4257c7b7fd3" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:46.681061 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712d60ecc6d0431480b2a4257c7b7fd3" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5" is_pre_election: true
I20260812 08:02:46.681191 32310 raft_consensus.cc:2468] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:46.681281 32058 raft_consensus.cc:2468] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:46.681679 31715 leader_election.cc:304] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2ea7421a364e447a932edf99c67546c5, 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:46.681896  1580 raft_consensus.cc:2804] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:46.681974  1580 raft_consensus.cc:493] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:46.682029  1580 raft_consensus.cc:3060] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:46.683019  1580 raft_consensus.cc:515] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.683459  1580 leader_election.cc:290] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Requested vote from peers 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:02:46.683848 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712d60ecc6d0431480b2a4257c7b7fd3" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5"
I20260812 08:02:46.683872 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "712d60ecc6d0431480b2a4257c7b7fd3" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:46.683972 32058 raft_consensus.cc:3060] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:46.684003 32310 raft_consensus.cc:3060] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:46.684821 32310 raft_consensus.cc:2468] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:46.684975 32058 raft_consensus.cc:2468] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:46.685171 31712 leader_election.cc:304] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:46.685369  1580 raft_consensus.cc:2804] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:46.685583  1580 raft_consensus.cc:697] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 LEADER]: Becoming Leader. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Running, Role: LEADER
I20260812 08:02:46.685945  1580 consensus_queue.cc:237] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } }
I20260812 08:02:46.687948  1271 catalog_manager.cc:5719] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65). New cstate: current_term: 1 leader_uuid: "e2b7a4d926554fb784ee7b1d94f86813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: HEALTHY } } }
W20260812 08:02:46.707952 31756 tablet_service.cc:3018] Rejecting scan request for tablet 712d60ecc6d0431480b2a4257c7b7fd3: Uninitialized: clean time has not yet been initialized
W20260812 08:02:46.713119 32392 tablet.cc:2406] T 712d60ecc6d0431480b2a4257c7b7fd3 P 3785b50895f74e12b7723aa0162c02c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:46.767613 32147 tablet.cc:2406] T 712d60ecc6d0431480b2a4257c7b7fd3 P 2ea7421a364e447a932edf99c67546c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:46.910218 31756 tablet_service.cc:3018] Rejecting scan request for tablet 712d60ecc6d0431480b2a4257c7b7fd3: Uninitialized: clean time has not yet been initialized
W20260812 08:02:46.939272 32508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:47.192287  1625 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:47.192462  1625 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:47.193032  1625 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:47.193414  1288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:47.209564  1580 consensus_queue.cc:1048] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:47.215754  1630 consensus_queue.cc:1048] T 712d60ecc6d0431480b2a4257c7b7fd3 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:47.313265 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.608s	user 0.002s	sys 0.000s
I20260812 08:02:47.314179   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 40 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.314529   730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 40 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:02:47.314720  1519 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [LEADER]: Connected to new peer: Peer: permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20260812 08:02:47.315714   726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 40 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:02:47.316017   726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.316293   727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e668bf917446e1a1f724f2782788aa" candidate_term: 10 candidate_status { last_received { term: 9 index: 40 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.316581   728 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 9 LEADER]: Stepping down as leader of term 9
I20260812 08:02:47.316644   728 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2f1d4089ea8140dfab33d71b320df9df, State: Running, Role: LEADER
I20260812 08:02:47.316845   719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.316825   728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 9.40, Last appended by leader: 40, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:47.317081   720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.317113   728 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 9 FOLLOWER]: Advancing to term 10
I20260812 08:02:47.317291   722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.317493   724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.317720   725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.318285 32558 raft_consensus.cc:1217] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 8.36->[9.37-9.40]   Dedup: 9.40->[]
I20260812 08:02:47.318399 32558 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Rejecting Update request from peer 2f1d4089ea8140dfab33d71b320df9df for earlier term 9. Current term is 10. Ops: [9.37-9.40]
I20260812 08:02:47.318387   728 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 10 FOLLOWER]: Refusing update from remote peer b5e668bf917446e1a1f724f2782788aa: Log matching property violated. Preceding OpId in replica: term: 9 index: 40. Preceding OpId from leader: term: 10 index: 41. (index mismatch)
I20260812 08:02:47.320771   730 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 10 FOLLOWER]: Rejecting Update request from peer 815fd2931e984818b4644ca5c9729cd4 for earlier term 8. Current term is 10. Ops: []
I20260812 08:02:47.321125   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 41 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.321247   729 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 10.
I20260812 08:02:47.322145 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 815fd2931e984818b4644ca5c9729cd4; no voters: 2f1d4089ea8140dfab33d71b320df9df, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:47.322607  1625 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260812 08:02:47.941733  1643 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:47.941920  1643 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:47.942413  1643 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:47.942960   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df" is_pre_election: true
I20260812 08:02:47.943142   729 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 10.
I20260812 08:02:47.943585 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4; no voters: 
I20260812 08:02:47.943941  1643 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 08:02:47.944000  1643 raft_consensus.cc:493] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b5e668bf917446e1a1f724f2782788aa)
I20260812 08:02:47.944029  1643 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 10 FOLLOWER]: Advancing to term 11
I20260812 08:02:47.945004  1643 raft_consensus.cc:515] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:47.945389  1643 leader_election.cc:290] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 election: Requested vote from peers 2f1d4089ea8140dfab33d71b320df9df (127.26.116.125:34993), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:47.945832   729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "2f1d4089ea8140dfab33d71b320df9df"
I20260812 08:02:47.945956   729 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 10 FOLLOWER]: Advancing to term 11
I20260812 08:02:47.946766   729 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 815fd2931e984818b4644ca5c9729cd4 in term 11.
I20260812 08:02:47.947109 32507 leader_election.cc:304] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df, 815fd2931e984818b4644ca5c9729cd4; no voters: 
I20260812 08:02:47.947365  1643 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 08:02:47.947556  1643 raft_consensus.cc:697] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 11 LEADER]: Becoming Leader. State: Replica: 815fd2931e984818b4644ca5c9729cd4, State: Running, Role: LEADER
I20260812 08:02:47.947727  1643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 10.44, Last appended by leader: 44, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:47.948432  1646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 11 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:47.948557  1646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:47.948813  1650 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:47.949753  1650 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352]
I20260812 08:02:47.949986  1650 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c]
I20260812 08:02:47.950246  1650 catalog_manager.cc:679] Loaded metadata for table default.table_2_1 [id=6543e302d0a34fac9d0a8ea7b37a98fc]
I20260812 08:02:47.950453  1650 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54]
I20260812 08:02:47.950663  1650 catalog_manager.cc:679] Loaded metadata for table default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed]
I20260812 08:02:47.950865  1650 catalog_manager.cc:679] Loaded metadata for table default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b]
I20260812 08:02:47.951069  1650 catalog_manager.cc:679] Loaded metadata for table default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d]
I20260812 08:02:47.951308  1650 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5]
I20260812 08:02:47.951526  1650 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993]
I20260812 08:02:47.951802  1650 catalog_manager.cc:679] Loaded metadata for table default.table_1_0 [id=e97000987e314ec6867154729c559c3b]
I20260812 08:02:47.952059  1650 catalog_manager.cc:679] Loaded metadata for table default.table_2_0 [id=ec2bd41acdfb4d0b9593b4140037fc6c]
I20260812 08:02:47.952713  1650 tablet_loader.cc:96] loaded metadata for tablet 2385c69cd90e40478e2b5af3af44f0b4 (table default.table_0_2 [id=df0d29e54cae4e1593d4f6d75f11bac5])
I20260812 08:02:47.952936  1650 tablet_loader.cc:96] loaded metadata for tablet 376519db6a5c4b3b833f976c2c7c1d3d (table default.table_1_0 [id=e97000987e314ec6867154729c559c3b])
I20260812 08:02:47.953140  1650 tablet_loader.cc:96] loaded metadata for tablet 712d60ecc6d0431480b2a4257c7b7fd3 (table default.table_2_1 [id=6543e302d0a34fac9d0a8ea7b37a98fc])
I20260812 08:02:47.953372  1650 tablet_loader.cc:96] loaded metadata for tablet 80c1ee736f9e41f894b5a577f2f9d3bd (table default.table_2_0 [id=ec2bd41acdfb4d0b9593b4140037fc6c])
I20260812 08:02:47.953569  1650 tablet_loader.cc:96] loaded metadata for tablet 80c24d7cc55a4b4d966ab1a77c67b1da (table default.table_0_1 [id=65d0457da56c4a399809f863bb4a1b54])
I20260812 08:02:47.953768  1650 tablet_loader.cc:96] loaded metadata for tablet bcd70c2d16324db1bc8271a76f3181fb (table default.table_1_2 [id=ddc20842e7a74ee8b91d78dd30a4275d])
I20260812 08:02:47.953960  1650 tablet_loader.cc:96] loaded metadata for tablet c95b91c169244ddc9740b5b3b2364db5 (table default.table_0_0 [id=521074ae51564fc1bf01e83f1d7d7352])
I20260812 08:02:47.954149  1650 tablet_loader.cc:96] loaded metadata for tablet ca31138e8f2d4590a7238059a969499c (table default.table_2 [id=b0d72051ebf448e2a116a9216301fb9b])
I20260812 08:02:47.954336  1650 tablet_loader.cc:96] loaded metadata for tablet cdd1a0db7b19430aa4f00dbc4498bf8d (table default.table_1 [id=5ec6e5a8c652426c8f02404c9fa61f2c])
I20260812 08:02:47.954524  1650 tablet_loader.cc:96] loaded metadata for tablet d1e4c47b3db54346b8b5fa4f45e4a034 (table default.table_1_1 [id=777ba8cfa6ba4c6e9d32cc364c9918ed])
I20260812 08:02:47.954790  1650 tablet_loader.cc:96] loaded metadata for tablet fdbfffc974504dd0a6b0d397b66a6bbf (table default.table_0 [id=df6299a14a8a45e3ab1d178743bbc993])
I20260812 08:02:47.955027  1650 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:47.955503  1650 catalog_manager.cc:1295] Loaded cluster ID: ff9b3b6c8ab34f1d976f9ae78a28458c
I20260812 08:02:47.955549  1650 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:47.956126  1650 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:47.956568  1650 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4: Loaded TSK: 0
I20260812 08:02:47.956822  1650 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:48.427453   729 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Refusing update from remote peer 815fd2931e984818b4644ca5c9729cd4: Log matching property violated. Preceding OpId in replica: term: 9 index: 40. Preceding OpId from leader: term: 11 index: 45. (index mismatch)
I20260812 08:02:48.428196  1646 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 40, Time since last communication: 0.000s
I20260812 08:02:48.431366  1657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 11 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:48.431538  1657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:48.431717  1651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 11 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:48.431819  1651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:48.432292  1646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 11 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:48.432422  1646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:48.432875  1654 mvcc.cc:204] Tried to move back new op lower bound from 7317593156358430720 to 7317593116540612608. Current Snapshot: MvccSnapshot[applied={T|T < 7317593156358430720}]
I20260812 08:02:48.433290  1651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 11 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:48.433410  1651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:48.713436 31899 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:02:48.718703 32389 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
I20260812 08:02:48.723171 32141 heartbeater.cc:499] Master 127.26.116.126:44773 was elected leader, sending a full tablet report...
W20260812 08:02:49.147190 32506 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.600s (SENT)
I20260812 08:02:49.318701  1664 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:49.318881  1664 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:49.319681  1664 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:49.320186 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:49.406577 32506 leader_election.cc:336] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.731s (SENT)
W20260812 08:02:49.921834   678 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.601s (SENT) [suppressed 1 similar messages]
W20260812 08:02:50.525421   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.601s (SENT)
I20260812 08:02:50.525568   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:50.526013  1676 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 08:02:52.240056  1679 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:52.240195  1679 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:52.241043  1679 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:52.241354 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:53.694527   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.725s (SENT)
I20260812 08:02:53.694643   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:53.695084  1685 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 08:02:54.620817  1689 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:54.620990  1689 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:54.621487  1689 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:54.621927 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:55.177825   678 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.555s (SENT) [suppressed 1 similar messages]
W20260812 08:02:55.733721   678 leader_election.cc:336] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465): Timed out: RequestConsensusVote RPC to 127.26.116.124:43465 timed out after 0.555s (SENT)
I20260812 08:02:55.733853   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
I20260812 08:02:55.734275  1693 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260812 08:02:57.326360 32398 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.116.124:43465)
I20260812 08:02:57.327997 32532 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51622:
name: "default.table_2_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:57.328507 32532 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:57.337471 31792 tablet_service.cc:1511] Processing CreateTablet for tablet 15a03abb46604cf28a4ffc0b110bad26 (DEFAULT_TABLE table=default.table_2_2 [id=70bc1a4f06ad4b54908262d1df97fd7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:57.337842 31792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a03abb46604cf28a4ffc0b110bad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.337836 32272 tablet_service.cc:1511] Processing CreateTablet for tablet 15a03abb46604cf28a4ffc0b110bad26 (DEFAULT_TABLE table=default.table_2_2 [id=70bc1a4f06ad4b54908262d1df97fd7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:57.337954 32025 tablet_service.cc:1511] Processing CreateTablet for tablet 15a03abb46604cf28a4ffc0b110bad26 (DEFAULT_TABLE table=default.table_2_2 [id=70bc1a4f06ad4b54908262d1df97fd7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:57.338165 32272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a03abb46604cf28a4ffc0b110bad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.338238 32025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a03abb46604cf28a4ffc0b110bad26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.340305  1720 tablet_bootstrap.cc:492] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5: Bootstrap starting.
I20260812 08:02:57.341344  1722 tablet_bootstrap.cc:492] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813: Bootstrap starting.
I20260812 08:02:57.341478  1720 tablet_bootstrap.cc:654] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.342403  1725 tablet_bootstrap.cc:492] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5: Bootstrap starting.
I20260812 08:02:57.342614  1720 tablet_bootstrap.cc:492] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5: No bootstrap required, opened a new log
I20260812 08:02:57.342722  1720 ts_tablet_manager.cc:1403] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:57.342730  1722 tablet_bootstrap.cc:654] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.343245  1720 raft_consensus.cc:359] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.343393  1720 raft_consensus.cc:385] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:57.343463  1720 raft_consensus.cc:740] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea7421a364e447a932edf99c67546c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.343622  1720 consensus_queue.cc:260] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.343708  1725 tablet_bootstrap.cc:654] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.344110  1720 ts_tablet_manager.cc:1434] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20260812 08:02:57.344904  1722 tablet_bootstrap.cc:492] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813: No bootstrap required, opened a new log
I20260812 08:02:57.345052  1722 ts_tablet_manager.cc:1403] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260812 08:02:57.345675  1722 raft_consensus.cc:359] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.345752  1725 tablet_bootstrap.cc:492] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5: No bootstrap required, opened a new log
I20260812 08:02:57.345841  1725 ts_tablet_manager.cc:1403] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:02:57.345858  1722 raft_consensus.cc:385] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:57.345906  1722 raft_consensus.cc:740] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.346055  1722 consensus_queue.cc:260] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.346415  1725 raft_consensus.cc:359] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.346700  1725 raft_consensus.cc:385] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:57.346812  1725 raft_consensus.cc:740] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3785b50895f74e12b7723aa0162c02c5, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.346992  1725 consensus_queue.cc:260] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.347954  1725 ts_tablet_manager.cc:1434] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:57.349391  1697 raft_consensus.cc:493] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:57.349498  1697 raft_consensus.cc:515] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.349901  1697 leader_election.cc:290] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:02:57.350519 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a03abb46604cf28a4ffc0b110bad26" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5" is_pre_election: true
I20260812 08:02:57.350642 32310 raft_consensus.cc:2468] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:57.350888 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a03abb46604cf28a4ffc0b110bad26" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5" is_pre_election: true
I20260812 08:02:57.351035 32058 raft_consensus.cc:2468] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 0.
I20260812 08:02:57.351336 31712 leader_election.cc:304] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:57.351634  1697 raft_consensus.cc:2804] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:57.351694  1697 raft_consensus.cc:493] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:57.351752  1697 raft_consensus.cc:3060] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.352906  1697 raft_consensus.cc:515] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.353299  1697 leader_election.cc:290] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Requested vote from peers 3785b50895f74e12b7723aa0162c02c5 (127.26.116.67:39239), 2ea7421a364e447a932edf99c67546c5 (127.26.116.66:42831)
I20260812 08:02:57.353566 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a03abb46604cf28a4ffc0b110bad26" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3785b50895f74e12b7723aa0162c02c5"
I20260812 08:02:57.353653 32058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a03abb46604cf28a4ffc0b110bad26" candidate_uuid: "e2b7a4d926554fb784ee7b1d94f86813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ea7421a364e447a932edf99c67546c5"
I20260812 08:02:57.353683 32310 raft_consensus.cc:3060] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.353677  1722 ts_tablet_manager.cc:1434] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.000s
I20260812 08:02:57.353760 32058 raft_consensus.cc:3060] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.354694 32058 raft_consensus.cc:2468] T 15a03abb46604cf28a4ffc0b110bad26 P 2ea7421a364e447a932edf99c67546c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:57.354694 32310 raft_consensus.cc:2468] T 15a03abb46604cf28a4ffc0b110bad26 P 3785b50895f74e12b7723aa0162c02c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b7a4d926554fb784ee7b1d94f86813 in term 1.
I20260812 08:02:57.355013 31712 leader_election.cc:304] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3785b50895f74e12b7723aa0162c02c5, e2b7a4d926554fb784ee7b1d94f86813; no voters: 
I20260812 08:02:57.355214  1697 raft_consensus.cc:2804] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.355409  1697 raft_consensus.cc:697] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [term 1 LEADER]: Becoming Leader. State: Replica: e2b7a4d926554fb784ee7b1d94f86813, State: Running, Role: LEADER
I20260812 08:02:57.355540  1697 consensus_queue.cc:237] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } }
I20260812 08:02:57.357751 32538 catalog_manager.cc:5719] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b7a4d926554fb784ee7b1d94f86813 (127.26.116.65). New cstate: current_term: 1 leader_uuid: "e2b7a4d926554fb784ee7b1d94f86813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2b7a4d926554fb784ee7b1d94f86813" member_type: VOTER last_known_addr { host: "127.26.116.65" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 } health_report { overall_health: UNKNOWN } } }
W20260812 08:02:57.366675 31756 tablet_service.cc:3018] Rejecting scan request for tablet 15a03abb46604cf28a4ffc0b110bad26: Uninitialized: clean time has not yet been initialized
W20260812 08:02:57.568625 31756 tablet_service.cc:3018] Rejecting scan request for tablet 15a03abb46604cf28a4ffc0b110bad26: Uninitialized: clean time has not yet been initialized
I20260812 08:02:57.738397  1697 consensus_queue.cc:1048] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3785b50895f74e12b7723aa0162c02c5" member_type: VOTER last_known_addr { host: "127.26.116.67" port: 39239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:57.743144  1734 consensus_queue.cc:1048] T 15a03abb46604cf28a4ffc0b110bad26 P e2b7a4d926554fb784ee7b1d94f86813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea7421a364e447a932edf99c67546c5" member_type: VOTER last_known_addr { host: "127.26.116.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:57.861639  1747 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 815fd2931e984818b4644ca5c9729cd4)
I20260812 08:02:57.861802  1747 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:57.862289  1747 leader_election.cc:290] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 815fd2931e984818b4644ca5c9729cd4 (127.26.116.126:44773), b5e668bf917446e1a1f724f2782788aa (127.26.116.124:43465)
I20260812 08:02:57.862699 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 48 } } ignore_live_leader: false dest_uuid: "815fd2931e984818b4644ca5c9729cd4" is_pre_election: true
W20260812 08:02:57.971568 27089 scanner-internal.cc:458] Time spent opening tablet: real 0.607s	user 0.002s	sys 0.000s
I20260812 08:02:57.972265 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 31683
I20260812 08:02:57.973506  1287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:57.973868  1287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa"
I20260812 08:02:57.974198  1287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:57.974373  1288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:57.974457  1286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:57.974992  1281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:57.975245  1277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:57.975286  1640 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260812 08:02:57.975463  1276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:57.975708  1275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 48 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
I20260812 08:02:57.978497  1274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "815fd2931e984818b4644ca5c9729cd4" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa"
I20260812 08:02:57.978811  1282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2f1d4089ea8140dfab33d71b320df9df" candidate_term: 12 candidate_status { last_received { term: 11 index: 45 } } ignore_live_leader: false dest_uuid: "b5e668bf917446e1a1f724f2782788aa" is_pre_election: true
W20260812 08:02:57.981524  1269 catalog_manager.cc:5552] Ignoring report from unknown tablet 15a03abb46604cf28a4ffc0b110bad26
I20260812 08:02:57.981509 32558 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [term 11 LEADER]: Rejecting Update request from peer b5e668bf917446e1a1f724f2782788aa for earlier term 10. Current term is 11. Ops: []
I20260812 08:02:57.981597   729 raft_consensus.cc:1217] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Deduplicated request from leader. Original: 9.40->[10.41-10.44]   Dedup: 10.44->[]
I20260812 08:02:57.981755   729 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Rejecting Update request from peer b5e668bf917446e1a1f724f2782788aa for earlier term 10. Current term is 11. Ops: [10.41-10.44]
I20260812 08:02:57.984138   678 leader_election.cc:304] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f1d4089ea8140dfab33d71b320df9df; no voters: 815fd2931e984818b4644ca5c9729cd4, b5e668bf917446e1a1f724f2782788aa
W20260812 08:02:57.984479  1263 catalog_manager.cc:5552] Ignoring report from unknown tablet 15a03abb46604cf28a4ffc0b110bad26
I20260812 08:02:57.984553  1266 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47666:
name: "default.table_2_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:57.984921  1262 catalog_manager.cc:5552] Ignoring report from unknown tablet 15a03abb46604cf28a4ffc0b110bad26
I20260812 08:02:57.984997  1640 consensus_queue.cc:1059] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 }, Status: INVALID_TERM, Last received: 9.40, Next index: 41, Last known committed idx: 48, Time since last communication: 0.000s
W20260812 08:02:57.985131  1266 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:57.985256  1640 consensus_queue.cc:1059] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 }, Status: INVALID_TERM, Last received: 10.44, Next index: 45, Last known committed idx: 48, Time since last communication: 0.000s
I20260812 08:02:57.985373  1640 consensus_queue.cc:1243] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [LEADER]: Peer 815fd2931e984818b4644ca5c9729cd4 log is divergent from this leader: its last log entry 11.48 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 48
I20260812 08:02:57.985265  1273 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 10 LEADER]: Stepping down as leader of term 10
I20260812 08:02:57.985562  1273 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b5e668bf917446e1a1f724f2782788aa, State: Running, Role: LEADER
I20260812 08:02:57.985762  1273 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 10.44, Last appended by leader: 44, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } }
I20260812 08:02:57.986028  1747 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2f1d4089ea8140dfab33d71b320df9df [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260812 08:02:57.986060  1273 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 10 FOLLOWER]: Advancing to term 11
W20260812 08:02:57.986186  1266 catalog_manager.cc:2228] Illegal state: an error occurred while writing to the sys-catalog: replica b5e668bf917446e1a1f724f2782788aa is not leader of this config: current role FOLLOWER
I20260812 08:02:57.987355  1273 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [term 11 FOLLOWER]: Refusing update from remote peer 815fd2931e984818b4644ca5c9729cd4: Log matching property violated. Preceding OpId in replica: term: 10 index: 44. Preceding OpId from leader: term: 11 index: 45. (index mismatch)
W20260812 08:02:57.987787  1640 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260812 08:02:57.989682  1748 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 815fd2931e984818b4644ca5c9729cd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260812 08:02:57.992049  1640 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 815fd2931e984818b4644ca5c9729cd4. Latest consensus state: current_term: 11 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:57.992163  1640 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:57.992265  1640 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 11 leader_uuid: "815fd2931e984818b4644ca5c9729cd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "815fd2931e984818b4644ca5c9729cd4" member_type: VOTER last_known_addr { host: "127.26.116.126" port: 44773 } } peers { permanent_uuid: "2f1d4089ea8140dfab33d71b320df9df" member_type: VOTER last_known_addr { host: "127.26.116.125" port: 34993 } } peers { permanent_uuid: "b5e668bf917446e1a1f724f2782788aa" member_type: VOTER last_known_addr { host: "127.26.116.124" port: 43465 } } }
I20260812 08:02:57.992340  1640 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e668bf917446e1a1f724f2782788aa [sys.catalog]: This master's current role is: FOLLOWER
I20260812 08:02:57.993832  1755 mvcc.cc:204] Tried to move back new op lower bound from 7317593200060317696 to 7317593161515397120. Current Snapshot: MvccSnapshot[applied={T|T < 7317593200060317696}]
W20260812 08:02:57.998739  1252 connection.cc:573] server connection from 127.26.116.65:60783 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:57.999586 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 31912
I20260812 08:02:58.019562 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 32153
I20260812 08:02:58.038066 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 32479
I20260812 08:02:58.052001 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 645
I20260812 08:02:58.065263 27089 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskWKFVVJ/build/debug/bin/kudu with pid 1214
2026-08-12T08:02:58Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestMasterPermanentFailure/0 (85342 ms)
[----------] 4 tests from HmsConfigurations/MasterFailoverTest (114059 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (114059 ms total)
[  PASSED  ] 4 tests.
