Note: This is test shard 1 of 4.
[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from HmsConfigurations/MasterFailoverTest
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestCreateTableSync/0
2026-08-12T06:36:05Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:05Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 06:36:05.588505 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:36921
--webserver_interface=127.19.182.62
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 06:36:05.696091 20202 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:05.696275 20202 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:05.696314 20202 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:05.699447 20202 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:05.699499 20202 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:05.699522 20202 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:05.699554 20202 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:05.703315 20202 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:36921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.182.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:05.704269 20202 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:05.705437 20202 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:05.710891 20211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:05.710886 20214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:05.710964 20210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:05.711120 20202 server_base.cc:1061] running on GCE node
I20260812 06:36:05.711679 20202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:05.712769 20202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:05.713932 20202 hybrid_clock.cc:648] HybridClock initialized: now 1786516565713905 us; error 44 us; skew 500 ppm
I20260812 06:36:05.715631 20202 webserver.cc:533] Webserver started at http://127.19.182.62:44731/ using document root <none> and password file <none>
I20260812 06:36:05.716159 20202 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:05.716215 20202 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:05.716421 20202 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:05.717833 20202 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/instance:
uuid: "9ebc341994bf4c71bd21dfa975efc877"
format_stamp: "Formatted at 2026-08-12 06:36:05 on dist-test-slave-q9h9"
I20260812 06:36:05.718283 20202 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance:
uuid: "9ebc341994bf4c71bd21dfa975efc877"
format_stamp: "Formatted at 2026-08-12 06:36:05 on dist-test-slave-q9h9"
I20260812 06:36:05.721412 20202 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:05.723426 20229 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:05.724255 20202 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:05.724356 20202 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
uuid: "9ebc341994bf4c71bd21dfa975efc877"
format_stamp: "Formatted at 2026-08-12 06:36:05 on dist-test-slave-q9h9"
I20260812 06:36:05.724431 20202 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:05.734557 20202 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:05.735095 20202 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:05.735282 20202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:05.743332 20202 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.62:36921
I20260812 06:36:05.743333 20331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.62:36921 every 8 connection(s)
I20260812 06:36:05.744190 20202 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:05.747316 20332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:05.750695 20332 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:05.753693 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 20202
I20260812 06:36:05.753824 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance
I20260812 06:36:05.755118 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:39259
--webserver_interface=127.19.182.61
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:05.763229 20332 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:05.763849 20237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.61:39259: connect: Connection refused (error 111)
W20260812 06:36:05.764637 20332 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:39259: Network error: Client connection negotiation failed: client connection to 127.19.182.61:39259: connect: Connection refused (error 111)
I20260812 06:36:05.813824 20332 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } attempt: 1
W20260812 06:36:05.815052 20332 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:39259: Network error: Client connection negotiation failed: client connection to 127.19.182.61:39259: connect: Connection refused (error 111)
W20260812 06:36:05.858920 20340 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:05.859138 20340 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:05.859200 20340 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:05.863622 20340 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:05.863677 20340 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:05.863705 20340 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:05.863778 20340 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:05.868320 20340 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:39259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.182.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:05.869570 20340 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:05.870909 20340 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:05.876983 20351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:05.876989 20350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:05.877352 20340 server_base.cc:1061] running on GCE node
W20260812 06:36:05.877390 20354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:05.877846 20340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:05.878782 20340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:05.879984 20340 hybrid_clock.cc:648] HybridClock initialized: now 1786516565879968 us; error 28 us; skew 500 ppm
I20260812 06:36:05.881857 20340 webserver.cc:533] Webserver started at http://127.19.182.61:40963/ using document root <none> and password file <none>
I20260812 06:36:05.882478 20340 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:05.882543 20340 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:05.882772 20340 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:05.883181 20332 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } attempt: 2
I20260812 06:36:05.884406 20340 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/instance:
uuid: "5529afa2395f466cbcce90f14b1ff3d2"
format_stamp: "Formatted at 2026-08-12 06:36:05 on dist-test-slave-q9h9"
W20260812 06:36:05.884780 20332 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:39259: Network error: Client connection negotiation failed: client connection to 127.19.182.61:39259: connect: Connection refused (error 111)
I20260812 06:36:05.884888 20340 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance:
uuid: "5529afa2395f466cbcce90f14b1ff3d2"
format_stamp: "Formatted at 2026-08-12 06:36:05 on dist-test-slave-q9h9"
I20260812 06:36:05.888728 20340 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 06:36:05.891155 20364 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:05.892170 20340 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:05.892282 20340 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
uuid: "5529afa2395f466cbcce90f14b1ff3d2"
format_stamp: "Formatted at 2026-08-12 06:36:05 on dist-test-slave-q9h9"
I20260812 06:36:05.892359 20340 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:05.905715 20340 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:05.906277 20340 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:05.906419 20340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:05.914858 20471 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.61:39259 every 8 connection(s)
I20260812 06:36:05.914870 20340 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.61:39259
I20260812 06:36:05.915784 20340 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
I20260812 06:36:05.918380 20472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:05.920221 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 20340
I20260812 06:36:05.920305 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance
I20260812 06:36:05.920879 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:43567
--webserver_interface=127.19.182.60
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:05.921567 20472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:05.929710 20472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:05.935672 20472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:05.936329 20371 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.60:43567: connect: Connection refused (error 111)
W20260812 06:36:05.937208 20472 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:43567: Network error: Client connection negotiation failed: client connection to 127.19.182.60:43567: connect: Connection refused (error 111)
I20260812 06:36:05.975966 20332 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } attempt: 3
I20260812 06:36:05.980593 20332 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:05.981827 20332 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:43567: Network error: Client connection negotiation failed: client connection to 127.19.182.60:43567: connect: Connection refused (error 111)
I20260812 06:36:05.986414 20472 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } attempt: 1
W20260812 06:36:05.987514 20472 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:43567: Network error: Client connection negotiation failed: client connection to 127.19.182.60:43567: connect: Connection refused (error 111)
I20260812 06:36:06.012998 20332 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } attempt: 1
W20260812 06:36:06.014364 20332 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:43567: Network error: Client connection negotiation failed: client connection to 127.19.182.60:43567: connect: Connection refused (error 111)
W20260812 06:36:06.027439 20482 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:06.027603 20482 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:06.027645 20482 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:06.030825 20482 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:06.030874 20482 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:06.030893 20482 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:06.030910 20482 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:06.034560 20482 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:43567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.182.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.20482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:06.035458 20482 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:06.036460 20482 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:06.041473 20495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:06.041471 20499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:06.041471 20497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:06.041641 20482 server_base.cc:1061] running on GCE node
I20260812 06:36:06.042237 20482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:06.043025 20482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:06.044170 20482 hybrid_clock.cc:648] HybridClock initialized: now 1786516566044154 us; error 27 us; skew 500 ppm
I20260812 06:36:06.045640 20482 webserver.cc:533] Webserver started at http://127.19.182.60:41113/ using document root <none> and password file <none>
I20260812 06:36:06.046190 20482 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:06.046247 20482 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:06.046424 20482 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:06.047863 20482 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/instance:
uuid: "04e51baf3cde407e96f76fa8e3479ed8"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.048302 20482 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance:
uuid: "04e51baf3cde407e96f76fa8e3479ed8"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.051347 20482 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:06.053251 20507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.054214 20482 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:06.054330 20482 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
uuid: "04e51baf3cde407e96f76fa8e3479ed8"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.054407 20482 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:06.055656 20472 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } attempt: 2
W20260812 06:36:06.056941 20472 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:43567: Network error: Client connection negotiation failed: client connection to 127.19.182.60:43567: connect: Connection refused (error 111)
I20260812 06:36:06.067239 20482 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:06.067749 20482 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:06.067878 20482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:06.077363 20482 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.60:43567
I20260812 06:36:06.077378 20617 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.60:43567 every 8 connection(s)
I20260812 06:36:06.078356 20482 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
I20260812 06:36:06.081276 20618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:06.084470 20618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:06.087507 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 20482
I20260812 06:36:06.087610 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance
I20260812 06:36:06.089627 20332 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } attempt: 2
I20260812 06:36:06.093549 20618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:06.097923 20618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:06.098364 20332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: Bootstrap starting.
I20260812 06:36:06.101019 20332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:06.102358 20332 log.cc:826] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:06.103821 20618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: Bootstrap starting.
I20260812 06:36:06.104286 20332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: No bootstrap required, opened a new log
I20260812 06:36:06.106047 20618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:06.106853 20618 log.cc:826] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:06.107702 20332 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.107874 20332 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:06.107941 20332 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ebc341994bf4c71bd21dfa975efc877, State: Initialized, Role: FOLLOWER
I20260812 06:36:06.108459 20618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: No bootstrap required, opened a new log
I20260812 06:36:06.108430 20332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.108966 20636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.109069 20636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:06.109805 20332 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:06.111753 20618 raft_consensus.cc:359] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.111984 20618 raft_consensus.cc:385] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:06.112089 20618 raft_consensus.cc:740] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e51baf3cde407e96f76fa8e3479ed8, State: Initialized, Role: FOLLOWER
I20260812 06:36:06.112625 20618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.113058 20655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.113245 20655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:06.113785 20618 sys_catalog.cc:565] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:36:06.116832 20657 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:06.116930 20657 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:06.115808 20202 master_runner.cc:187] Error getting master registration for 127.19.182.61:39259: OK, instance_id { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" instance_seqno: 1786516565912389 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:36:06.118996 20202 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:36:06.119652 20686 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:06.119730 20686 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:06.121060 20482 master_runner.cc:187] Error getting master registration for 127.19.182.61:39259: OK, instance_id { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" instance_seqno: 1786516565912389 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:36:06.123333 20482 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:06.148121 20472 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } attempt: 3
I20260812 06:36:06.155061 20472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2: Bootstrap starting.
I20260812 06:36:06.157862 20472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:06.159013 20472 log.cc:826] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:06.160992 20472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2: No bootstrap required, opened a new log
I20260812 06:36:06.164135 20472 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.164309 20472 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:06.164418 20472 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5529afa2395f466cbcce90f14b1ff3d2, State: Initialized, Role: FOLLOWER
I20260812 06:36:06.164902 20472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.165508 20693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.165694 20693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:06.166227 20472 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:36:06.171940 20710 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:06.172067 20710 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:06.174984 20340 master_runner.cc:264] No leader master found from master 5529afa2395f466cbcce90f14b1ff3d2
I20260812 06:36:06.175047 20340 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:36:06.236732 20240 tablet.cc:2406] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:06.241721 20693 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:06.241935 20693 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.243096 20693 leader_election.cc:290] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ebc341994bf4c71bd21dfa975efc877 (127.19.182.62:36921), 04e51baf3cde407e96f76fa8e3479ed8 (127.19.182.60:43567)
I20260812 06:36:06.243911 20557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5529afa2395f466cbcce90f14b1ff3d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e51baf3cde407e96f76fa8e3479ed8" is_pre_election: true
I20260812 06:36:06.244189 20557 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5529afa2395f466cbcce90f14b1ff3d2 in term 0.
I20260812 06:36:06.244802 20371 leader_election.cc:304] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e51baf3cde407e96f76fa8e3479ed8, 5529afa2395f466cbcce90f14b1ff3d2; no voters: 
I20260812 06:36:06.245430 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5529afa2395f466cbcce90f14b1ff3d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ebc341994bf4c71bd21dfa975efc877" is_pre_election: true
I20260812 06:36:06.245678 20278 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5529afa2395f466cbcce90f14b1ff3d2 in term 0.
I20260812 06:36:06.246502 20693 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:06.246574 20693 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:06.246614 20693 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:06.247831 20693 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.248201 20693 leader_election.cc:290] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9ebc341994bf4c71bd21dfa975efc877 (127.19.182.62:36921), 04e51baf3cde407e96f76fa8e3479ed8 (127.19.182.60:43567)
I20260812 06:36:06.248809 20557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5529afa2395f466cbcce90f14b1ff3d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e51baf3cde407e96f76fa8e3479ed8"
I20260812 06:36:06.248920 20557 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:06.250304 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5529afa2395f466cbcce90f14b1ff3d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ebc341994bf4c71bd21dfa975efc877"
I20260812 06:36:06.250422 20278 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:06.251452 20278 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5529afa2395f466cbcce90f14b1ff3d2 in term 1.
I20260812 06:36:06.251873 20366 leader_election.cc:304] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5529afa2395f466cbcce90f14b1ff3d2, 9ebc341994bf4c71bd21dfa975efc877; no voters: 
I20260812 06:36:06.252686 20557 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5529afa2395f466cbcce90f14b1ff3d2 in term 1.
I20260812 06:36:06.255306 20693 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:06.256000 20693 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5529afa2395f466cbcce90f14b1ff3d2, State: Running, Role: LEADER
I20260812 06:36:06.256385 20693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.258659 20693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5529afa2395f466cbcce90f14b1ff3d2. Latest consensus state: current_term: 1 leader_uuid: "5529afa2395f466cbcce90f14b1ff3d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.258857 20693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:06.260854 20721 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:06.262089 20721 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:06.267834 20557 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Refusing update from remote peer 5529afa2395f466cbcce90f14b1ff3d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:06.268738 20715 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:06.272944 20655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5529afa2395f466cbcce90f14b1ff3d2. Latest consensus state: current_term: 1 leader_uuid: "5529afa2395f466cbcce90f14b1ff3d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.273049 20655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:06.273994 20278 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 1 FOLLOWER]: Refusing update from remote peer 5529afa2395f466cbcce90f14b1ff3d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:06.277552 20715 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:06.281011 20636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5529afa2395f466cbcce90f14b1ff3d2. Latest consensus state: current_term: 1 leader_uuid: "5529afa2395f466cbcce90f14b1ff3d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.281144 20636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:06.285075 20715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5529afa2395f466cbcce90f14b1ff3d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.285190 20715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:06.286602 20636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5529afa2395f466cbcce90f14b1ff3d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.286701 20636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:06.287113 20722 mvcc.cc:204] Tried to move back new op lower bound from 7317571855424933888 to 7317571855390105600. Current Snapshot: MvccSnapshot[applied={T|T < 7317571855424933888}]
I20260812 06:36:06.287483 20726 mvcc.cc:204] Tried to move back new op lower bound from 7317571855424933888 to 7317571855390105600. Current Snapshot: MvccSnapshot[applied={T|T < 7317571855424933888}]
I20260812 06:36:06.289217 20693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5529afa2395f466cbcce90f14b1ff3d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.289314 20693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:06.290282 20655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5529afa2395f466cbcce90f14b1ff3d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:06.290388 20655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:06.293790 20723 mvcc.cc:204] Tried to move back new op lower bound from 7317571855424933888 to 7317571855390105600. Current Snapshot: MvccSnapshot[applied={T|T < 7317571855424933888}]
I20260812 06:36:06.294299 20721 catalog_manager.cc:1383] Generated new cluster ID: 894e100f65674ea48a90676ca4208461
I20260812 06:36:06.294355 20721 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:06.331569 20721 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:06.332698 20721 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:06.346450 20721 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2: Generated new TSK 0
I20260812 06:36:06.347126 20721 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:06.351939 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.1:0
--local_ip_for_outbound_sockets=127.19.182.1
--webserver_interface=127.19.182.1
--webserver_port=0
--tserver_master_addrs=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--builtin_ntp_servers=127.19.182.20:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 06:36:06.458786 20739 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:06.458942 20739 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:06.458990 20739 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:06.462131 20739 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:06.462239 20739 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.1
I20260812 06:36:06.465775 20739 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.182.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--never_fsync=true
--heap_profile_path=/tmp/kudu.20739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:06.466637 20739 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:06.467577 20739 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:06.473342 20755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:06.473351 20753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:06.473424 20751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:06.473832 20739 server_base.cc:1061] running on GCE node
I20260812 06:36:06.474165 20739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:06.474592 20739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:06.475735 20739 hybrid_clock.cc:648] HybridClock initialized: now 1786516566475719 us; error 33 us; skew 500 ppm
I20260812 06:36:06.477221 20739 webserver.cc:533] Webserver started at http://127.19.182.1:40745/ using document root <none> and password file <none>
I20260812 06:36:06.477701 20739 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:06.477753 20739 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:06.477923 20739 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:06.479341 20739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/instance:
uuid: "5021d4effe324ea19ed7c7c1efc39e22"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.479774 20739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal/instance:
uuid: "5021d4effe324ea19ed7c7c1efc39e22"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.482666 20739 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:06.484473 20762 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.485360 20739 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:06.485456 20739 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
uuid: "5021d4effe324ea19ed7c7c1efc39e22"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.485533 20739 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:06.498086 20739 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:06.498570 20739 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:06.498718 20739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:06.499178 20739 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:06.500175 20739 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:06.500222 20739 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.500268 20739 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:06.500298 20739 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.509313 20739 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.1:40975
I20260812 06:36:06.509353 20979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.1:40975 every 8 connection(s)
I20260812 06:36:06.510140 20739 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:06.518451 20982 heartbeater.cc:344] Connected to a master server at 127.19.182.62:36921
I20260812 06:36:06.518656 20982 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.519078 20982 heartbeater.cc:507] Master 127.19.182.62:36921 requested a full tablet report, sending...
I20260812 06:36:06.519311 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 20739
I20260812 06:36:06.519418 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:06.519714 20980 heartbeater.cc:344] Connected to a master server at 127.19.182.60:43567
I20260812 06:36:06.519798 20980 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.519969 20980 heartbeater.cc:507] Master 127.19.182.60:43567 requested a full tablet report, sending...
I20260812 06:36:06.520337 20984 heartbeater.cc:344] Connected to a master server at 127.19.182.61:39259
I20260812 06:36:06.520406 20984 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.520563 20984 heartbeater.cc:507] Master 127.19.182.61:39259 requested a full tablet report, sending...
I20260812 06:36:06.520983 20261 ts_manager.cc:194] Registered new tserver with Master: 5021d4effe324ea19ed7c7c1efc39e22 (127.19.182.1:40975)
I20260812 06:36:06.521566 20392 ts_manager.cc:194] Registered new tserver with Master: 5021d4effe324ea19ed7c7c1efc39e22 (127.19.182.1:40975)
I20260812 06:36:06.522984 20392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.1:59859
I20260812 06:36:06.523325 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.2:0
--local_ip_for_outbound_sockets=127.19.182.2
--webserver_interface=127.19.182.2
--webserver_port=0
--tserver_master_addrs=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--builtin_ntp_servers=127.19.182.20:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 06:36:06.523428 20534 ts_manager.cc:194] Registered new tserver with Master: 5021d4effe324ea19ed7c7c1efc39e22 (127.19.182.1:40975)
W20260812 06:36:06.624053 20993 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:06.624220 20993 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:06.624269 20993 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:06.627440 20993 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:06.627552 20993 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.2
I20260812 06:36:06.631189 20993 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.182.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--never_fsync=true
--heap_profile_path=/tmp/kudu.20993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:06.632195 20993 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:06.633216 20993 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:06.638861 21004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:06.638957 21009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:06.638870 21005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:06.639111 20993 server_base.cc:1061] running on GCE node
I20260812 06:36:06.639436 20993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:06.639921 20993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:06.641063 20993 hybrid_clock.cc:648] HybridClock initialized: now 1786516566641050 us; error 29 us; skew 500 ppm
I20260812 06:36:06.642557 20993 webserver.cc:533] Webserver started at http://127.19.182.2:46151/ using document root <none> and password file <none>
I20260812 06:36:06.643042 20993 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:06.643100 20993 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:06.643275 20993 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:06.644644 20993 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/instance:
uuid: "a41eb11a72d34a34a7d8567171c141c1"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.645093 20993 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/instance:
uuid: "a41eb11a72d34a34a7d8567171c141c1"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.648062 20993 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260812 06:36:06.649904 21019 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.650795 20993 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:36:06.650892 20993 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
uuid: "a41eb11a72d34a34a7d8567171c141c1"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.650967 20993 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:06.686373 20993 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:06.686877 20993 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:06.687022 20993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:06.687556 20993 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:06.688535 20993 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:06.688583 20993 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.688632 20993 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:06.688658 20993 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.697227 20993 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.2:34389
I20260812 06:36:06.697261 21230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.2:34389 every 8 connection(s)
I20260812 06:36:06.698094 20993 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:06.698923 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 20993
I20260812 06:36:06.699016 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:06.702770 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.3:0
--local_ip_for_outbound_sockets=127.19.182.3
--webserver_interface=127.19.182.3
--webserver_port=0
--tserver_master_addrs=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--builtin_ntp_servers=127.19.182.20:43235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 06:36:06.707624 21235 heartbeater.cc:344] Connected to a master server at 127.19.182.61:39259
I20260812 06:36:06.707660 21233 heartbeater.cc:344] Connected to a master server at 127.19.182.60:43567
I20260812 06:36:06.707829 21233 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.707831 21235 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.708288 21233 heartbeater.cc:507] Master 127.19.182.60:43567 requested a full tablet report, sending...
I20260812 06:36:06.708288 21235 heartbeater.cc:507] Master 127.19.182.61:39259 requested a full tablet report, sending...
I20260812 06:36:06.708737 21234 heartbeater.cc:344] Connected to a master server at 127.19.182.62:36921
I20260812 06:36:06.708814 21234 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.708977 21234 heartbeater.cc:507] Master 127.19.182.62:36921 requested a full tablet report, sending...
I20260812 06:36:06.709290 20392 ts_manager.cc:194] Registered new tserver with Master: a41eb11a72d34a34a7d8567171c141c1 (127.19.182.2:34389)
I20260812 06:36:06.709551 20534 ts_manager.cc:194] Registered new tserver with Master: a41eb11a72d34a34a7d8567171c141c1 (127.19.182.2:34389)
I20260812 06:36:06.709662 20261 ts_manager.cc:194] Registered new tserver with Master: a41eb11a72d34a34a7d8567171c141c1 (127.19.182.2:34389)
I20260812 06:36:06.709950 20392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.2:43951
W20260812 06:36:06.805094 21242 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:06.805261 21242 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:06.805308 21242 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:06.808447 21242 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:06.808545 21242 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.3
I20260812 06:36:06.812080 21242 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:43235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.182.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:36921,127.19.182.61:39259,127.19.182.60:43567
--never_fsync=true
--heap_profile_path=/tmp/kudu.21242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:06.812904 21242 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:06.813823 21242 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:06.819435 21252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:06.819636 21242 server_base.cc:1061] running on GCE node
W20260812 06:36:06.819447 21250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:06.819501 21255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:06.820055 21242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:06.820492 21242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:06.821631 21242 hybrid_clock.cc:648] HybridClock initialized: now 1786516566821614 us; error 29 us; skew 500 ppm
I20260812 06:36:06.823098 21242 webserver.cc:533] Webserver started at http://127.19.182.3:42805/ using document root <none> and password file <none>
I20260812 06:36:06.823577 21242 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:06.823629 21242 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:06.823812 21242 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:06.825112 21242 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/instance:
uuid: "e85482073375446e9243c45904900337"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.825527 21242 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/instance:
uuid: "e85482073375446e9243c45904900337"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.828413 21242 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260812 06:36:06.830268 21263 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.831117 21242 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260812 06:36:06.831205 21242 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
uuid: "e85482073375446e9243c45904900337"
format_stamp: "Formatted at 2026-08-12 06:36:06 on dist-test-slave-q9h9"
I20260812 06:36:06.831290 21242 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:06.846642 21272 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5529afa2395f466cbcce90f14b1ff3d2)
I20260812 06:36:06.846752 21272 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:06.847560 21272 leader_election.cc:290] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ebc341994bf4c71bd21dfa975efc877 (127.19.182.62:36921), 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259)
I20260812 06:36:06.848027 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e51baf3cde407e96f76fa8e3479ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ebc341994bf4c71bd21dfa975efc877" is_pre_election: true
I20260812 06:36:06.848088 20415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e51baf3cde407e96f76fa8e3479ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:06.848611 20514 leader_election.cc:304] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e51baf3cde407e96f76fa8e3479ed8; no voters: 5529afa2395f466cbcce90f14b1ff3d2, 9ebc341994bf4c71bd21dfa975efc877
I20260812 06:36:06.848796 21272 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:36:06.857713 21242 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:06.858269 21242 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:06.858414 21242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:06.858968 21242 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:06.859912 21242 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:06.859961 21242 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.859999 21242 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:06.860028 21242 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:06.868749 21242 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.3:41131
I20260812 06:36:06.868783 21489 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.3:41131 every 8 connection(s)
I20260812 06:36:06.869668 21242 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:06.870976 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 21242
I20260812 06:36:06.871089 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestCreateTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:06.879202 21495 heartbeater.cc:344] Connected to a master server at 127.19.182.61:39259
I20260812 06:36:06.879253 21492 heartbeater.cc:344] Connected to a master server at 127.19.182.60:43567
I20260812 06:36:06.879417 21493 heartbeater.cc:344] Connected to a master server at 127.19.182.62:36921
I20260812 06:36:06.879408 21492 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.879407 21495 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.879472 21493 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:06.879904 21495 heartbeater.cc:507] Master 127.19.182.61:39259 requested a full tablet report, sending...
I20260812 06:36:06.879904 21492 heartbeater.cc:507] Master 127.19.182.60:43567 requested a full tablet report, sending...
I20260812 06:36:06.879905 21493 heartbeater.cc:507] Master 127.19.182.62:36921 requested a full tablet report, sending...
I20260812 06:36:06.880880 20392 ts_manager.cc:194] Registered new tserver with Master: e85482073375446e9243c45904900337 (127.19.182.3:41131)
I20260812 06:36:06.880945 20261 ts_manager.cc:194] Registered new tserver with Master: e85482073375446e9243c45904900337 (127.19.182.3:41131)
I20260812 06:36:06.880956 20534 ts_manager.cc:194] Registered new tserver with Master: e85482073375446e9243c45904900337 (127.19.182.3:41131)
I20260812 06:36:06.881493 20392 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.3:40863
I20260812 06:36:06.891496 20184 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:06.900698 20184 master_failover-itest.cc:180] Pausing leader master
I20260812 06:36:07.024820 20984 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:07.118153 20657 catalog_manager.cc:1295] Loaded cluster ID: 894e100f65674ea48a90676ca4208461
I20260812 06:36:07.118219 20657 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: loading cluster ID for follower catalog manager: success
I20260812 06:36:07.119959 20657 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: acquiring CA information for follower catalog manager: success
I20260812 06:36:07.120702 20686 catalog_manager.cc:1295] Loaded cluster ID: 894e100f65674ea48a90676ca4208461
I20260812 06:36:07.120755 20686 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: loading cluster ID for follower catalog manager: success
I20260812 06:36:07.121040 20657 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:07.122290 20686 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: acquiring CA information for follower catalog manager: success
I20260812 06:36:07.123131 20686 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:07.211393 21235 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:07.300690 21513 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5529afa2395f466cbcce90f14b1ff3d2)
I20260812 06:36:07.300846 21513 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:07.301787 21513 leader_election.cc:290] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259), 04e51baf3cde407e96f76fa8e3479ed8 (127.19.182.60:43567)
I20260812 06:36:07.302330 20557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e51baf3cde407e96f76fa8e3479ed8" is_pre_election: true
I20260812 06:36:07.369720 21514 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5529afa2395f466cbcce90f14b1ff3d2)
I20260812 06:36:07.369844 21514 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:07.370306 21514 leader_election.cc:290] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ebc341994bf4c71bd21dfa975efc877 (127.19.182.62:36921), 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259)
I20260812 06:36:07.370702 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e51baf3cde407e96f76fa8e3479ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ebc341994bf4c71bd21dfa975efc877" is_pre_election: true
I20260812 06:36:07.370842 20278 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e51baf3cde407e96f76fa8e3479ed8 in term 1.
I20260812 06:36:07.371192 20508 leader_election.cc:304] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e51baf3cde407e96f76fa8e3479ed8, 9ebc341994bf4c71bd21dfa975efc877; no voters: 
I20260812 06:36:07.371376 21514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:36:07.371436 21514 raft_consensus.cc:493] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5529afa2395f466cbcce90f14b1ff3d2)
I20260812 06:36:07.371475 21514 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:07.372396 21514 raft_consensus.cc:515] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:07.372735 21514 leader_election.cc:290] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [CANDIDATE]: Term 2 election: Requested vote from peers 9ebc341994bf4c71bd21dfa975efc877 (127.19.182.62:36921), 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259)
I20260812 06:36:07.373077 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e51baf3cde407e96f76fa8e3479ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9ebc341994bf4c71bd21dfa975efc877"
I20260812 06:36:07.373183 20278 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:07.373907 20278 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e51baf3cde407e96f76fa8e3479ed8 in term 2.
I20260812 06:36:07.374245 20508 leader_election.cc:304] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e51baf3cde407e96f76fa8e3479ed8, 9ebc341994bf4c71bd21dfa975efc877; no voters: 
I20260812 06:36:07.374440 21514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:36:07.374600 21514 raft_consensus.cc:697] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [term 2 LEADER]: Becoming Leader. State: Replica: 04e51baf3cde407e96f76fa8e3479ed8, State: Running, Role: LEADER
I20260812 06:36:07.374909 21514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:07.375890 21515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e51baf3cde407e96f76fa8e3479ed8. Latest consensus state: current_term: 2 leader_uuid: "04e51baf3cde407e96f76fa8e3479ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:07.376004 21515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:07.376294 21519 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:07.377084 21519 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:07.377468 21519 catalog_manager.cc:1295] Loaded cluster ID: 894e100f65674ea48a90676ca4208461
I20260812 06:36:07.377516 21519 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:07.378065 21519 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:07.378461 21519 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8: Loaded TSK: 0
I20260812 06:36:07.379109 21519 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:07.382769 21495 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:07.877612 20278 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Refusing update from remote peer 04e51baf3cde407e96f76fa8e3479ed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 06:36:07.878232 21520 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 06:36:07.879606 21521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e51baf3cde407e96f76fa8e3479ed8. Latest consensus state: current_term: 2 leader_uuid: "04e51baf3cde407e96f76fa8e3479ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:07.879750 21521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:07.881001 21524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "04e51baf3cde407e96f76fa8e3479ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:07.881134 21524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:07.881448 21521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "04e51baf3cde407e96f76fa8e3479ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:07.881569 21521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:07.883530 21492 heartbeater.cc:499] Master 127.19.182.60:43567 was elected leader, sending a full tablet report...
W20260812 06:36:07.962694 20514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.591s (SENT)
W20260812 06:36:08.026070 20984 heartbeater.cc:646] Failed to heartbeat to 127.19.182.61:39259 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.61:39259 timed out after 1.000s (SENT)
I20260812 06:36:08.027050 20980 heartbeater.cc:499] Master 127.19.182.60:43567 was elected leader, sending a full tablet report...
W20260812 06:36:08.212618 21235 heartbeater.cc:646] Failed to heartbeat to 127.19.182.61:39259 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.61:39259 timed out after 1.000s (SENT)
I20260812 06:36:08.213227 21233 heartbeater.cc:499] Master 127.19.182.60:43567 was elected leader, sending a full tablet report...
W20260812 06:36:08.383885 21495 heartbeater.cc:646] Failed to heartbeat to 127.19.182.61:39259 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.61:39259 timed out after 1.000s (SENT)
I20260812 06:36:08.526331 20984 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
W20260812 06:36:08.555303 20514 leader_election.cc:336] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259): Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.591s (SENT)
W20260812 06:36:08.621713 20514 leader_election.cc:336] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259): Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.623s (SENT)
W20260812 06:36:08.637194 20237 leader_election.cc:336] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259): Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.666s (SENT)
I20260812 06:36:08.637292 20237 leader_election.cc:304] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ebc341994bf4c71bd21dfa975efc877; no voters: 04e51baf3cde407e96f76fa8e3479ed8, 5529afa2395f466cbcce90f14b1ff3d2
I20260812 06:36:08.637694 21534 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:36:08.712904 21235 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:08.884157 21495 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:09.446481 21539 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04e51baf3cde407e96f76fa8e3479ed8)
I20260812 06:36:09.446609 21539 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:09.447014 21539 leader_election.cc:290] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259), 04e51baf3cde407e96f76fa8e3479ed8 (127.19.182.60:43567)
I20260812 06:36:09.447438 20557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e51baf3cde407e96f76fa8e3479ed8" is_pre_election: true
I20260812 06:36:10.027663 20984 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:10.214268 21235 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:10.385448 21495 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
W20260812 06:36:10.665825 20237 leader_election.cc:336] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259): Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.608s (SENT)
I20260812 06:36:10.665926 20237 leader_election.cc:304] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ebc341994bf4c71bd21dfa975efc877; no voters: 04e51baf3cde407e96f76fa8e3479ed8, 5529afa2395f466cbcce90f14b1ff3d2
I20260812 06:36:10.666294 21546 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 06:36:11.389784 21548 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04e51baf3cde407e96f76fa8e3479ed8)
I20260812 06:36:11.389914 21548 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:11.390429 21548 leader_election.cc:290] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259), 04e51baf3cde407e96f76fa8e3479ed8 (127.19.182.60:43567)
I20260812 06:36:11.390918 20557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e51baf3cde407e96f76fa8e3479ed8" is_pre_election: true
I20260812 06:36:11.529155 20984 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:11.715684 21235 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:11.886891 21495 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
W20260812 06:36:12.063742 20237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.672s (SENT) [suppressed 6 similar messages]
W20260812 06:36:12.737651 20237 leader_election.cc:336] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259): Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.672s (SENT)
I20260812 06:36:12.737748 20237 leader_election.cc:304] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ebc341994bf4c71bd21dfa975efc877; no voters: 04e51baf3cde407e96f76fa8e3479ed8, 5529afa2395f466cbcce90f14b1ff3d2
I20260812 06:36:12.738081 21552 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 06:36:13.030476 20984 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:13.217072 21235 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:13.388279 21495 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:13.426452 21562 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04e51baf3cde407e96f76fa8e3479ed8)
I20260812 06:36:13.426571 21562 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:13.426977 21562 leader_election.cc:290] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259), 04e51baf3cde407e96f76fa8e3479ed8 (127.19.182.60:43567)
I20260812 06:36:13.427372 20557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e51baf3cde407e96f76fa8e3479ed8" is_pre_election: true
I20260812 06:36:14.531911 20984 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
W20260812 06:36:14.705966 20237 leader_election.cc:336] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259): Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.638s (SENT)
I20260812 06:36:14.706085 20237 leader_election.cc:304] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ebc341994bf4c71bd21dfa975efc877; no voters: 04e51baf3cde407e96f76fa8e3479ed8, 5529afa2395f466cbcce90f14b1ff3d2
I20260812 06:36:14.706395 21568 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 06:36:14.718611 21235 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:14.889671 21495 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:15.585585 21571 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04e51baf3cde407e96f76fa8e3479ed8)
I20260812 06:36:15.585712 21571 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:15.586181 21571 leader_election.cc:290] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259), 04e51baf3cde407e96f76fa8e3479ed8 (127.19.182.60:43567)
I20260812 06:36:15.586570 20557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e51baf3cde407e96f76fa8e3479ed8" is_pre_election: true
I20260812 06:36:16.033097 20984 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:16.219846 21235 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:16.391010 21495 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
W20260812 06:36:16.916946 21509 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.182.61:39259)
I20260812 06:36:16.919458 20534 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41512:
name: "default.test_create_table_sync"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:16.920662 20534 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_create_table_sync in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:16.939680 20853 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebdbb970ab34aedaa6891d2a7fd0722 (DEFAULT_TABLE table=default.test_create_table_sync [id=19e216a4d5214e4dbbcb096eba026d67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:16.939728 21104 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebdbb970ab34aedaa6891d2a7fd0722 (DEFAULT_TABLE table=default.test_create_table_sync [id=19e216a4d5214e4dbbcb096eba026d67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:16.939728 21358 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebdbb970ab34aedaa6891d2a7fd0722 (DEFAULT_TABLE table=default.test_create_table_sync [id=19e216a4d5214e4dbbcb096eba026d67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:16.940544 20853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebdbb970ab34aedaa6891d2a7fd0722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:16.940614 21358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebdbb970ab34aedaa6891d2a7fd0722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:16.940624 21104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebdbb970ab34aedaa6891d2a7fd0722. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:16.945147 21609 tablet_bootstrap.cc:492] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22: Bootstrap starting.
I20260812 06:36:16.945832 21610 tablet_bootstrap.cc:492] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1: Bootstrap starting.
I20260812 06:36:16.946818 21615 tablet_bootstrap.cc:492] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337: Bootstrap starting.
I20260812 06:36:16.948040 21609 tablet_bootstrap.cc:654] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:16.948040 21610 tablet_bootstrap.cc:654] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:16.948413 21615 tablet_bootstrap.cc:654] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:16.948877 21610 log.cc:826] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:16.948877 21609 log.cc:826] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:16.949048 21615 log.cc:826] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:16.950439 21609 tablet_bootstrap.cc:492] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22: No bootstrap required, opened a new log
I20260812 06:36:16.950498 21610 tablet_bootstrap.cc:492] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1: No bootstrap required, opened a new log
I20260812 06:36:16.950498 21615 tablet_bootstrap.cc:492] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337: No bootstrap required, opened a new log
I20260812 06:36:16.950678 21610 ts_tablet_manager.cc:1403] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:16.950678 21615 ts_tablet_manager.cc:1403] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 06:36:16.950683 21609 ts_tablet_manager.cc:1403] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:36:16.954183 21610 raft_consensus.cc:359] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
I20260812 06:36:16.954394 21610 raft_consensus.cc:385] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:16.954468 21610 raft_consensus.cc:740] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a41eb11a72d34a34a7d8567171c141c1, State: Initialized, Role: FOLLOWER
I20260812 06:36:16.954393 21615 raft_consensus.cc:359] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
I20260812 06:36:16.954568 21615 raft_consensus.cc:385] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:16.954633 21615 raft_consensus.cc:740] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e85482073375446e9243c45904900337, State: Initialized, Role: FOLLOWER
I20260812 06:36:16.954931 21610 consensus_queue.cc:260] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
I20260812 06:36:16.955025 21615 consensus_queue.cc:260] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
I20260812 06:36:16.955006 21609 raft_consensus.cc:359] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
I20260812 06:36:16.955220 21609 raft_consensus.cc:385] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:16.955348 21609 raft_consensus.cc:740] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5021d4effe324ea19ed7c7c1efc39e22, State: Initialized, Role: FOLLOWER
I20260812 06:36:16.955791 21615 ts_tablet_manager.cc:1434] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260812 06:36:16.955791 21610 ts_tablet_manager.cc:1434] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:16.955816 21609 consensus_queue.cc:260] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
W20260812 06:36:16.956517 21236 tablet.cc:2406] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:16.957645 21609 ts_tablet_manager.cc:1434] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260812 06:36:17.018290 20986 tablet.cc:2406] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:17.021251 21623 raft_consensus.cc:493] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:17.021435 21623 raft_consensus.cc:515] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
I20260812 06:36:17.022601 21623 leader_election.cc:290] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5021d4effe324ea19ed7c7c1efc39e22 (127.19.182.1:40975), a41eb11a72d34a34a7d8567171c141c1 (127.19.182.2:34389)
I20260812 06:36:17.026299 20892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebdbb970ab34aedaa6891d2a7fd0722" candidate_uuid: "e85482073375446e9243c45904900337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5021d4effe324ea19ed7c7c1efc39e22" is_pre_election: true
I20260812 06:36:17.026298 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebdbb970ab34aedaa6891d2a7fd0722" candidate_uuid: "e85482073375446e9243c45904900337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a41eb11a72d34a34a7d8567171c141c1" is_pre_election: true
I20260812 06:36:17.026544 20892 raft_consensus.cc:2468] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e85482073375446e9243c45904900337 in term 0.
I20260812 06:36:17.026546 21146 raft_consensus.cc:2468] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e85482073375446e9243c45904900337 in term 0.
I20260812 06:36:17.027109 21264 leader_election.cc:304] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5021d4effe324ea19ed7c7c1efc39e22, e85482073375446e9243c45904900337; no voters: 
I20260812 06:36:17.027354 21623 raft_consensus.cc:2804] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:17.027428 21623 raft_consensus.cc:493] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:17.027472 21623 raft_consensus.cc:3060] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:17.028393 21623 raft_consensus.cc:515] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
I20260812 06:36:17.028726 21623 leader_election.cc:290] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [CANDIDATE]: Term 1 election: Requested vote from peers 5021d4effe324ea19ed7c7c1efc39e22 (127.19.182.1:40975), a41eb11a72d34a34a7d8567171c141c1 (127.19.182.2:34389)
I20260812 06:36:17.029047 20892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebdbb970ab34aedaa6891d2a7fd0722" candidate_uuid: "e85482073375446e9243c45904900337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5021d4effe324ea19ed7c7c1efc39e22"
I20260812 06:36:17.029058 21146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebdbb970ab34aedaa6891d2a7fd0722" candidate_uuid: "e85482073375446e9243c45904900337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a41eb11a72d34a34a7d8567171c141c1"
I20260812 06:36:17.029160 20892 raft_consensus.cc:3060] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:17.029178 21146 raft_consensus.cc:3060] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:17.029999 20892 raft_consensus.cc:2468] T 3ebdbb970ab34aedaa6891d2a7fd0722 P 5021d4effe324ea19ed7c7c1efc39e22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e85482073375446e9243c45904900337 in term 1.
I20260812 06:36:17.030041 21146 raft_consensus.cc:2468] T 3ebdbb970ab34aedaa6891d2a7fd0722 P a41eb11a72d34a34a7d8567171c141c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e85482073375446e9243c45904900337 in term 1.
I20260812 06:36:17.030328 21265 leader_election.cc:304] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a41eb11a72d34a34a7d8567171c141c1, e85482073375446e9243c45904900337; no voters: 
I20260812 06:36:17.030510 21623 raft_consensus.cc:2804] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:17.030735 21623 raft_consensus.cc:697] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [term 1 LEADER]: Becoming Leader. State: Replica: e85482073375446e9243c45904900337, State: Running, Role: LEADER
I20260812 06:36:17.031045 21623 consensus_queue.cc:237] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } }
I20260812 06:36:17.034126 20534 catalog_manager.cc:5719] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 reported cstate change: term changed from 0 to 1, leader changed from <none> to e85482073375446e9243c45904900337 (127.19.182.3). New cstate: current_term: 1 leader_uuid: "e85482073375446e9243c45904900337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e85482073375446e9243c45904900337" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:17.034930 20984 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
W20260812 06:36:17.043009 20237 leader_election.cc:336] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5529afa2395f466cbcce90f14b1ff3d2 (127.19.182.61:39259): Timed out: RequestConsensusVote RPC to 127.19.182.61:39259 timed out after 0.727s (SENT)
I20260812 06:36:17.043079 20237 leader_election.cc:304] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ebc341994bf4c71bd21dfa975efc877; no voters: 04e51baf3cde407e96f76fa8e3479ed8, 5529afa2395f466cbcce90f14b1ff3d2
I20260812 06:36:17.043303 21632 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9ebc341994bf4c71bd21dfa975efc877 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 06:36:17.070441 21312 tablet_service.cc:3018] Rejecting scan request for tablet 3ebdbb970ab34aedaa6891d2a7fd0722: Uninitialized: clean time has not yet been initialized
W20260812 06:36:17.129012 21496 tablet.cc:2406] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:17.221200 21235 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
W20260812 06:36:17.272688 21312 tablet_service.cc:3018] Rejecting scan request for tablet 3ebdbb970ab34aedaa6891d2a7fd0722: Uninitialized: clean time has not yet been initialized
I20260812 06:36:17.392560 21495 heartbeater.cc:499] Master 127.19.182.61:39259 was elected leader, sending a full tablet report...
I20260812 06:36:17.558243 21641 consensus_queue.cc:1048] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a41eb11a72d34a34a7d8567171c141c1" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 34389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:17.563458 21651 consensus_queue.cc:1048] T 3ebdbb970ab34aedaa6891d2a7fd0722 P e85482073375446e9243c45904900337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5021d4effe324ea19ed7c7c1efc39e22" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 40975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:36:17.677736 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.616s	user 0.005s	sys 0.000s
I20260812 06:36:17.678509 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 20739
I20260812 06:36:17.682133 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.682360 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e51baf3cde407e96f76fa8e3479ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.682482 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e51baf3cde407e96f76fa8e3479ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.682576 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e51baf3cde407e96f76fa8e3479ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2"
I20260812 06:36:17.682660 20406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "04e51baf3cde407e96f76fa8e3479ed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2"
I20260812 06:36:17.682953 20406 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 06:36:17.683002 20406 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5529afa2395f466cbcce90f14b1ff3d2, State: Running, Role: LEADER
I20260812 06:36:17.683128 20406 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } }
I20260812 06:36:17.683341 20406 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:17.684322 20406 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 2 FOLLOWER]: Refusing update from remote peer 04e51baf3cde407e96f76fa8e3479ed8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 06:36:17.685573 20710 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:17.687613 20395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.687732 20395 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ebc341994bf4c71bd21dfa975efc877 in term 2.
I20260812 06:36:17.687980 20402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.688102 20402 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ebc341994bf4c71bd21dfa975efc877 in term 2.
I20260812 06:36:17.689011 20398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.689116 20398 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ebc341994bf4c71bd21dfa975efc877 in term 2.
I20260812 06:36:17.689133 21635 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 04e51baf3cde407e96f76fa8e3479ed8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 06:36:17.689576 20404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.689669 20404 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ebc341994bf4c71bd21dfa975efc877 in term 2.
I20260812 06:36:17.690183 20410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.690287 20410 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ebc341994bf4c71bd21dfa975efc877 in term 2.
I20260812 06:36:17.690945 20396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.691154 20415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.691478 20413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.691751 20412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ebc341994bf4c71bd21dfa975efc877" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5529afa2395f466cbcce90f14b1ff3d2" is_pre_election: true
I20260812 06:36:17.692152 20738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e51baf3cde407e96f76fa8e3479ed8. Latest consensus state: current_term: 2 leader_uuid: "04e51baf3cde407e96f76fa8e3479ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:17.692243 20738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:17.692322 20738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "04e51baf3cde407e96f76fa8e3479ed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ebc341994bf4c71bd21dfa975efc877" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 36921 } } peers { permanent_uuid: "5529afa2395f466cbcce90f14b1ff3d2" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 39259 } } peers { permanent_uuid: "04e51baf3cde407e96f76fa8e3479ed8" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 43567 } } }
I20260812 06:36:17.692371 20738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5529afa2395f466cbcce90f14b1ff3d2 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:36:17.693251 20386 catalog_manager.cc:5552] Ignoring report from unknown tablet 3ebdbb970ab34aedaa6891d2a7fd0722
W20260812 06:36:17.709679 20371 connection.cc:573] server connection from 127.19.182.1:59859 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:36:17.710762 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 20993
I20260812 06:36:17.720242 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 21242
I20260812 06:36:17.733211 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 20202
I20260812 06:36:17.744207 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 20340
I20260812 06:36:17.759900 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 20482
2026-08-12T06:36:17Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestCreateTableSync/0 (12220 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestDeleteTableSync/0
2026-08-12T06:36:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:17Z Disabled control of system clock
I20260812 06:36:17.799774 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:33511
--webserver_interface=127.19.182.62
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:44369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 06:36:17.898658 21682 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:17.898829 21682 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:17.898866 21682 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:17.901914 21682 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:17.901959 21682 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:17.901978 21682 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:17.901998 21682 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:17.905570 21682 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:44369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:33511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.182.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.21682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:17.906409 21682 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:17.907332 21682 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:17.912308 21692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:17.912312 21695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:17.912403 21693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:17.912487 21682 server_base.cc:1061] running on GCE node
I20260812 06:36:17.912899 21682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:17.913647 21682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:17.914803 21682 hybrid_clock.cc:648] HybridClock initialized: now 1786516577914781 us; error 35 us; skew 500 ppm
I20260812 06:36:17.916278 21682 webserver.cc:533] Webserver started at http://127.19.182.62:46419/ using document root <none> and password file <none>
I20260812 06:36:17.916767 21682 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:17.916823 21682 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:17.916987 21682 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:17.918404 21682 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/instance:
uuid: "b5d63889aba14c3aa4ac61062e9a3156"
format_stamp: "Formatted at 2026-08-12 06:36:17 on dist-test-slave-q9h9"
I20260812 06:36:17.918843 21682 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance:
uuid: "b5d63889aba14c3aa4ac61062e9a3156"
format_stamp: "Formatted at 2026-08-12 06:36:17 on dist-test-slave-q9h9"
I20260812 06:36:17.921710 21682 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:36:17.923606 21703 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:17.924444 21682 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:17.924546 21682 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
uuid: "b5d63889aba14c3aa4ac61062e9a3156"
format_stamp: "Formatted at 2026-08-12 06:36:17 on dist-test-slave-q9h9"
I20260812 06:36:17.924621 21682 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:17.946787 21682 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:17.947285 21682 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:17.947434 21682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:17.954093 21682 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.62:33511
I20260812 06:36:17.954078 21804 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.62:33511 every 8 connection(s)
I20260812 06:36:17.955000 21682 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:17.957567 21809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:17.960752 21809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:17.963909 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 21682
I20260812 06:36:17.964041 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance
I20260812 06:36:17.964645 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:43907
--webserver_interface=127.19.182.61
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:44369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:17.970168 21809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:17.970906 21707 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.61:43907: connect: Connection refused (error 111)
W20260812 06:36:17.971777 21809 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:43907: Network error: Client connection negotiation failed: client connection to 127.19.182.61:43907: connect: Connection refused (error 111)
I20260812 06:36:18.020969 21809 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } attempt: 1
W20260812 06:36:18.022373 21809 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:43907: Network error: Client connection negotiation failed: client connection to 127.19.182.61:43907: connect: Connection refused (error 111)
W20260812 06:36:18.066270 21816 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:18.066445 21816 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:18.066485 21816 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:18.069741 21816 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:18.069793 21816 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:18.069813 21816 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:18.069831 21816 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:18.073567 21816 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:44369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:43907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.182.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.21816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:18.074586 21816 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:18.075637 21816 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:18.080689 21835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:18.080685 21840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:18.080688 21834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:18.080763 21816 server_base.cc:1061] running on GCE node
I20260812 06:36:18.081341 21816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:18.082197 21816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:18.083338 21816 hybrid_clock.cc:648] HybridClock initialized: now 1786516578083327 us; error 23 us; skew 500 ppm
I20260812 06:36:18.084816 21816 webserver.cc:533] Webserver started at http://127.19.182.61:44345/ using document root <none> and password file <none>
I20260812 06:36:18.085319 21816 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:18.085374 21816 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:18.085544 21816 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:18.087016 21816 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/instance:
uuid: "0c0ba468700e4468a27e53833d9444e0"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.087512 21816 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance:
uuid: "0c0ba468700e4468a27e53833d9444e0"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.090508 21816 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:18.090530 21809 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } attempt: 2
W20260812 06:36:18.091886 21809 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:43907: Network error: Client connection negotiation failed: client connection to 127.19.182.61:43907: connect: Connection refused (error 111)
I20260812 06:36:18.092594 21852 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:18.093504 21816 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:18.093600 21816 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
uuid: "0c0ba468700e4468a27e53833d9444e0"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.093667 21816 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:18.112764 21816 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:18.113273 21816 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:18.113411 21816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:18.119993 21946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.61:43907 every 8 connection(s)
I20260812 06:36:18.119997 21816 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.61:43907
I20260812 06:36:18.120911 21816 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
I20260812 06:36:18.123481 21948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:18.126592 21948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:18.130406 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 21816
I20260812 06:36:18.130515 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance
I20260812 06:36:18.131062 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:35349
--webserver_interface=127.19.182.60
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:44369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:18.133936 21948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:18.139287 21948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:18.139928 21854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.60:35349: connect: Connection refused (error 111)
W20260812 06:36:18.140726 21948 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:35349: Network error: Client connection negotiation failed: client connection to 127.19.182.60:35349: connect: Connection refused (error 111)
I20260812 06:36:18.183054 21809 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } attempt: 3
I20260812 06:36:18.187186 21809 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:18.188401 21809 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:35349: Network error: Client connection negotiation failed: client connection to 127.19.182.60:35349: connect: Connection refused (error 111)
I20260812 06:36:18.189898 21948 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } attempt: 1
W20260812 06:36:18.190943 21948 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:35349: Network error: Client connection negotiation failed: client connection to 127.19.182.60:35349: connect: Connection refused (error 111)
I20260812 06:36:18.219544 21809 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } attempt: 1
W20260812 06:36:18.220597 21809 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:35349: Network error: Client connection negotiation failed: client connection to 127.19.182.60:35349: connect: Connection refused (error 111)
W20260812 06:36:18.233211 21956 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:18.233388 21956 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:18.233440 21956 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:18.236601 21956 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:18.236650 21956 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:18.236678 21956 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:18.236709 21956 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:18.240336 21956 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:44369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:35349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.182.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.21956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:18.241209 21956 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:18.242201 21956 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:18.247136 21976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:18.247258 21956 server_base.cc:1061] running on GCE node
W20260812 06:36:18.247196 21970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:18.247150 21972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:18.247813 21956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:18.248610 21956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:18.249786 21956 hybrid_clock.cc:648] HybridClock initialized: now 1786516578249769 us; error 31 us; skew 500 ppm
I20260812 06:36:18.251363 21956 webserver.cc:533] Webserver started at http://127.19.182.60:39073/ using document root <none> and password file <none>
I20260812 06:36:18.251861 21956 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:18.251920 21956 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:18.252095 21956 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:18.253449 21956 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/instance:
uuid: "a11d1d8e1938470aa5fbfe35c79cde89"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.253873 21956 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance:
uuid: "a11d1d8e1938470aa5fbfe35c79cde89"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.256837 21956 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 06:36:18.258711 21990 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:18.259087 21948 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } attempt: 2
I20260812 06:36:18.259770 21956 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:18.259887 21956 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
uuid: "a11d1d8e1938470aa5fbfe35c79cde89"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.259980 21956 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260812 06:36:18.260417 21948 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:35349: Network error: Client connection negotiation failed: client connection to 127.19.182.60:35349: connect: Connection refused (error 111)
I20260812 06:36:18.277781 21956 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:18.278385 21956 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:18.278535 21956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:18.285444 22091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.60:35349 every 8 connection(s)
I20260812 06:36:18.285449 21956 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.60:35349
I20260812 06:36:18.286419 21956 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
I20260812 06:36:18.286693 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 21956
I20260812 06:36:18.286783 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance
I20260812 06:36:18.289629 22092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:18.293323 22092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:18.296046 21809 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } attempt: 2
I20260812 06:36:18.301116 22092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:18.303174 21809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156: Bootstrap starting.
I20260812 06:36:18.305096 22092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:18.305464 21809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:18.306360 21809 log.cc:826] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:18.307950 21809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156: No bootstrap required, opened a new log
I20260812 06:36:18.310307 22092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: Bootstrap starting.
I20260812 06:36:18.311425 21809 raft_consensus.cc:359] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.311638 21809 raft_consensus.cc:385] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:18.311699 21809 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d63889aba14c3aa4ac61062e9a3156, State: Initialized, Role: FOLLOWER
I20260812 06:36:18.312093 22092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:18.312091 21809 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.312534 22104 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.312668 22104 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:18.312708 22092 log.cc:826] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:18.313158 21809 sys_catalog.cc:565] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:18.314321 22092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: No bootstrap required, opened a new log
I20260812 06:36:18.317200 22092 raft_consensus.cc:359] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.317379 22092 raft_consensus.cc:385] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:18.317435 22092 raft_consensus.cc:740] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11d1d8e1938470aa5fbfe35c79cde89, State: Initialized, Role: FOLLOWER
I20260812 06:36:18.317880 22092 consensus_queue.cc:260] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.318337 22133 sys_catalog.cc:455] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.318514 22133 sys_catalog.cc:458] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:36:18.318822 22128 catalog_manager.cc:1594] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:18.318882 22128 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:18.318951 22092 sys_catalog.cc:565] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:18.317687 21682 master_runner.cc:187] Error getting master registration for 127.19.182.61:43907: OK, instance_id { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" instance_seqno: 1786516578118321 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:36:18.319873 21682 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:36:18.324424 22159 catalog_manager.cc:1594] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:18.324540 22159 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:18.324461 21956 master_runner.cc:187] Error getting master registration for 127.19.182.61:43907: OK, instance_id { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" instance_seqno: 1786516578118321 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:36:18.325978 21956 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:18.351557 21948 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } attempt: 3
I20260812 06:36:18.357390 21948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0: Bootstrap starting.
I20260812 06:36:18.359452 21948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:18.360103 21948 log.cc:826] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:18.361538 21948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0: No bootstrap required, opened a new log
I20260812 06:36:18.364570 21948 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.364769 21948 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:18.364858 21948 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0ba468700e4468a27e53833d9444e0, State: Initialized, Role: FOLLOWER
I20260812 06:36:18.365295 21948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.366443 22162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.366518 21948 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:18.366595 22162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:36:18.371034 22197 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:18.371151 22197 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:18.373694 21816 master_runner.cc:264] No leader master found from master 0c0ba468700e4468a27e53833d9444e0
I20260812 06:36:18.373756 21816 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:18.430239 22104 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:18.430431 22104 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.431392 22104 leader_election.cc:290] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0ba468700e4468a27e53833d9444e0 (127.19.182.61:43907), a11d1d8e1938470aa5fbfe35c79cde89 (127.19.182.60:35349)
I20260812 06:36:18.432332 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5d63889aba14c3aa4ac61062e9a3156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ba468700e4468a27e53833d9444e0" is_pre_election: true
I20260812 06:36:18.432590 21901 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5d63889aba14c3aa4ac61062e9a3156 in term 0.
I20260812 06:36:18.433043 21707 leader_election.cc:304] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0, b5d63889aba14c3aa4ac61062e9a3156; no voters: 
I20260812 06:36:18.433473 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5d63889aba14c3aa4ac61062e9a3156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" is_pre_election: true
I20260812 06:36:18.433728 22040 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5d63889aba14c3aa4ac61062e9a3156 in term 0.
I20260812 06:36:18.434345 22104 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:18.434415 22104 raft_consensus.cc:493] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:18.434454 22104 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:18.435570 22104 raft_consensus.cc:515] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.435905 22104 leader_election.cc:290] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0ba468700e4468a27e53833d9444e0 (127.19.182.61:43907), a11d1d8e1938470aa5fbfe35c79cde89 (127.19.182.60:35349)
I20260812 06:36:18.436587 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5d63889aba14c3aa4ac61062e9a3156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0ba468700e4468a27e53833d9444e0"
I20260812 06:36:18.436697 21901 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:18.437704 21901 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5d63889aba14c3aa4ac61062e9a3156 in term 1.
I20260812 06:36:18.438081 21707 leader_election.cc:304] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0, b5d63889aba14c3aa4ac61062e9a3156; no voters: 
I20260812 06:36:18.438334 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5d63889aba14c3aa4ac61062e9a3156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11d1d8e1938470aa5fbfe35c79cde89"
I20260812 06:36:18.438433 22040 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:18.439441 22040 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5d63889aba14c3aa4ac61062e9a3156 in term 1.
I20260812 06:36:18.441583 22104 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:18.441776 22104 raft_consensus.cc:697] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 1 LEADER]: Becoming Leader. State: Replica: b5d63889aba14c3aa4ac61062e9a3156, State: Running, Role: LEADER
I20260812 06:36:18.442461 22104 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:18.444268 22104 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5d63889aba14c3aa4ac61062e9a3156. Latest consensus state: current_term: 1 leader_uuid: "b5d63889aba14c3aa4ac61062e9a3156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.444425 22104 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:18.444881 22203 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:18.445972 22203 catalog_manager.cc:1520] Initializing Kudu cluster ID...
W20260812 06:36:18.448594 21709 tablet.cc:2406] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:18.453251 22040 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 1 FOLLOWER]: Refusing update from remote peer b5d63889aba14c3aa4ac61062e9a3156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:18.453835 22199 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:18.457185 22133 sys_catalog.cc:455] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5d63889aba14c3aa4ac61062e9a3156. Latest consensus state: current_term: 1 leader_uuid: "b5d63889aba14c3aa4ac61062e9a3156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.457291 22133 sys_catalog.cc:458] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:18.458199 21901 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 1 FOLLOWER]: Refusing update from remote peer b5d63889aba14c3aa4ac61062e9a3156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:18.458750 22199 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:18.462806 22162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5d63889aba14c3aa4ac61062e9a3156. Latest consensus state: current_term: 1 leader_uuid: "b5d63889aba14c3aa4ac61062e9a3156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.462906 22162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:18.466774 22133 sys_catalog.cc:455] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5d63889aba14c3aa4ac61062e9a3156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.466867 22133 sys_catalog.cc:458] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:18.468024 22199 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5d63889aba14c3aa4ac61062e9a3156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.468122 22199 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:18.468304 22204 mvcc.cc:204] Tried to move back new op lower bound from 7317571905338085376 to 7317571905303887872. Current Snapshot: MvccSnapshot[applied={T|T < 7317571905338085376}]
I20260812 06:36:18.471095 22203 catalog_manager.cc:1383] Generated new cluster ID: 76c8a30f58c34958a37e5af1fb9fe37c
I20260812 06:36:18.471148 22203 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:18.474084 22209 mvcc.cc:204] Tried to move back new op lower bound from 7317571905338085376 to 7317571905303887872. Current Snapshot: MvccSnapshot[applied={T|T < 7317571905338085376 or (T in {7317571905338085376})}]
I20260812 06:36:18.486887 22104 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5d63889aba14c3aa4ac61062e9a3156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.486985 22104 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:18.488101 22162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5d63889aba14c3aa4ac61062e9a3156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:18.488199 22162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:18.492911 22211 mvcc.cc:204] Tried to move back new op lower bound from 7317571905338085376 to 7317571905303887872. Current Snapshot: MvccSnapshot[applied={T|T < 7317571905338085376}]
I20260812 06:36:18.506568 22203 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:18.507661 22203 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:18.530596 22203 catalog_manager.cc:6092] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156: Generated new TSK 0
I20260812 06:36:18.531308 22203 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:18.552948 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.1:0
--local_ip_for_outbound_sockets=127.19.182.1
--webserver_interface=127.19.182.1
--webserver_port=0
--tserver_master_addrs=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--builtin_ntp_servers=127.19.182.20:44369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 06:36:18.656632 22218 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:18.656795 22218 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:18.656842 22218 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:18.659974 22218 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:18.660077 22218 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.1
I20260812 06:36:18.663869 22218 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:44369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.182.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--never_fsync=true
--heap_profile_path=/tmp/kudu.22218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:18.664773 22218 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:18.665740 22218 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:18.671538 22228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:18.671519 22229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:18.671732 22218 server_base.cc:1061] running on GCE node
W20260812 06:36:18.671516 22232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:18.672020 22218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:18.672500 22218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:18.673668 22218 hybrid_clock.cc:648] HybridClock initialized: now 1786516578673657 us; error 29 us; skew 500 ppm
I20260812 06:36:18.675205 22218 webserver.cc:533] Webserver started at http://127.19.182.1:35107/ using document root <none> and password file <none>
I20260812 06:36:18.675704 22218 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:18.675761 22218 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:18.675925 22218 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:18.677331 22218 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/instance:
uuid: "cf920c9cb7784a1f87141d8b642e84eb"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.677760 22218 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal/instance:
uuid: "cf920c9cb7784a1f87141d8b642e84eb"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.680789 22218 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260812 06:36:18.682725 22248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:18.683609 22218 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:18.683699 22218 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
uuid: "cf920c9cb7784a1f87141d8b642e84eb"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.683789 22218 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:18.697606 22218 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:18.698221 22218 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:18.698380 22218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:18.698880 22218 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:18.699863 22218 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:18.699908 22218 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:18.699944 22218 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:18.699971 22218 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:18.708590 22218 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.1:33695
I20260812 06:36:18.708663 22473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.1:33695 every 8 connection(s)
I20260812 06:36:18.709535 22218 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:18.718639 22478 heartbeater.cc:344] Connected to a master server at 127.19.182.61:43907
I20260812 06:36:18.718652 22475 heartbeater.cc:344] Connected to a master server at 127.19.182.60:35349
I20260812 06:36:18.718760 22477 heartbeater.cc:344] Connected to a master server at 127.19.182.62:33511
I20260812 06:36:18.718878 22477 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:18.718881 22475 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:18.718883 22478 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:18.719391 22477 heartbeater.cc:507] Master 127.19.182.62:33511 requested a full tablet report, sending...
I20260812 06:36:18.719413 22478 heartbeater.cc:507] Master 127.19.182.61:43907 requested a full tablet report, sending...
I20260812 06:36:18.719408 22475 heartbeater.cc:507] Master 127.19.182.60:35349 requested a full tablet report, sending...
I20260812 06:36:18.719554 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 22218
I20260812 06:36:18.719663 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:18.720924 21884 ts_manager.cc:194] Registered new tserver with Master: cf920c9cb7784a1f87141d8b642e84eb (127.19.182.1:33695)
I20260812 06:36:18.721323 22019 ts_manager.cc:194] Registered new tserver with Master: cf920c9cb7784a1f87141d8b642e84eb (127.19.182.1:33695)
I20260812 06:36:18.722574 21723 ts_manager.cc:194] Registered new tserver with Master: cf920c9cb7784a1f87141d8b642e84eb (127.19.182.1:33695)
I20260812 06:36:18.722982 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.2:0
--local_ip_for_outbound_sockets=127.19.182.2
--webserver_interface=127.19.182.2
--webserver_port=0
--tserver_master_addrs=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--builtin_ntp_servers=127.19.182.20:44369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 06:36:18.723687 21723 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.1:42669
W20260812 06:36:18.826429 22484 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:18.826603 22484 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:18.826664 22484 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:18.829926 22484 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:18.830111 22484 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.2
I20260812 06:36:18.833743 22484 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:44369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.182.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--never_fsync=true
--heap_profile_path=/tmp/kudu.22484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:18.834681 22484 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:18.835714 22484 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:18.841630 22495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:18.841639 22503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:18.841740 22484 server_base.cc:1061] running on GCE node
W20260812 06:36:18.841648 22498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:18.842186 22484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:18.842682 22484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:18.843829 22484 hybrid_clock.cc:648] HybridClock initialized: now 1786516578843822 us; error 30 us; skew 500 ppm
I20260812 06:36:18.845292 22484 webserver.cc:533] Webserver started at http://127.19.182.2:41757/ using document root <none> and password file <none>
I20260812 06:36:18.845782 22484 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:18.845836 22484 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:18.846002 22484 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:18.847474 22484 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/instance:
uuid: "86a8650f93ea4ae19fcda7cf5ba5246d"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.847898 22484 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/instance:
uuid: "86a8650f93ea4ae19fcda7cf5ba5246d"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.850834 22484 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:36:18.852752 22510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:18.853605 22484 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:18.853698 22484 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
uuid: "86a8650f93ea4ae19fcda7cf5ba5246d"
format_stamp: "Formatted at 2026-08-12 06:36:18 on dist-test-slave-q9h9"
I20260812 06:36:18.853780 22484 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:18.884231 22484 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:18.884775 22484 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:18.884922 22484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:18.885414 22484 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:18.886556 22484 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:18.886611 22484 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:18.886667 22484 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:18.886695 22484 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:18.895063 22484 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.2:39275
I20260812 06:36:18.895109 22709 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.2:39275 every 8 connection(s)
I20260812 06:36:18.895927 22484 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:18.899005 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 22484
I20260812 06:36:18.899104 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:18.902418 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.3:0
--local_ip_for_outbound_sockets=127.19.182.3
--webserver_interface=127.19.182.3
--webserver_port=0
--tserver_master_addrs=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--builtin_ntp_servers=127.19.182.20:44369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 06:36:18.905710 22712 heartbeater.cc:344] Connected to a master server at 127.19.182.62:33511
I20260812 06:36:18.905769 22710 heartbeater.cc:344] Connected to a master server at 127.19.182.60:35349
I20260812 06:36:18.905928 22710 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:18.905930 22712 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:18.906008 22714 heartbeater.cc:344] Connected to a master server at 127.19.182.61:43907
I20260812 06:36:18.906092 22714 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:18.906437 22712 heartbeater.cc:507] Master 127.19.182.62:33511 requested a full tablet report, sending...
I20260812 06:36:18.906447 22710 heartbeater.cc:507] Master 127.19.182.60:35349 requested a full tablet report, sending...
I20260812 06:36:18.906453 22714 heartbeater.cc:507] Master 127.19.182.61:43907 requested a full tablet report, sending...
I20260812 06:36:18.907486 22019 ts_manager.cc:194] Registered new tserver with Master: 86a8650f93ea4ae19fcda7cf5ba5246d (127.19.182.2:39275)
I20260812 06:36:18.907487 21883 ts_manager.cc:194] Registered new tserver with Master: 86a8650f93ea4ae19fcda7cf5ba5246d (127.19.182.2:39275)
I20260812 06:36:18.907500 21723 ts_manager.cc:194] Registered new tserver with Master: 86a8650f93ea4ae19fcda7cf5ba5246d (127.19.182.2:39275)
I20260812 06:36:18.908154 21723 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.2:58593
W20260812 06:36:19.011523 22720 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:19.011699 22720 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:19.011772 22720 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:19.014963 22720 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:19.015079 22720 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.3
I20260812 06:36:19.018743 22720 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:44369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.182.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:33511,127.19.182.61:43907,127.19.182.60:35349
--never_fsync=true
--heap_profile_path=/tmp/kudu.22720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:19.019701 22720 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:19.020762 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:19.026594 22733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:19.026599 22729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:19.026599 22728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:19.026932 22720 server_base.cc:1061] running on GCE node
I20260812 06:36:19.027292 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:19.027832 22720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:19.028990 22720 hybrid_clock.cc:648] HybridClock initialized: now 1786516579028962 us; error 42 us; skew 500 ppm
I20260812 06:36:19.030656 22720 webserver.cc:533] Webserver started at http://127.19.182.3:32977/ using document root <none> and password file <none>
I20260812 06:36:19.031188 22720 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:19.031251 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:19.031406 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:19.032822 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/instance:
uuid: "ac52398dec6345e2b383de650d52b5d2"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-q9h9"
I20260812 06:36:19.033241 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/instance:
uuid: "ac52398dec6345e2b383de650d52b5d2"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-q9h9"
I20260812 06:36:19.036283 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:19.038142 22740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:19.039024 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:19.039126 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
uuid: "ac52398dec6345e2b383de650d52b5d2"
format_stamp: "Formatted at 2026-08-12 06:36:19 on dist-test-slave-q9h9"
I20260812 06:36:19.039202 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:19.051426 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:19.051924 22720 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:19.052074 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:19.052573 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:19.053493 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:19.053541 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:19.053588 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:19.053615 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:19.062173 22720 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.3:41477
I20260812 06:36:19.062229 22979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.3:41477 every 8 connection(s)
I20260812 06:36:19.063009 22720 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:19.070008 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 22720
I20260812 06:36:19.070143 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:19.071394 22982 heartbeater.cc:344] Connected to a master server at 127.19.182.62:33511
I20260812 06:36:19.071609 22982 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:19.071942 22980 heartbeater.cc:344] Connected to a master server at 127.19.182.60:35349
I20260812 06:36:19.072024 22980 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:19.072149 22982 heartbeater.cc:507] Master 127.19.182.62:33511 requested a full tablet report, sending...
I20260812 06:36:19.072181 22980 heartbeater.cc:507] Master 127.19.182.60:35349 requested a full tablet report, sending...
I20260812 06:36:19.072603 22983 heartbeater.cc:344] Connected to a master server at 127.19.182.61:43907
I20260812 06:36:19.072669 22983 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:19.072832 22983 heartbeater.cc:507] Master 127.19.182.61:43907 requested a full tablet report, sending...
I20260812 06:36:19.073182 21723 ts_manager.cc:194] Registered new tserver with Master: ac52398dec6345e2b383de650d52b5d2 (127.19.182.3:41477)
I20260812 06:36:19.073184 22019 ts_manager.cc:194] Registered new tserver with Master: ac52398dec6345e2b383de650d52b5d2 (127.19.182.3:41477)
I20260812 06:36:19.073573 21883 ts_manager.cc:194] Registered new tserver with Master: ac52398dec6345e2b383de650d52b5d2 (127.19.182.3:41477)
I20260812 06:36:19.073812 21723 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.3:51477
I20260812 06:36:19.075663 20184 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:19.083871 21723 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38104:
name: "default.test_delete_table_sync"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:19.084853 21723 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_delete_table_sync in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:19.103211 22362 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2bd5cb177b44a7b20f965e18f834f4 (DEFAULT_TABLE table=default.test_delete_table_sync [id=2889bff5a82340a5991a722112733b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:19.103650 22593 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2bd5cb177b44a7b20f965e18f834f4 (DEFAULT_TABLE table=default.test_delete_table_sync [id=2889bff5a82340a5991a722112733b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:19.103735 22850 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2bd5cb177b44a7b20f965e18f834f4 (DEFAULT_TABLE table=default.test_delete_table_sync [id=2889bff5a82340a5991a722112733b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:19.104069 22362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2bd5cb177b44a7b20f965e18f834f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:19.104511 22850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2bd5cb177b44a7b20f965e18f834f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:19.104511 22593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2bd5cb177b44a7b20f965e18f834f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:19.108837 23034 tablet_bootstrap.cc:492] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb: Bootstrap starting.
I20260812 06:36:19.110178 23038 tablet_bootstrap.cc:492] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Bootstrap starting.
I20260812 06:36:19.110431 23036 tablet_bootstrap.cc:492] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Bootstrap starting.
I20260812 06:36:19.111397 23034 tablet_bootstrap.cc:654] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:19.112038 23034 log.cc:826] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:19.112267 23036 tablet_bootstrap.cc:654] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:19.112272 23038 tablet_bootstrap.cc:654] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:19.113004 23038 log.cc:826] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:19.113150 23036 log.cc:826] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:19.114512 23038 tablet_bootstrap.cc:492] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: No bootstrap required, opened a new log
I20260812 06:36:19.114511 23034 tablet_bootstrap.cc:492] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb: No bootstrap required, opened a new log
I20260812 06:36:19.114521 23036 tablet_bootstrap.cc:492] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: No bootstrap required, opened a new log
I20260812 06:36:19.114688 23036 ts_tablet_manager.cc:1403] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 06:36:19.114689 23038 ts_tablet_manager.cc:1403] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:19.114689 23034 ts_tablet_manager.cc:1403] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:36:19.117334 23036 raft_consensus.cc:359] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.117499 23036 raft_consensus.cc:385] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:19.117584 23036 raft_consensus.cc:740] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac52398dec6345e2b383de650d52b5d2, State: Initialized, Role: FOLLOWER
I20260812 06:36:19.117784 23038 raft_consensus.cc:359] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.117973 23038 raft_consensus.cc:385] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:19.118046 23038 raft_consensus.cc:740] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86a8650f93ea4ae19fcda7cf5ba5246d, State: Initialized, Role: FOLLOWER
I20260812 06:36:19.117990 23036 consensus_queue.cc:260] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.118053 23034 raft_consensus.cc:359] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.118300 23034 raft_consensus.cc:385] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:19.118407 23034 raft_consensus.cc:740] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf920c9cb7784a1f87141d8b642e84eb, State: Initialized, Role: FOLLOWER
I20260812 06:36:19.118474 23038 consensus_queue.cc:260] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.118832 23036 ts_tablet_manager.cc:1434] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:19.118865 23034 consensus_queue.cc:260] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.119092 22712 heartbeater.cc:499] Master 127.19.182.62:33511 was elected leader, sending a full tablet report...
I20260812 06:36:19.119726 23034 ts_tablet_manager.cc:1434] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260812 06:36:19.120335 23038 ts_tablet_manager.cc:1434] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260812 06:36:19.121901 22477 heartbeater.cc:499] Master 127.19.182.62:33511 was elected leader, sending a full tablet report...
I20260812 06:36:19.130167 22982 heartbeater.cc:499] Master 127.19.182.62:33511 was elected leader, sending a full tablet report...
W20260812 06:36:19.146883 22715 tablet.cc:2406] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:19.210765 22479 tablet.cc:2406] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:19.314532 22985 tablet.cc:2406] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:19.325851 22159 catalog_manager.cc:1295] Loaded cluster ID: 76c8a30f58c34958a37e5af1fb9fe37c
I20260812 06:36:19.325911 22159 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: loading cluster ID for follower catalog manager: success
I20260812 06:36:19.327564 22159 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: acquiring CA information for follower catalog manager: success
I20260812 06:36:19.328613 22159 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:19.365574 23049 raft_consensus.cc:493] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:19.365748 23049 raft_consensus.cc:515] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.366827 23049 leader_election.cc:290] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac52398dec6345e2b383de650d52b5d2 (127.19.182.3:41477), 86a8650f93ea4ae19fcda7cf5ba5246d (127.19.182.2:39275)
I20260812 06:36:19.370587 22890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2bd5cb177b44a7b20f965e18f834f4" candidate_uuid: "cf920c9cb7784a1f87141d8b642e84eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac52398dec6345e2b383de650d52b5d2" is_pre_election: true
I20260812 06:36:19.370594 22624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2bd5cb177b44a7b20f965e18f834f4" candidate_uuid: "cf920c9cb7784a1f87141d8b642e84eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" is_pre_election: true
I20260812 06:36:19.370831 22624 raft_consensus.cc:2468] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf920c9cb7784a1f87141d8b642e84eb in term 0.
I20260812 06:36:19.370831 22890 raft_consensus.cc:2468] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf920c9cb7784a1f87141d8b642e84eb in term 0.
I20260812 06:36:19.371253 22261 leader_election.cc:304] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac52398dec6345e2b383de650d52b5d2, cf920c9cb7784a1f87141d8b642e84eb; no voters: 
I20260812 06:36:19.371477 23049 raft_consensus.cc:2804] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:19.371558 23049 raft_consensus.cc:493] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:19.371606 23049 raft_consensus.cc:3060] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:19.372553 22197 catalog_manager.cc:1295] Loaded cluster ID: 76c8a30f58c34958a37e5af1fb9fe37c
I20260812 06:36:19.372617 22197 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0: loading cluster ID for follower catalog manager: success
I20260812 06:36:19.372718 23049 raft_consensus.cc:515] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.373102 23049 leader_election.cc:290] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [CANDIDATE]: Term 1 election: Requested vote from peers ac52398dec6345e2b383de650d52b5d2 (127.19.182.3:41477), 86a8650f93ea4ae19fcda7cf5ba5246d (127.19.182.2:39275)
I20260812 06:36:19.373463 22624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2bd5cb177b44a7b20f965e18f834f4" candidate_uuid: "cf920c9cb7784a1f87141d8b642e84eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d"
I20260812 06:36:19.373584 22624 raft_consensus.cc:3060] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:19.374172 22890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2bd5cb177b44a7b20f965e18f834f4" candidate_uuid: "cf920c9cb7784a1f87141d8b642e84eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac52398dec6345e2b383de650d52b5d2"
I20260812 06:36:19.374287 22890 raft_consensus.cc:3060] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:19.374666 22624 raft_consensus.cc:2468] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf920c9cb7784a1f87141d8b642e84eb in term 1.
I20260812 06:36:19.374915 22197 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0: acquiring CA information for follower catalog manager: success
I20260812 06:36:19.375006 22251 leader_election.cc:304] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86a8650f93ea4ae19fcda7cf5ba5246d, cf920c9cb7784a1f87141d8b642e84eb; no voters: 
I20260812 06:36:19.375167 23049 raft_consensus.cc:2804] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:19.375160 22890 raft_consensus.cc:2468] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf920c9cb7784a1f87141d8b642e84eb in term 1.
I20260812 06:36:19.375347 23049 raft_consensus.cc:697] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [term 1 LEADER]: Becoming Leader. State: Replica: cf920c9cb7784a1f87141d8b642e84eb, State: Running, Role: LEADER
I20260812 06:36:19.375634 23049 consensus_queue.cc:237] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } }
I20260812 06:36:19.376029 22197 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:19.378482 21723 catalog_manager.cc:5719] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb reported cstate change: term changed from 0 to 1, leader changed from <none> to cf920c9cb7784a1f87141d8b642e84eb (127.19.182.1). New cstate: current_term: 1 leader_uuid: "cf920c9cb7784a1f87141d8b642e84eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf920c9cb7784a1f87141d8b642e84eb" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:19.452373 20184 master_failover-itest.cc:239] Pausing leader master
I20260812 06:36:19.831184 23055 consensus_queue.cc:1048] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86a8650f93ea4ae19fcda7cf5ba5246d" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:19.836719 23064 consensus_queue.cc:1048] T 5a2bd5cb177b44a7b20f965e18f834f4 P cf920c9cb7784a1f87141d8b642e84eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac52398dec6345e2b383de650d52b5d2" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 41477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:19.882885 23071 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5d63889aba14c3aa4ac61062e9a3156)
I20260812 06:36:19.882983 23071 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:19.883421 23073 raft_consensus.cc:493] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b5d63889aba14c3aa4ac61062e9a3156)
I20260812 06:36:19.883519 23073 raft_consensus.cc:515] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:19.883777 23071 leader_election.cc:290] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), a11d1d8e1938470aa5fbfe35c79cde89 (127.19.182.60:35349)
I20260812 06:36:19.884171 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" is_pre_election: true
I20260812 06:36:19.884291 22040 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ba468700e4468a27e53833d9444e0 in term 1.
I20260812 06:36:19.884352 23073 leader_election.cc:290] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), 0c0ba468700e4468a27e53833d9444e0 (127.19.182.61:43907)
I20260812 06:36:19.884656 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ba468700e4468a27e53833d9444e0" is_pre_election: true
I20260812 06:36:19.884682 21854 leader_election.cc:304] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0, a11d1d8e1938470aa5fbfe35c79cde89; no voters: 
I20260812 06:36:19.884788 21901 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11d1d8e1938470aa5fbfe35c79cde89 in term 1.
I20260812 06:36:19.884882 23071 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:36:19.884946 23071 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5d63889aba14c3aa4ac61062e9a3156)
I20260812 06:36:19.885020 23071 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:19.885073 21994 leader_election.cc:304] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0, a11d1d8e1938470aa5fbfe35c79cde89; no voters: 
I20260812 06:36:19.885280 23073 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:36:19.885334 23073 raft_consensus.cc:493] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b5d63889aba14c3aa4ac61062e9a3156)
I20260812 06:36:19.885362 23073 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:19.885896 23071 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:19.886260 23071 leader_election.cc:290] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 2 election: Requested vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), a11d1d8e1938470aa5fbfe35c79cde89 (127.19.182.60:35349)
I20260812 06:36:19.886271 23073 raft_consensus.cc:515] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:19.886595 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "a11d1d8e1938470aa5fbfe35c79cde89"
I20260812 06:36:19.886679 23073 leader_election.cc:290] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 2 election: Requested vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), 0c0ba468700e4468a27e53833d9444e0 (127.19.182.61:43907)
I20260812 06:36:19.886746 22040 raft_consensus.cc:2393] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ba468700e4468a27e53833d9444e0 in current term 2: Already voted for candidate a11d1d8e1938470aa5fbfe35c79cde89 in this term.
I20260812 06:36:19.886987 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ba468700e4468a27e53833d9444e0"
I20260812 06:36:19.887147 21901 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a11d1d8e1938470aa5fbfe35c79cde89 in current term 2: Already voted for candidate 0c0ba468700e4468a27e53833d9444e0 in this term.
W20260812 06:36:20.393751 21992 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.506s (SENT)
W20260812 06:36:20.627842 22712 heartbeater.cc:646] Failed to heartbeat to 127.19.182.62:33511 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.62:33511 timed out after 1.000s (SENT)
W20260812 06:36:20.634161 22982 heartbeater.cc:646] Failed to heartbeat to 127.19.182.62:33511 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.62:33511 timed out after 1.000s (SENT)
W20260812 06:36:20.837328 22477 heartbeater.cc:646] Failed to heartbeat to 127.19.182.62:33511 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.62:33511 timed out after 1.000s (SENT)
W20260812 06:36:20.901162 21992 leader_election.cc:336] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.506s (SENT)
I20260812 06:36:20.901273 21992 leader_election.cc:304] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11d1d8e1938470aa5fbfe35c79cde89; no voters: 0c0ba468700e4468a27e53833d9444e0, b5d63889aba14c3aa4ac61062e9a3156
I20260812 06:36:20.901556 23077 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 06:36:21.010656 21854 leader_election.cc:336] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.561s (SENT)
I20260812 06:36:21.010778 21854 leader_election.cc:304] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0; no voters: a11d1d8e1938470aa5fbfe35c79cde89, b5d63889aba14c3aa4ac61062e9a3156
I20260812 06:36:21.011125 23078 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 06:36:21.056007 21992 leader_election.cc:336] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.584s (SENT)
W20260812 06:36:21.303969 21854 leader_election.cc:336] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.709s (SENT)
I20260812 06:36:21.480449 23080 raft_consensus.cc:493] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:21.480572 23080 raft_consensus.cc:515] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:21.481020 23080 leader_election.cc:290] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), 0c0ba468700e4468a27e53833d9444e0 (127.19.182.61:43907)
I20260812 06:36:21.481447 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ba468700e4468a27e53833d9444e0" is_pre_election: true
I20260812 06:36:21.481587 21901 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11d1d8e1938470aa5fbfe35c79cde89 in term 2.
I20260812 06:36:21.481886 21994 leader_election.cc:304] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0, a11d1d8e1938470aa5fbfe35c79cde89; no voters: 
I20260812 06:36:21.482079 23080 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 06:36:21.482141 23080 raft_consensus.cc:493] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:21.482167 23080 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:36:21.483002 23080 raft_consensus.cc:515] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:21.483316 23080 leader_election.cc:290] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 3 election: Requested vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), 0c0ba468700e4468a27e53833d9444e0 (127.19.182.61:43907)
I20260812 06:36:21.483675 21901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "0c0ba468700e4468a27e53833d9444e0"
I20260812 06:36:21.483780 21901 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:36:21.484532 21901 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11d1d8e1938470aa5fbfe35c79cde89 in term 3.
I20260812 06:36:21.484800 21994 leader_election.cc:304] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0, a11d1d8e1938470aa5fbfe35c79cde89; no voters: 
I20260812 06:36:21.484972 23080 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:36:21.485167 23080 raft_consensus.cc:697] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [term 3 LEADER]: Becoming Leader. State: Replica: a11d1d8e1938470aa5fbfe35c79cde89, State: Running, Role: LEADER
I20260812 06:36:21.485467 23080 consensus_queue.cc:237] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:21.486716 23086 sys_catalog.cc:455] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a11d1d8e1938470aa5fbfe35c79cde89. Latest consensus state: current_term: 3 leader_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:21.486810 23086 sys_catalog.cc:458] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:21.487079 23089 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:21.488554 23089 catalog_manager.cc:679] Loaded metadata for table default.test_delete_table_sync [id=2889bff5a82340a5991a722112733b52]
I20260812 06:36:21.489554 23089 tablet_loader.cc:96] loaded metadata for tablet 5a2bd5cb177b44a7b20f965e18f834f4 (table default.test_delete_table_sync [id=2889bff5a82340a5991a722112733b52])
I20260812 06:36:21.489686 23089 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:21.490084 23089 catalog_manager.cc:1295] Loaded cluster ID: 76c8a30f58c34958a37e5af1fb9fe37c
I20260812 06:36:21.490127 23089 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:21.490641 23089 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:21.491003 23089 catalog_manager.cc:6103] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: Loaded TSK: 0
I20260812 06:36:21.491550 23089 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:21.893751 21901 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Refusing update from remote peer a11d1d8e1938470aa5fbfe35c79cde89: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
I20260812 06:36:21.894250 23086 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 06:36:21.895401 23090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a11d1d8e1938470aa5fbfe35c79cde89. Latest consensus state: current_term: 3 leader_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:21.895522 23090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:21.896499 23086 sys_catalog.cc:455] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:21.896605 23086 sys_catalog.cc:458] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:21.896916 23090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:21.897078 23090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:22.223367 22475 heartbeater.cc:499] Master 127.19.182.60:35349 was elected leader, sending a full tablet report...
I20260812 06:36:22.343811 22710 heartbeater.cc:499] Master 127.19.182.60:35349 was elected leader, sending a full tablet report...
I20260812 06:36:22.346006 22980 heartbeater.cc:499] Master 127.19.182.60:35349 was elected leader, sending a full tablet report...
I20260812 06:36:22.809427 23100 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11d1d8e1938470aa5fbfe35c79cde89)
I20260812 06:36:22.809563 23100 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:22.810001 23100 leader_election.cc:290] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), a11d1d8e1938470aa5fbfe35c79cde89 (127.19.182.60:35349)
I20260812 06:36:22.810524 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" is_pre_election: true
W20260812 06:36:23.038345 21992 leader_election.cc:336] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.777s (SENT)
W20260812 06:36:23.445473 21854 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.634s (SENT) [suppressed 4 similar messages]
W20260812 06:36:23.689375 21992 leader_election.cc:336] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 1.102s (SENT)
W20260812 06:36:24.081800 21854 leader_election.cc:336] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.634s (SENT)
I20260812 06:36:24.081894 21854 leader_election.cc:304] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0; no voters: a11d1d8e1938470aa5fbfe35c79cde89, b5d63889aba14c3aa4ac61062e9a3156
I20260812 06:36:24.082252 23110 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 06:36:24.589329 23112 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11d1d8e1938470aa5fbfe35c79cde89)
I20260812 06:36:24.589468 23112 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:24.589991 23112 leader_election.cc:290] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), a11d1d8e1938470aa5fbfe35c79cde89 (127.19.182.60:35349)
I20260812 06:36:24.590593 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" is_pre_election: true
W20260812 06:36:26.151839 21854 leader_election.cc:336] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.779s (SENT)
I20260812 06:36:26.151942 21854 leader_election.cc:304] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0; no voters: a11d1d8e1938470aa5fbfe35c79cde89, b5d63889aba14c3aa4ac61062e9a3156
I20260812 06:36:26.152277 23122 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 06:36:27.380801 23126 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11d1d8e1938470aa5fbfe35c79cde89)
I20260812 06:36:27.380932 23126 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:27.381299 23126 leader_election.cc:290] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), a11d1d8e1938470aa5fbfe35c79cde89 (127.19.182.60:35349)
I20260812 06:36:27.381680 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" is_pre_election: true
W20260812 06:36:28.420315 21854 leader_election.cc:336] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511): Timed out: RequestConsensusVote RPC to 127.19.182.62:33511 timed out after 0.518s (SENT)
I20260812 06:36:28.420419 21854 leader_election.cc:304] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0; no voters: a11d1d8e1938470aa5fbfe35c79cde89, b5d63889aba14c3aa4ac61062e9a3156
I20260812 06:36:28.420717 23133 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 06:36:29.007339 23136 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11d1d8e1938470aa5fbfe35c79cde89)
I20260812 06:36:29.007485 23136 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:29.007934 23136 leader_election.cc:290] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5d63889aba14c3aa4ac61062e9a3156 (127.19.182.62:33511), a11d1d8e1938470aa5fbfe35c79cde89 (127.19.182.60:35349)
I20260812 06:36:29.008479 22040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" is_pre_election: true
W20260812 06:36:29.466460 23001 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.19.182.62:33511)
I20260812 06:36:29.469028 22018 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54714:
table { table_name: "default.test_delete_table_sync" } modify_external_catalogs: true
I20260812 06:36:29.469275 22018 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54714:
table { table_name: "default.test_delete_table_sync" } modify_external_catalogs: true
I20260812 06:36:29.474424 22018 catalog_manager.cc:6006] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89: Sending DeleteTablet for 3 replicas of tablet 5a2bd5cb177b44a7b20f965e18f834f4
I20260812 06:36:29.477778 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 22218
I20260812 06:36:29.479108 21745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.479550 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156"
I20260812 06:36:29.479789 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156"
I20260812 06:36:29.480000 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.480188 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.480406 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156"
I20260812 06:36:29.480788 21735 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 06:36:29.480835 21735 raft_consensus.cc:740] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5d63889aba14c3aa4ac61062e9a3156, State: Running, Role: LEADER
I20260812 06:36:29.480959 21735 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } }
I20260812 06:36:29.481182 21735 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 1 FOLLOWER]: Advancing to term 3
I20260812 06:36:29.482079 21735 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Refusing update from remote peer a11d1d8e1938470aa5fbfe35c79cde89: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 3 index: 8. (index mismatch)
I20260812 06:36:29.482452 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.482494 21735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.482595 21734 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11d1d8e1938470aa5fbfe35c79cde89 in term 3.
I20260812 06:36:29.482784 21733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" candidate_term: 3 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156"
I20260812 06:36:29.482851 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.483078 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.483320 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156"
I20260812 06:36:29.483593 21854 leader_election.cc:304] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0ba468700e4468a27e53833d9444e0; no voters: a11d1d8e1938470aa5fbfe35c79cde89, b5d63889aba14c3aa4ac61062e9a3156
I20260812 06:36:29.483652 22128 catalog_manager.cc:1638] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:29.483754 21733 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11d1d8e1938470aa5fbfe35c79cde89 in term 3.
I20260812 06:36:29.483795 23136 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 0c0ba468700e4468a27e53833d9444e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 06:36:29.483938 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156"
I20260812 06:36:29.483944 21730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.484055 21739 raft_consensus.cc:2368] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0ba468700e4468a27e53833d9444e0 for earlier term 2. Current term is 3.
I20260812 06:36:29.484247 21741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.484352 21741 raft_consensus.cc:2368] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0ba468700e4468a27e53833d9444e0 for earlier term 2. Current term is 3.
I20260812 06:36:29.484498 21742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.484576 21742 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ba468700e4468a27e53833d9444e0 in term 3.
I20260812 06:36:29.484974 21735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.485072 21735 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ba468700e4468a27e53833d9444e0 in term 3.
I20260812 06:36:29.488471 21743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.488581 21743 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ba468700e4468a27e53833d9444e0 in term 3.
I20260812 06:36:29.488543 22593 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a2bd5cb177b44a7b20f965e18f834f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:36:29 UTC) from {username='slave'} at 127.0.0.1:46226
I20260812 06:36:29.489209 21745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c0ba468700e4468a27e53833d9444e0" candidate_term: 4 candidate_status { last_received { term: 3 index: 8 } } ignore_live_leader: false dest_uuid: "b5d63889aba14c3aa4ac61062e9a3156" is_pre_election: true
I20260812 06:36:29.489308 21745 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0ba468700e4468a27e53833d9444e0 in term 3.
I20260812 06:36:29.489840 23160 tablet_replica.cc:333] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: stopping tablet replica
I20260812 06:36:29.490242 23160 raft_consensus.cc:2243] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:29.490643 23160 raft_consensus.cc:2272] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:29.491988 23160 ts_tablet_manager.cc:1916] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:36:29.495152 23160 ts_tablet_manager.cc:1929] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 06:36:29.495328 23160 log.cc:1199] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Deleting WAL directory at /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/wals/5a2bd5cb177b44a7b20f965e18f834f4
I20260812 06:36:29.495774 23160 ts_tablet_manager.cc:1950] T 5a2bd5cb177b44a7b20f965e18f834f4 P 86a8650f93ea4ae19fcda7cf5ba5246d: Deleting consensus metadata
I20260812 06:36:29.501017 21991 catalog_manager.cc:5050] TS 86a8650f93ea4ae19fcda7cf5ba5246d (127.19.182.2:39275): tablet 5a2bd5cb177b44a7b20f965e18f834f4 (table default.test_delete_table_sync [id=2889bff5a82340a5991a722112733b52]) successfully deleted
I20260812 06:36:29.504114 22850 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a2bd5cb177b44a7b20f965e18f834f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:36:29 UTC) from {username='slave'} at 127.0.0.1:39564
I20260812 06:36:29.504633 23165 tablet_replica.cc:333] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: stopping tablet replica
I20260812 06:36:29.504985 23165 raft_consensus.cc:2243] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:36:29.505668 23145 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a11d1d8e1938470aa5fbfe35c79cde89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 06:36:29.505862 23165 raft_consensus.cc:2272] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:36:29.507016 23165 ts_tablet_manager.cc:1916] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:36:29.508890 23172 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:29.509039 22199 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a11d1d8e1938470aa5fbfe35c79cde89. Latest consensus state: current_term: 3 leader_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5d63889aba14c3aa4ac61062e9a3156" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 33511 } } peers { permanent_uuid: "0c0ba468700e4468a27e53833d9444e0" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 43907 } } peers { permanent_uuid: "a11d1d8e1938470aa5fbfe35c79cde89" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 35349 } } }
I20260812 06:36:29.509999 22199 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:29.510164 23172 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5d63889aba14c3aa4ac61062e9a3156 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:29.510965 23165 ts_tablet_manager.cc:1929] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 06:36:29.511102 23165 log.cc:1199] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Deleting WAL directory at /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestDeleteTableSync_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/wals/5a2bd5cb177b44a7b20f965e18f834f4
I20260812 06:36:29.511444 23165 ts_tablet_manager.cc:1950] T 5a2bd5cb177b44a7b20f965e18f834f4 P ac52398dec6345e2b383de650d52b5d2: Deleting consensus metadata
I20260812 06:36:29.512560 21993 catalog_manager.cc:5050] TS ac52398dec6345e2b383de650d52b5d2 (127.19.182.3:41477): tablet 5a2bd5cb177b44a7b20f965e18f834f4 (table default.test_delete_table_sync [id=2889bff5a82340a5991a722112733b52]) successfully deleted
W20260812 06:36:29.514848 21707 connection.cc:573] server connection from 127.19.182.1:42669 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:36:29.515450 23151 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 06:36:29.475375 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.19.182.1:33695 (local address 127.0.0.1:50352)
0812 06:36:29.475677 (+   302us) negotiation.cc:107] Waiting for socket to connect
0812 06:36:29.475692 (+    15us) client_negotiation.cc:175] Beginning negotiation
0812 06:36:29.475842 (+   150us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 06:36:29.476293 (+   451us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0812 06:36:29.476297 (+     4us) client_negotiation.cc:404] Received NEGOTIATE response from server
0812 06:36:29.476319 (+    22us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0812 06:36:29.476574 (+   255us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0812 06:36:29.476584 (+    10us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:36:29.514929 (+ 38345us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.182.1:33695: BlockingRecv error: recv got EOF from 127.19.182.1:33695 (error 108)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":89,"threads_started":1}
W20260812 06:36:29.515623 21994 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.1:33695: BlockingRecv error: recv got EOF from 127.19.182.1:33695 (error 108) [suppressed 3 similar messages]
I20260812 06:36:29.516525 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 22484
W20260812 06:36:29.522934 21994 catalog_manager.cc:4777] TS cf920c9cb7784a1f87141d8b642e84eb (127.19.182.1:33695): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5a2bd5cb177b44a7b20f965e18f834f4: Network error: Client connection negotiation failed: client connection to 127.19.182.1:33695: connect: Connection refused (error 111)
I20260812 06:36:29.528900 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 22720
I20260812 06:36:29.554103 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 21682
I20260812 06:36:29.570966 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 21816
I20260812 06:36:29.579792 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 21956
2026-08-12T06:36:29Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestDeleteTableSync/0 (11821 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestKUDU1374/0
2026-08-12T06:36:29Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:29Z Disabled control of system clock
I20260812 06:36:29.621315 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:44927
--webserver_interface=127.19.182.62
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 06:36:29.732563 23180 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:29.732724 23180 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:29.732759 23180 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:29.735877 23180 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:29.735925 23180 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:29.735944 23180 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:29.735960 23180 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:29.739519 23180 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:44927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.182.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.23180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:29.740327 23180 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:29.741230 23180 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:29.746605 23190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.746621 23192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.746624 23196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:29.746831 23180 server_base.cc:1061] running on GCE node
I20260812 06:36:29.747319 23180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:29.748103 23180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:29.749269 23180 hybrid_clock.cc:648] HybridClock initialized: now 1786516589749254 us; error 31 us; skew 500 ppm
I20260812 06:36:29.750841 23180 webserver.cc:533] Webserver started at http://127.19.182.62:34327/ using document root <none> and password file <none>
I20260812 06:36:29.751333 23180 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:29.751389 23180 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:29.751556 23180 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:29.752945 23180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/data/instance:
uuid: "4db5b0ebdf394f4089aa6c16a2599145"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-q9h9"
I20260812 06:36:29.753376 23180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance:
uuid: "4db5b0ebdf394f4089aa6c16a2599145"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-q9h9"
I20260812 06:36:29.756397 23180 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260812 06:36:29.758307 23202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:29.759171 23180 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:29.759285 23180 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/wal
uuid: "4db5b0ebdf394f4089aa6c16a2599145"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-q9h9"
I20260812 06:36:29.759361 23180 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:29.781765 23180 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:29.782323 23180 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:29.782472 23180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:29.789040 23305 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.62:44927 every 8 connection(s)
I20260812 06:36:29.789049 23180 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.62:44927
I20260812 06:36:29.790001 23180 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:29.792594 23307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:29.795800 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 23180
I20260812 06:36:29.795902 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance
I20260812 06:36:29.795740 23307 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:29.796505 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:46155
--webserver_interface=127.19.182.61
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:29.805209 23307 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:29.805922 23204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.61:46155: connect: Connection refused (error 111)
W20260812 06:36:29.806754 23307 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:46155: Network error: Client connection negotiation failed: client connection to 127.19.182.61:46155: connect: Connection refused (error 111)
I20260812 06:36:29.855955 23307 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } attempt: 1
W20260812 06:36:29.857445 23307 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:46155: Network error: Client connection negotiation failed: client connection to 127.19.182.61:46155: connect: Connection refused (error 111)
W20260812 06:36:29.900084 23315 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:29.900278 23315 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:29.900321 23315 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:29.903501 23315 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:29.903553 23315 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:29.903570 23315 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:29.903585 23315 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:29.907215 23315 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:46155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.182.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.23315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:29.908097 23315 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:29.909098 23315 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:29.913993 23324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.914079 23330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:29.914186 23326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:29.914330 23315 server_base.cc:1061] running on GCE node
I20260812 06:36:29.914740 23315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:29.915546 23315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:29.916713 23315 hybrid_clock.cc:648] HybridClock initialized: now 1786516589916694 us; error 35 us; skew 500 ppm
I20260812 06:36:29.918282 23315 webserver.cc:533] Webserver started at http://127.19.182.61:34967/ using document root <none> and password file <none>
I20260812 06:36:29.918787 23315 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:29.918844 23315 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:29.919011 23315 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:29.920415 23315 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/data/instance:
uuid: "c470df885c914fba8301c83e52d03647"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-q9h9"
I20260812 06:36:29.920858 23315 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance:
uuid: "c470df885c914fba8301c83e52d03647"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-q9h9"
I20260812 06:36:29.923899 23315 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:29.925594 23307 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } attempt: 2
I20260812 06:36:29.925840 23345 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260812 06:36:29.926864 23307 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:46155: Network error: Client connection negotiation failed: client connection to 127.19.182.61:46155: connect: Connection refused (error 111)
I20260812 06:36:29.926990 23315 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:29.927132 23315 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/wal
uuid: "c470df885c914fba8301c83e52d03647"
format_stamp: "Formatted at 2026-08-12 06:36:29 on dist-test-slave-q9h9"
I20260812 06:36:29.927210 23315 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:29.941859 23315 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:29.942446 23315 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:29.942600 23315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:29.949429 23445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.61:46155 every 8 connection(s)
I20260812 06:36:29.949427 23315 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.61:46155
I20260812 06:36:29.950440 23315 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
I20260812 06:36:29.952517 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 23315
I20260812 06:36:29.952613 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance
I20260812 06:36:29.953143 23448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:29.953171 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:40425
--webserver_interface=127.19.182.60
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:29.956332 23448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:29.964648 23448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:29.970646 23448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:29.971376 23349 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
W20260812 06:36:29.972205 23448 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:40425: Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
I20260812 06:36:30.018044 23307 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } attempt: 3
I20260812 06:36:30.021409 23448 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } attempt: 1
I20260812 06:36:30.022372 23307 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:30.022641 23448 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:40425: Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
W20260812 06:36:30.023718 23307 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:40425: Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
I20260812 06:36:30.054849 23307 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } attempt: 1
W20260812 06:36:30.056015 23307 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:40425: Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
W20260812 06:36:30.057933 23450 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:30.058171 23450 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:30.058235 23450 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:30.061347 23450 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:30.061395 23450 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:30.061421 23450 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:30.061445 23450 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:30.065135 23450 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:40425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.182.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.23450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:30.066002 23450 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:30.067005 23450 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:30.071851 23468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:30.071913 23450 server_base.cc:1061] running on GCE node
W20260812 06:36:30.071828 23470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:30.072008 23475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:30.072435 23450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:30.073199 23450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:30.074345 23450 hybrid_clock.cc:648] HybridClock initialized: now 1786516590074327 us; error 28 us; skew 500 ppm
I20260812 06:36:30.075831 23450 webserver.cc:533] Webserver started at http://127.19.182.60:36843/ using document root <none> and password file <none>
I20260812 06:36:30.076323 23450 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:30.076380 23450 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:30.076542 23450 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:30.077900 23450 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/data/instance:
uuid: "11da4fcd09da447d9c96b9ffe353d512"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.078387 23450 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance:
uuid: "11da4fcd09da447d9c96b9ffe353d512"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.081262 23450 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:36:30.083141 23483 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.084062 23450 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:30.084165 23450 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/wal
uuid: "11da4fcd09da447d9c96b9ffe353d512"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.084244 23450 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:30.090780 23448 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } attempt: 2
W20260812 06:36:30.091945 23448 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:40425: Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
I20260812 06:36:30.101976 23450 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:30.102561 23450 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:30.102728 23450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:30.109229 23450 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.60:40425
I20260812 06:36:30.109227 23576 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.60:40425 every 8 connection(s)
I20260812 06:36:30.110152 23450 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
I20260812 06:36:30.112708 23578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:30.115900 23578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:30.118881 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 23450
I20260812 06:36:30.118973 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance
I20260812 06:36:30.123847 23578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:30.128111 23578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:30.131146 23307 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } attempt: 2
I20260812 06:36:30.134104 23578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512: Bootstrap starting.
I20260812 06:36:30.136502 23578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.136668 23307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: Bootstrap starting.
I20260812 06:36:30.137295 23578 log.cc:826] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.138911 23307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.138953 23578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512: No bootstrap required, opened a new log
I20260812 06:36:30.139905 23307 log.cc:826] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.141443 23307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: No bootstrap required, opened a new log
I20260812 06:36:30.142083 23578 raft_consensus.cc:359] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.142261 23578 raft_consensus.cc:385] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:30.142320 23578 raft_consensus.cc:740] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11da4fcd09da447d9c96b9ffe353d512, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.142727 23578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.143144 23597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.143391 23597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:30.143827 23578 sys_catalog.cc:565] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:30.144519 23307 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.144712 23307 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:30.144778 23307 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db5b0ebdf394f4089aa6c16a2599145, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.145197 23307 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.145627 23611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.145793 23611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:30.146309 23307 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:36:30.149195 23625 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:30.149315 23625 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 06:36:30.152065 23646 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:30.152189 23646 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:30.150496 23180 master_runner.cc:187] Error getting master registration for 127.19.182.61:46155: OK, instance_id { permanent_uuid: "c470df885c914fba8301c83e52d03647" instance_seqno: 1786516589947657 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:36:30.152639 23180 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:30.153082 23450 master_runner.cc:187] Error getting master registration for 127.19.182.61:46155: OK, instance_id { permanent_uuid: "c470df885c914fba8301c83e52d03647" instance_seqno: 1786516589947657 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:36:30.155247 23450 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:30.183117 23448 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } attempt: 3
I20260812 06:36:30.190107 23448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: Bootstrap starting.
I20260812 06:36:30.192598 23448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.193638 23448 log.cc:826] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.195451 23448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: No bootstrap required, opened a new log
I20260812 06:36:30.198575 23448 raft_consensus.cc:359] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.198750 23448 raft_consensus.cc:385] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:30.198846 23448 raft_consensus.cc:740] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c470df885c914fba8301c83e52d03647, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.199277 23448 consensus_queue.cc:260] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.199759 23651 sys_catalog.cc:455] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.199929 23651 sys_catalog.cc:458] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:30.200404 23448 sys_catalog.cc:565] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:36:30.205101 23677 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:30.205226 23677 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:30.207808 23315 master_runner.cc:264] No leader master found from master c470df885c914fba8301c83e52d03647
I20260812 06:36:30.207866 23315 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:30.251998 23597 raft_consensus.cc:493] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:30.252185 23597 raft_consensus.cc:515] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.253116 23597 leader_election.cc:290] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db5b0ebdf394f4089aa6c16a2599145 (127.19.182.62:44927), c470df885c914fba8301c83e52d03647 (127.19.182.61:46155)
I20260812 06:36:30.253841 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11da4fcd09da447d9c96b9ffe353d512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db5b0ebdf394f4089aa6c16a2599145" is_pre_election: true
I20260812 06:36:30.254221 23257 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11da4fcd09da447d9c96b9ffe353d512 in term 0.
I20260812 06:36:30.254839 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11da4fcd09da447d9c96b9ffe353d512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470df885c914fba8301c83e52d03647" is_pre_election: true
I20260812 06:36:30.255087 23394 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11da4fcd09da447d9c96b9ffe353d512 in term 0.
I20260812 06:36:30.255542 23486 leader_election.cc:304] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11da4fcd09da447d9c96b9ffe353d512, 4db5b0ebdf394f4089aa6c16a2599145; no voters: 
I20260812 06:36:30.256186 23597 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:30.256254 23597 raft_consensus.cc:493] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:30.256292 23597 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:30.257426 23597 raft_consensus.cc:515] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.257776 23597 leader_election.cc:290] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [CANDIDATE]: Term 1 election: Requested vote from peers 4db5b0ebdf394f4089aa6c16a2599145 (127.19.182.62:44927), c470df885c914fba8301c83e52d03647 (127.19.182.61:46155)
I20260812 06:36:30.258315 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11da4fcd09da447d9c96b9ffe353d512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db5b0ebdf394f4089aa6c16a2599145"
I20260812 06:36:30.258419 23257 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:30.259469 23257 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11da4fcd09da447d9c96b9ffe353d512 in term 1.
I20260812 06:36:30.259894 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11da4fcd09da447d9c96b9ffe353d512" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c470df885c914fba8301c83e52d03647"
I20260812 06:36:30.259997 23394 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:30.261830 23394 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11da4fcd09da447d9c96b9ffe353d512 in term 1.
I20260812 06:36:30.262252 23486 leader_election.cc:304] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11da4fcd09da447d9c96b9ffe353d512, 4db5b0ebdf394f4089aa6c16a2599145; no voters: 
I20260812 06:36:30.264900 23597 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:30.265126 23597 raft_consensus.cc:697] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [term 1 LEADER]: Becoming Leader. State: Replica: 11da4fcd09da447d9c96b9ffe353d512, State: Running, Role: LEADER
I20260812 06:36:30.265419 23597 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:30.267222 23597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11da4fcd09da447d9c96b9ffe353d512. Latest consensus state: current_term: 1 leader_uuid: "11da4fcd09da447d9c96b9ffe353d512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.267412 23597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:30.267877 23683 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:30.268942 23683 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:30.273804 23394 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 1 FOLLOWER]: Refusing update from remote peer 11da4fcd09da447d9c96b9ffe353d512: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:30.274595 23680 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:30.278679 23651 sys_catalog.cc:455] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11da4fcd09da447d9c96b9ffe353d512. Latest consensus state: current_term: 1 leader_uuid: "11da4fcd09da447d9c96b9ffe353d512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.278791 23651 sys_catalog.cc:458] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:30.279781 23257 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Refusing update from remote peer 11da4fcd09da447d9c96b9ffe353d512: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:30.280396 23680 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:36:30.283668 23218 tablet.cc:2406] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:30.283684 23611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11da4fcd09da447d9c96b9ffe353d512. Latest consensus state: current_term: 1 leader_uuid: "11da4fcd09da447d9c96b9ffe353d512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.284132 23611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:30.289973 23680 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "11da4fcd09da447d9c96b9ffe353d512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.290134 23680 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:30.291178 23651 sys_catalog.cc:455] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "11da4fcd09da447d9c96b9ffe353d512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.291281 23651 sys_catalog.cc:458] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:30.291709 23684 mvcc.cc:204] Tried to move back new op lower bound from 7317571953755594752 to 7317571953730809856. Current Snapshot: MvccSnapshot[applied={T|T < 7317571953755594752}]
I20260812 06:36:30.293596 23685 mvcc.cc:204] Tried to move back new op lower bound from 7317571953755594752 to 7317571953730809856. Current Snapshot: MvccSnapshot[applied={T|T < 7317571953755594752}]
I20260812 06:36:30.295255 23683 catalog_manager.cc:1383] Generated new cluster ID: d8712dabb4b84262862d4ac6bf58644d
I20260812 06:36:30.295317 23683 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:30.300835 23597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "11da4fcd09da447d9c96b9ffe353d512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.300940 23597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:30.303778 23611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "11da4fcd09da447d9c96b9ffe353d512" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:30.303884 23611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:30.304855 23688 mvcc.cc:204] Tried to move back new op lower bound from 7317571953755594752 to 7317571953730809856. Current Snapshot: MvccSnapshot[applied={T|T < 7317571953755594752}]
I20260812 06:36:30.329843 23683 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:30.331032 23683 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:30.349188 23683 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 11da4fcd09da447d9c96b9ffe353d512: Generated new TSK 0
I20260812 06:36:30.349838 23683 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:30.364012 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.1:0
--local_ip_for_outbound_sockets=127.19.182.1
--webserver_interface=127.19.182.1
--webserver_port=0
--tserver_master_addrs=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--builtin_ntp_servers=127.19.182.20:35537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 06:36:30.464524 23696 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:30.464699 23696 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:30.464754 23696 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:30.467923 23696 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:30.468034 23696 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.1
I20260812 06:36:30.471647 23696 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.182.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--never_fsync=true
--heap_profile_path=/tmp/kudu.23696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:30.472491 23696 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:30.473451 23696 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:30.479028 23707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:30.479024 23717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:30.479028 23709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:30.479302 23696 server_base.cc:1061] running on GCE node
I20260812 06:36:30.479612 23696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:30.480077 23696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:30.481223 23696 hybrid_clock.cc:648] HybridClock initialized: now 1786516590481209 us; error 28 us; skew 500 ppm
I20260812 06:36:30.482745 23696 webserver.cc:533] Webserver started at http://127.19.182.1:36709/ using document root <none> and password file <none>
I20260812 06:36:30.483232 23696 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:30.483286 23696 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:30.483458 23696 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:30.484794 23696 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/data/instance:
uuid: "4fb1f680396542fc904fdcfef47dab12"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.485217 23696 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/wal/instance:
uuid: "4fb1f680396542fc904fdcfef47dab12"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.488139 23696 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:30.490080 23736 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.490942 23696 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:30.491034 23696 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
uuid: "4fb1f680396542fc904fdcfef47dab12"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.491117 23696 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:30.507463 23696 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:30.507957 23696 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:30.508097 23696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:30.508565 23696 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:30.509461 23696 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:30.509508 23696 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.509546 23696 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:30.509575 23696 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.517699 23696 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.1:33139
I20260812 06:36:30.517727 23959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.1:33139 every 8 connection(s)
I20260812 06:36:30.518522 23696 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:30.519424 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 23696
I20260812 06:36:30.519534 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:30.522696 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.2:0
--local_ip_for_outbound_sockets=127.19.182.2
--webserver_interface=127.19.182.2
--webserver_port=0
--tserver_master_addrs=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--builtin_ntp_servers=127.19.182.20:35537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 06:36:30.528714 23960 heartbeater.cc:344] Connected to a master server at 127.19.182.60:40425
I20260812 06:36:30.528805 23968 heartbeater.cc:344] Connected to a master server at 127.19.182.61:46155
I20260812 06:36:30.528990 23961 heartbeater.cc:344] Connected to a master server at 127.19.182.62:44927
I20260812 06:36:30.528987 23968 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.529129 23961 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.529608 23961 heartbeater.cc:507] Master 127.19.182.62:44927 requested a full tablet report, sending...
I20260812 06:36:30.528986 23960 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.529613 23968 heartbeater.cc:507] Master 127.19.182.61:46155 requested a full tablet report, sending...
I20260812 06:36:30.530357 23960 heartbeater.cc:507] Master 127.19.182.60:40425 requested a full tablet report, sending...
I20260812 06:36:30.531212 23238 ts_manager.cc:194] Registered new tserver with Master: 4fb1f680396542fc904fdcfef47dab12 (127.19.182.1:33139)
I20260812 06:36:30.531232 23372 ts_manager.cc:194] Registered new tserver with Master: 4fb1f680396542fc904fdcfef47dab12 (127.19.182.1:33139)
I20260812 06:36:30.532205 23514 ts_manager.cc:194] Registered new tserver with Master: 4fb1f680396542fc904fdcfef47dab12 (127.19.182.1:33139)
I20260812 06:36:30.533243 23514 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.1:39919
W20260812 06:36:30.625285 23981 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:30.625468 23981 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:30.625538 23981 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:30.628716 23981 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:30.628837 23981 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.2
I20260812 06:36:30.632529 23981 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.182.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--never_fsync=true
--heap_profile_path=/tmp/kudu.23981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:30.633338 23981 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:30.634300 23981 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:30.639812 23992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:30.639818 23995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:30.639890 24001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:30.640101 23981 server_base.cc:1061] running on GCE node
I20260812 06:36:30.640396 23981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:30.640867 23981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:30.642010 23981 hybrid_clock.cc:648] HybridClock initialized: now 1786516590641994 us; error 26 us; skew 500 ppm
I20260812 06:36:30.643522 23981 webserver.cc:533] Webserver started at http://127.19.182.2:41067/ using document root <none> and password file <none>
I20260812 06:36:30.644006 23981 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:30.644060 23981 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:30.644220 23981 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:30.645622 23981 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/data/instance:
uuid: "9f1408183000425f83856426cb8485e2"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.646077 23981 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/instance:
uuid: "9f1408183000425f83856426cb8485e2"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.649080 23981 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 06:36:30.651046 24013 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.651973 23981 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:30.652071 23981 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
uuid: "9f1408183000425f83856426cb8485e2"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.652176 23981 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:30.663672 23981 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:30.664177 23981 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:30.664305 23981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:30.664731 23981 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:30.665575 23981 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:30.665621 23981 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.665655 23981 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:30.665675 23981 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.673700 23981 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.2:42393
I20260812 06:36:30.673768 24223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.2:42393 every 8 connection(s)
I20260812 06:36:30.674526 23981 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:30.679066 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 23981
I20260812 06:36:30.679162 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:30.683297 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.3:0
--local_ip_for_outbound_sockets=127.19.182.3
--webserver_interface=127.19.182.3
--webserver_port=0
--tserver_master_addrs=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--builtin_ntp_servers=127.19.182.20:35537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 06:36:30.683336 24227 heartbeater.cc:344] Connected to a master server at 127.19.182.62:44927
I20260812 06:36:30.683534 24227 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.683904 24225 heartbeater.cc:344] Connected to a master server at 127.19.182.60:40425
I20260812 06:36:30.683990 24225 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.684018 24227 heartbeater.cc:507] Master 127.19.182.62:44927 requested a full tablet report, sending...
I20260812 06:36:30.684146 24225 heartbeater.cc:507] Master 127.19.182.60:40425 requested a full tablet report, sending...
I20260812 06:36:30.683339 24230 heartbeater.cc:344] Connected to a master server at 127.19.182.61:46155
I20260812 06:36:30.684545 24230 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.684741 24230 heartbeater.cc:507] Master 127.19.182.61:46155 requested a full tablet report, sending...
I20260812 06:36:30.684960 23514 ts_manager.cc:194] Registered new tserver with Master: 9f1408183000425f83856426cb8485e2 (127.19.182.2:42393)
I20260812 06:36:30.685112 23238 ts_manager.cc:194] Registered new tserver with Master: 9f1408183000425f83856426cb8485e2 (127.19.182.2:42393)
I20260812 06:36:30.685587 23514 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.2:59461
I20260812 06:36:30.685858 23372 ts_manager.cc:194] Registered new tserver with Master: 9f1408183000425f83856426cb8485e2 (127.19.182.2:42393)
W20260812 06:36:30.784650 24236 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:30.784827 24236 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:30.784873 24236 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:30.788015 24236 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:30.788120 24236 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.3
I20260812 06:36:30.791885 24236 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.182.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:44927,127.19.182.61:46155,127.19.182.60:40425
--never_fsync=true
--heap_profile_path=/tmp/kudu.24236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:30.792775 24236 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:30.793776 24236 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:30.799609 24250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:30.799540 24249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:30.799549 24252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:30.799989 24236 server_base.cc:1061] running on GCE node
I20260812 06:36:30.800354 24236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:30.800906 24236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:30.802098 24236 hybrid_clock.cc:648] HybridClock initialized: now 1786516590802063 us; error 46 us; skew 500 ppm
I20260812 06:36:30.803639 24236 webserver.cc:533] Webserver started at http://127.19.182.3:44459/ using document root <none> and password file <none>
I20260812 06:36:30.804140 24236 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:30.804196 24236 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:30.804360 24236 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:30.805684 24236 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/data/instance:
uuid: "d7facb0bb25f4605a2c8ada98433c8b6"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.806155 24236 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/instance:
uuid: "d7facb0bb25f4605a2c8ada98433c8b6"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.809115 24236 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:36:30.811287 24262 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.812131 24236 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:30.812220 24236 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
uuid: "d7facb0bb25f4605a2c8ada98433c8b6"
format_stamp: "Formatted at 2026-08-12 06:36:30 on dist-test-slave-q9h9"
I20260812 06:36:30.812304 24236 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:30.824977 24236 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:30.825443 24236 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:30.825578 24236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:30.826081 24236 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:30.826972 24236 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:30.827018 24236 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.827056 24236 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:30.827085 24236 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:30.835476 24236 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.3:45543
I20260812 06:36:30.835508 24458 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.3:45543 every 8 connection(s)
I20260812 06:36:30.836277 24236 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:30.840046 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 24236
I20260812 06:36:30.840157 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestKUDU1374_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:30.845557 24465 heartbeater.cc:344] Connected to a master server at 127.19.182.62:44927
I20260812 06:36:30.845638 24460 heartbeater.cc:344] Connected to a master server at 127.19.182.60:40425
I20260812 06:36:30.845764 24465 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.845767 24460 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.846280 24465 heartbeater.cc:507] Master 127.19.182.62:44927 requested a full tablet report, sending...
I20260812 06:36:30.846279 24460 heartbeater.cc:507] Master 127.19.182.60:40425 requested a full tablet report, sending...
I20260812 06:36:30.846825 24466 heartbeater.cc:344] Connected to a master server at 127.19.182.61:46155
I20260812 06:36:30.846930 24466 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:30.847184 24466 heartbeater.cc:507] Master 127.19.182.61:46155 requested a full tablet report, sending...
I20260812 06:36:30.847369 23238 ts_manager.cc:194] Registered new tserver with Master: d7facb0bb25f4605a2c8ada98433c8b6 (127.19.182.3:45543)
I20260812 06:36:30.847808 23514 ts_manager.cc:194] Registered new tserver with Master: d7facb0bb25f4605a2c8ada98433c8b6 (127.19.182.3:45543)
I20260812 06:36:30.847849 23372 ts_manager.cc:194] Registered new tserver with Master: d7facb0bb25f4605a2c8ada98433c8b6 (127.19.182.3:45543)
I20260812 06:36:30.848483 23514 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.3:50237
I20260812 06:36:30.860719 20184 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:30.868499 23514 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54164:
name: "default.test_kudu_1374"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:30.869454 23514 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.test_kudu_1374 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:30.886780 23823 tablet_service.cc:1511] Processing CreateTablet for tablet fa28329b3abc480d97c9e7ecc717855e (DEFAULT_TABLE table=default.test_kudu_1374 [id=42c14ab769254ae3a56c360b66d4b334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:30.886838 24104 tablet_service.cc:1511] Processing CreateTablet for tablet fa28329b3abc480d97c9e7ecc717855e (DEFAULT_TABLE table=default.test_kudu_1374 [id=42c14ab769254ae3a56c360b66d4b334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:30.887590 23823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa28329b3abc480d97c9e7ecc717855e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:30.887660 24104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa28329b3abc480d97c9e7ecc717855e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:30.892096 24514 tablet_bootstrap.cc:492] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: Bootstrap starting.
I20260812 06:36:30.892614 24340 tablet_service.cc:1511] Processing CreateTablet for tablet fa28329b3abc480d97c9e7ecc717855e (DEFAULT_TABLE table=default.test_kudu_1374 [id=42c14ab769254ae3a56c360b66d4b334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:30.892963 24515 tablet_bootstrap.cc:492] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: Bootstrap starting.
I20260812 06:36:30.893419 24340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa28329b3abc480d97c9e7ecc717855e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:30.894155 24514 tablet_bootstrap.cc:654] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.894972 24514 log.cc:826] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.895042 24515 tablet_bootstrap.cc:654] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.895829 24515 log.cc:826] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.896373 24514 tablet_bootstrap.cc:492] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: No bootstrap required, opened a new log
I20260812 06:36:30.896556 24514 ts_tablet_manager.cc:1403] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.003s
I20260812 06:36:30.897446 24515 tablet_bootstrap.cc:492] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: No bootstrap required, opened a new log
I20260812 06:36:30.897622 24515 ts_tablet_manager.cc:1403] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:36:30.899219 24524 tablet_bootstrap.cc:492] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: Bootstrap starting.
I20260812 06:36:30.899191 24514 raft_consensus.cc:359] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:30.899392 24514 raft_consensus.cc:385] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:30.899446 24514 raft_consensus.cc:740] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f1408183000425f83856426cb8485e2, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.899847 24514 consensus_queue.cc:260] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:30.900482 24225 heartbeater.cc:499] Master 127.19.182.60:40425 was elected leader, sending a full tablet report...
I20260812 06:36:30.900689 24514 ts_tablet_manager.cc:1434] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.001s
I20260812 06:36:30.900650 24515 raft_consensus.cc:359] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:30.900830 24515 raft_consensus.cc:385] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:30.900877 24515 raft_consensus.cc:740] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fb1f680396542fc904fdcfef47dab12, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.901299 24515 consensus_queue.cc:260] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:30.902120 24515 ts_tablet_manager.cc:1434] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:36:30.902489 23960 heartbeater.cc:499] Master 127.19.182.60:40425 was elected leader, sending a full tablet report...
I20260812 06:36:30.903991 24524 tablet_bootstrap.cc:654] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:30.904774 24524 log.cc:826] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:30.906365 24524 tablet_bootstrap.cc:492] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: No bootstrap required, opened a new log
I20260812 06:36:30.906540 24524 ts_tablet_manager.cc:1403] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: Time spent bootstrapping tablet: real 0.008s	user 0.004s	sys 0.000s
I20260812 06:36:30.908941 24524 raft_consensus.cc:359] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:30.909068 24524 raft_consensus.cc:385] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:30.909097 24524 raft_consensus.cc:740] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7facb0bb25f4605a2c8ada98433c8b6, State: Initialized, Role: FOLLOWER
I20260812 06:36:30.909368 24524 consensus_queue.cc:260] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:30.909871 24460 heartbeater.cc:499] Master 127.19.182.60:40425 was elected leader, sending a full tablet report...
I20260812 06:36:30.910002 24524 ts_tablet_manager.cc:1434] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
W20260812 06:36:30.925920 24232 tablet.cc:2406] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:31.020362 23972 tablet.cc:2406] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:31.087320 24467 tablet.cc:2406] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:31.131727 24526 raft_consensus.cc:493] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:31.131937 24526 raft_consensus.cc:515] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:31.133008 24526 leader_election.cc:290] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f1408183000425f83856426cb8485e2 (127.19.182.2:42393), d7facb0bb25f4605a2c8ada98433c8b6 (127.19.182.3:45543)
I20260812 06:36:31.137117 24371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa28329b3abc480d97c9e7ecc717855e" candidate_uuid: "4fb1f680396542fc904fdcfef47dab12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" is_pre_election: true
I20260812 06:36:31.137121 24132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa28329b3abc480d97c9e7ecc717855e" candidate_uuid: "4fb1f680396542fc904fdcfef47dab12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f1408183000425f83856426cb8485e2" is_pre_election: true
I20260812 06:36:31.137398 24371 raft_consensus.cc:2468] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fb1f680396542fc904fdcfef47dab12 in term 0.
I20260812 06:36:31.137398 24132 raft_consensus.cc:2468] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fb1f680396542fc904fdcfef47dab12 in term 0.
I20260812 06:36:31.137858 23739 leader_election.cc:304] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fb1f680396542fc904fdcfef47dab12, d7facb0bb25f4605a2c8ada98433c8b6; no voters: 
I20260812 06:36:31.138090 24526 raft_consensus.cc:2804] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:31.138159 24526 raft_consensus.cc:493] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:31.138187 24526 raft_consensus.cc:3060] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:31.139061 24526 raft_consensus.cc:515] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:31.139371 24526 leader_election.cc:290] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [CANDIDATE]: Term 1 election: Requested vote from peers 9f1408183000425f83856426cb8485e2 (127.19.182.2:42393), d7facb0bb25f4605a2c8ada98433c8b6 (127.19.182.3:45543)
I20260812 06:36:31.139766 24132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa28329b3abc480d97c9e7ecc717855e" candidate_uuid: "4fb1f680396542fc904fdcfef47dab12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f1408183000425f83856426cb8485e2"
I20260812 06:36:31.139783 24371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa28329b3abc480d97c9e7ecc717855e" candidate_uuid: "4fb1f680396542fc904fdcfef47dab12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7facb0bb25f4605a2c8ada98433c8b6"
I20260812 06:36:31.139873 24132 raft_consensus.cc:3060] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:31.139881 24371 raft_consensus.cc:3060] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:31.140682 24371 raft_consensus.cc:2468] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fb1f680396542fc904fdcfef47dab12 in term 1.
I20260812 06:36:31.140749 24132 raft_consensus.cc:2468] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fb1f680396542fc904fdcfef47dab12 in term 1.
I20260812 06:36:31.140973 23739 leader_election.cc:304] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fb1f680396542fc904fdcfef47dab12, d7facb0bb25f4605a2c8ada98433c8b6; no voters: 
I20260812 06:36:31.141163 24526 raft_consensus.cc:2804] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:31.141330 24526 raft_consensus.cc:697] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [term 1 LEADER]: Becoming Leader. State: Replica: 4fb1f680396542fc904fdcfef47dab12, State: Running, Role: LEADER
I20260812 06:36:31.141615 24526 consensus_queue.cc:237] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } }
I20260812 06:36:31.144445 23514 catalog_manager.cc:5719] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fb1f680396542fc904fdcfef47dab12 (127.19.182.1). New cstate: current_term: 1 leader_uuid: "4fb1f680396542fc904fdcfef47dab12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fb1f680396542fc904fdcfef47dab12" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 33139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:31.153272 23646 catalog_manager.cc:1295] Loaded cluster ID: d8712dabb4b84262862d4ac6bf58644d
I20260812 06:36:31.153326 23646 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: loading cluster ID for follower catalog manager: success
I20260812 06:36:31.155011 23646 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: acquiring CA information for follower catalog manager: success
I20260812 06:36:31.155967 23646 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:31.206516 23677 catalog_manager.cc:1295] Loaded cluster ID: d8712dabb4b84262862d4ac6bf58644d
I20260812 06:36:31.206583 23677 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: loading cluster ID for follower catalog manager: success
I20260812 06:36:31.208228 23677 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: acquiring CA information for follower catalog manager: success
I20260812 06:36:31.209234 23677 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:31.649919 24545 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 11da4fcd09da447d9c96b9ffe353d512)
I20260812 06:36:31.650059 24545 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:31.650913 24545 leader_election.cc:290] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470df885c914fba8301c83e52d03647 (127.19.182.61:46155), 11da4fcd09da447d9c96b9ffe353d512 (127.19.182.60:40425)
I20260812 06:36:31.651224 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4db5b0ebdf394f4089aa6c16a2599145" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c470df885c914fba8301c83e52d03647" is_pre_election: true
I20260812 06:36:31.651415 23528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4db5b0ebdf394f4089aa6c16a2599145" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "11da4fcd09da447d9c96b9ffe353d512" is_pre_election: true
I20260812 06:36:31.651902 23204 leader_election.cc:304] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db5b0ebdf394f4089aa6c16a2599145; no voters: 11da4fcd09da447d9c96b9ffe353d512, c470df885c914fba8301c83e52d03647
I20260812 06:36:31.652130 24545 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:36:31.660938 24546 consensus_queue.cc:1048] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7facb0bb25f4605a2c8ada98433c8b6" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:31.666515 24549 consensus_queue.cc:1048] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f1408183000425f83856426cb8485e2" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 42393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:32.172261 23563 generic_service.cc:175] {username='slave'} at 127.0.0.1:54140 changed flags via RPC: catalog_manager_fail_ts_rpcs from 'false' to 'true'
I20260812 06:36:32.173784 23514 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54164:
table { table_name: "default.test_kudu_1374" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "new_col" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
W20260812 06:36:32.178483 23514 catalog_manager.cc:5979] Failed to send alter table request: Runtime error: Async RPCs configured to fail
I20260812 06:36:32.179034 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 23450
W20260812 06:36:32.196106 23212 connection.cc:573] server connection from 127.0.0.1:36720 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:36:32.197508 24472 master_proxy_rpc.cc:203] Re-attempting IsAlterTableInProgres request to leader Master (127.19.182.60:40425)
W20260812 06:36:32.202484 23960 heartbeater.cc:646] Failed to heartbeat to 127.19.182.60:40425 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
W20260812 06:36:32.671182 24460 heartbeater.cc:646] Failed to heartbeat to 127.19.182.60:40425 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
W20260812 06:36:32.674111 24225 heartbeater.cc:646] Failed to heartbeat to 127.19.182.60:40425 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
I20260812 06:36:32.678956 24584 raft_consensus.cc:493] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 11da4fcd09da447d9c96b9ffe353d512)
I20260812 06:36:32.679049 24584 raft_consensus.cc:515] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:32.679924 24585 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 11da4fcd09da447d9c96b9ffe353d512)
I20260812 06:36:32.679980 24584 leader_election.cc:290] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db5b0ebdf394f4089aa6c16a2599145 (127.19.182.62:44927), 11da4fcd09da447d9c96b9ffe353d512 (127.19.182.60:40425)
I20260812 06:36:32.680053 24585 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:32.680261 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c470df885c914fba8301c83e52d03647" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "4db5b0ebdf394f4089aa6c16a2599145" is_pre_election: true
I20260812 06:36:32.680387 23257 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c470df885c914fba8301c83e52d03647 in term 1.
I20260812 06:36:32.680766 23350 leader_election.cc:304] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db5b0ebdf394f4089aa6c16a2599145, c470df885c914fba8301c83e52d03647; no voters: 
I20260812 06:36:32.680886 24585 leader_election.cc:290] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c470df885c914fba8301c83e52d03647 (127.19.182.61:46155), 11da4fcd09da447d9c96b9ffe353d512 (127.19.182.60:40425)
I20260812 06:36:32.681119 23394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4db5b0ebdf394f4089aa6c16a2599145" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "c470df885c914fba8301c83e52d03647" is_pre_election: true
I20260812 06:36:32.681119 24584 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:36:32.681303 24584 raft_consensus.cc:493] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 11da4fcd09da447d9c96b9ffe353d512)
W20260812 06:36:32.681679 23204 leader_election.cc:336] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 11da4fcd09da447d9c96b9ffe353d512 (127.19.182.60:40425): Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
I20260812 06:36:32.681609 24584 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 1 FOLLOWER]: Advancing to term 2
W20260812 06:36:32.681893 23349 leader_election.cc:336] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 11da4fcd09da447d9c96b9ffe353d512 (127.19.182.60:40425): Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
I20260812 06:36:32.682644 24584 raft_consensus.cc:515] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:32.682869 23394 raft_consensus.cc:2393] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db5b0ebdf394f4089aa6c16a2599145 in current term 2: Already voted for candidate c470df885c914fba8301c83e52d03647 in this term.
I20260812 06:36:32.682983 24584 leader_election.cc:290] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [CANDIDATE]: Term 2 election: Requested vote from peers 4db5b0ebdf394f4089aa6c16a2599145 (127.19.182.62:44927), 11da4fcd09da447d9c96b9ffe353d512 (127.19.182.60:40425)
I20260812 06:36:32.683275 23257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c470df885c914fba8301c83e52d03647" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "4db5b0ebdf394f4089aa6c16a2599145"
I20260812 06:36:32.683326 23204 leader_election.cc:304] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db5b0ebdf394f4089aa6c16a2599145; no voters: 11da4fcd09da447d9c96b9ffe353d512, c470df885c914fba8301c83e52d03647
I20260812 06:36:32.683378 23257 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 1 FOLLOWER]: Advancing to term 2
W20260812 06:36:32.683952 23349 leader_election.cc:336] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 11da4fcd09da447d9c96b9ffe353d512 (127.19.182.60:40425): Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111)
I20260812 06:36:32.684159 23257 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c470df885c914fba8301c83e52d03647 in term 2.
I20260812 06:36:32.684262 24585 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:36:32.684484 23350 leader_election.cc:304] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db5b0ebdf394f4089aa6c16a2599145, c470df885c914fba8301c83e52d03647; no voters: 11da4fcd09da447d9c96b9ffe353d512
I20260812 06:36:32.684682 24584 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:36:32.684820 24584 raft_consensus.cc:697] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [term 2 LEADER]: Becoming Leader. State: Replica: c470df885c914fba8301c83e52d03647, State: Running, Role: LEADER
I20260812 06:36:32.685079 24584 consensus_queue.cc:237] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } }
I20260812 06:36:32.685936 24590 sys_catalog.cc:455] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c470df885c914fba8301c83e52d03647. Latest consensus state: current_term: 2 leader_uuid: "c470df885c914fba8301c83e52d03647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:32.686049 24590 sys_catalog.cc:458] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:32.686360 24591 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:32.687647 24591 catalog_manager.cc:679] Loaded metadata for table default.test_kudu_1374 [id=42c14ab769254ae3a56c360b66d4b334]
I20260812 06:36:32.688567 24591 tablet_loader.cc:96] loaded metadata for tablet fa28329b3abc480d97c9e7ecc717855e (table default.test_kudu_1374 [id=42c14ab769254ae3a56c360b66d4b334])
I20260812 06:36:32.688700 24591 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:32.689055 24591 catalog_manager.cc:1295] Loaded cluster ID: d8712dabb4b84262862d4ac6bf58644d
I20260812 06:36:32.689100 24591 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:32.689603 24591 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:32.689966 24591 catalog_manager.cc:6103] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: Loaded TSK: 0
I20260812 06:36:32.690555 24591 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 06:36:33.119804 23349 consensus_peers.cc:597] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 -> Peer 11da4fcd09da447d9c96b9ffe353d512 (127.19.182.60:40425): Couldn't send request to peer 11da4fcd09da447d9c96b9ffe353d512. Status: Network error: Client connection negotiation failed: client connection to 127.19.182.60:40425: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:33.203744 23968 heartbeater.cc:499] Master 127.19.182.61:46155 was elected leader, sending a full tablet report...
I20260812 06:36:33.205348 23371 catalog_manager.cc:5811] TS 4fb1f680396542fc904fdcfef47dab12 (127.19.182.1:33139) does not have the latest schema for tablet fa28329b3abc480d97c9e7ecc717855e (table default.test_kudu_1374 [id=42c14ab769254ae3a56c360b66d4b334]). Expected version 1 got 0
I20260812 06:36:33.215070 24615 tablet.cc:1724] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    13:new_col INT32 NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 06:36:33.215442 24618 tablet.cc:1724] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    13:new_col INT32 NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 06:36:33.215840 24621 tablet.cc:1724] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NOT NULL,
    13:new_col INT32 NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260812 06:36:33.216150 24615 tablet.cc:1622] T fa28329b3abc480d97c9e7ecc717855e P 4fb1f680396542fc904fdcfef47dab12: MemRowSet was empty: no flush needed.
I20260812 06:36:33.216353 24618 tablet.cc:1622] T fa28329b3abc480d97c9e7ecc717855e P 9f1408183000425f83856426cb8485e2: MemRowSet was empty: no flush needed.
I20260812 06:36:33.216814 24621 tablet.cc:1622] T fa28329b3abc480d97c9e7ecc717855e P d7facb0bb25f4605a2c8ada98433c8b6: MemRowSet was empty: no flush needed.
I20260812 06:36:33.218472 24230 heartbeater.cc:499] Master 127.19.182.61:46155 was elected leader, sending a full tablet report...
I20260812 06:36:33.221364 24466 heartbeater.cc:499] Master 127.19.182.61:46155 was elected leader, sending a full tablet report...
I20260812 06:36:33.222774 23257 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [term 2 FOLLOWER]: Refusing update from remote peer c470df885c914fba8301c83e52d03647: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20260812 06:36:33.223214 24590 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 06:36:33.224550 24626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c470df885c914fba8301c83e52d03647. Latest consensus state: current_term: 2 leader_uuid: "c470df885c914fba8301c83e52d03647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:33.224664 24626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:33.226068 24590 sys_catalog.cc:455] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "c470df885c914fba8301c83e52d03647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:33.226174 24590 sys_catalog.cc:458] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:33.226460 24626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "c470df885c914fba8301c83e52d03647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db5b0ebdf394f4089aa6c16a2599145" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 44927 } } peers { permanent_uuid: "c470df885c914fba8301c83e52d03647" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 46155 } } peers { permanent_uuid: "11da4fcd09da447d9c96b9ffe353d512" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 40425 } } }
I20260812 06:36:33.226559 24626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db5b0ebdf394f4089aa6c16a2599145 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:33.227061 23371 catalog_manager.cc:6264] T 00000000000000000000000000000000 P c470df885c914fba8301c83e52d03647: default.test_kudu_1374 [id=42c14ab769254ae3a56c360b66d4b334] alter complete (version 1)
I20260812 06:36:33.233764 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 23696
I20260812 06:36:33.251711 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 23981
I20260812 06:36:33.262965 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 24236
I20260812 06:36:33.286069 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 23180
I20260812 06:36:33.298543 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 23315
2026-08-12T06:36:33Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestKUDU1374/0 (3715 ms)
[ RUN      ] HmsConfigurations/MasterFailoverTest.TestMasterPermanentFailure/0
2026-08-12T06:36:33Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:33Z Disabled control of system clock
I20260812 06:36:33.336889 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:35785
--webserver_interface=127.19.182.62
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 06:36:33.436039 24654 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:33.436216 24654 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:33.436259 24654 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:33.439396 24654 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:33.439445 24654 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:33.439464 24654 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:33.439495 24654 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:33.443105 24654 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:35785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.182.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.24654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:33.444031 24654 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:33.445037 24654 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:33.449944 24668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:33.449970 24661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:33.449959 24660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:33.450218 24654 server_base.cc:1061] running on GCE node
I20260812 06:36:33.450736 24654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:33.451514 24654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:33.452658 24654 hybrid_clock.cc:648] HybridClock initialized: now 1786516593452641 us; error 34 us; skew 500 ppm
I20260812 06:36:33.454226 24654 webserver.cc:533] Webserver started at http://127.19.182.62:46243/ using document root <none> and password file <none>
I20260812 06:36:33.454734 24654 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:33.454808 24654 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:33.454996 24654 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:33.456398 24654 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/instance:
uuid: "1ca3e3140b554813be67d29042c31ba6"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.456840 24654 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance:
uuid: "1ca3e3140b554813be67d29042c31ba6"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.459872 24654 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:33.461746 24678 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:33.462628 24654 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:33.462747 24654 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
uuid: "1ca3e3140b554813be67d29042c31ba6"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.462821 24654 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:33.480970 24654 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:33.481473 24654 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:33.481621 24654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:33.488128 24654 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.62:35785
I20260812 06:36:33.488134 24789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.62:35785 every 8 connection(s)
I20260812 06:36:33.488982 24654 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:33.490895 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 24654
I20260812 06:36:33.490984 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance
I20260812 06:36:33.491529 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:34983
--webserver_interface=127.19.182.61
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:33.491652 24790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:33.494781 24790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:33.506954 24790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:33.507587 24682 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.61:34983: connect: Connection refused (error 111)
W20260812 06:36:33.508323 24790 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:34983: Network error: Client connection negotiation failed: client connection to 127.19.182.61:34983: connect: Connection refused (error 111)
I20260812 06:36:33.557530 24790 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } attempt: 1
W20260812 06:36:33.558869 24790 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:34983: Network error: Client connection negotiation failed: client connection to 127.19.182.61:34983: connect: Connection refused (error 111)
W20260812 06:36:33.593297 24792 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:33.593461 24792 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:33.593513 24792 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:33.596696 24792 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:33.596747 24792 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:33.596774 24792 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:33.596796 24792 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:33.600373 24792 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:34983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.182.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.24792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:33.601230 24792 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:33.602231 24792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:33.606915 24813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:33.607013 24806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:33.607087 24792 server_base.cc:1061] running on GCE node
W20260812 06:36:33.607064 24807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:33.607532 24792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:33.608287 24792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:33.609438 24792 hybrid_clock.cc:648] HybridClock initialized: now 1786516593609422 us; error 28 us; skew 500 ppm
I20260812 06:36:33.610965 24792 webserver.cc:533] Webserver started at http://127.19.182.61:42567/ using document root <none> and password file <none>
I20260812 06:36:33.611451 24792 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:33.611507 24792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:33.611670 24792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:33.613062 24792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/instance:
uuid: "a64236e67a9c458d8160cf015bff12ac"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.613508 24792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance:
uuid: "a64236e67a9c458d8160cf015bff12ac"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.616822 24792 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260812 06:36:33.618996 24826 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:33.619867 24792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:36:33.619982 24792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
uuid: "a64236e67a9c458d8160cf015bff12ac"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.620066 24792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:33.627014 24790 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } attempt: 2
W20260812 06:36:33.628566 24790 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.61:34983: Network error: Client connection negotiation failed: client connection to 127.19.182.61:34983: connect: Connection refused (error 111)
I20260812 06:36:33.630926 24792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:33.631582 24792 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:33.631753 24792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:33.638478 24945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.61:34983 every 8 connection(s)
I20260812 06:36:33.638484 24792 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.61:34983
I20260812 06:36:33.639413 24792 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
I20260812 06:36:33.641989 24948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:33.645058 24948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:33.646992 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 24792
I20260812 06:36:33.647104 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance
I20260812 06:36:33.647768 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:36573
--webserver_interface=127.19.182.60
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:33.652645 24948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:33.658262 24948 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:33.658955 24834 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.60:36573: connect: Connection refused (error 111)
W20260812 06:36:33.659801 24948 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:36573: Network error: Client connection negotiation failed: client connection to 127.19.182.60:36573: connect: Connection refused (error 111)
I20260812 06:36:33.709002 24948 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } attempt: 1
W20260812 06:36:33.710314 24948 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:36573: Network error: Client connection negotiation failed: client connection to 127.19.182.60:36573: connect: Connection refused (error 111)
I20260812 06:36:33.719717 24790 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } attempt: 3
I20260812 06:36:33.723598 24790 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } has no permanent_uuid. Determining permanent_uuid...
W20260812 06:36:33.724852 24790 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:36573: Network error: Client connection negotiation failed: client connection to 127.19.182.60:36573: connect: Connection refused (error 111)
W20260812 06:36:33.748407 24961 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:33.748572 24961 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:33.748625 24961 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:33.751776 24961 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:33.751827 24961 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:33.751852 24961 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:33.751888 24961 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:33.756284 24961 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:36573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.182.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.24961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:33.756294 24790 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } attempt: 1
I20260812 06:36:33.757330 24961 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260812 06:36:33.757362 24790 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:36573: Network error: Client connection negotiation failed: client connection to 127.19.182.60:36573: connect: Connection refused (error 111)
I20260812 06:36:33.758363 24961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:33.763024 24980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:33.763046 24971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:33.763211 24961 server_base.cc:1061] running on GCE node
W20260812 06:36:33.763029 24975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:33.763684 24961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:33.764444 24961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:33.765585 24961 hybrid_clock.cc:648] HybridClock initialized: now 1786516593765570 us; error 25 us; skew 500 ppm
I20260812 06:36:33.767098 24961 webserver.cc:533] Webserver started at http://127.19.182.60:39851/ using document root <none> and password file <none>
I20260812 06:36:33.767611 24961 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:33.767661 24961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:33.767824 24961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:33.769158 24961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/instance:
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.769572 24961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance:
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.772469 24961 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260812 06:36:33.774326 24987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:33.775173 24961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:33.775280 24961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:33.775359 24961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:33.778466 24948 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } attempt: 2
W20260812 06:36:33.779623 24948 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.19.182.60:36573: Network error: Client connection negotiation failed: client connection to 127.19.182.60:36573: connect: Connection refused (error 111)
I20260812 06:36:33.799304 24961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:33.799783 24961 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:33.799911 24961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:33.806310 24961 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.60:36573
I20260812 06:36:33.806315 25087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.60:36573 every 8 connection(s)
I20260812 06:36:33.807179 24961 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
I20260812 06:36:33.809823 25088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:33.813177 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 24961
I20260812 06:36:33.813287 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance
I20260812 06:36:33.813048 25088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:33.821503 25088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:33.825744 25088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:36:33.830463 25088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Bootstrap starting.
I20260812 06:36:33.832505 24790 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } attempt: 2
I20260812 06:36:33.832576 25088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:33.833634 25088 log.cc:826] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:33.835235 25088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: No bootstrap required, opened a new log
I20260812 06:36:33.838378 24790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Bootstrap starting.
I20260812 06:36:33.838408 25088 raft_consensus.cc:359] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:33.838581 25088 raft_consensus.cc:385] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:33.838639 25088 raft_consensus.cc:740] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e5df2c51e84400916b9e114c9aca13, State: Initialized, Role: FOLLOWER
I20260812 06:36:33.839066 25088 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:33.839526 25101 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:33.839643 25101 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:33.840215 25088 sys_catalog.cc:565] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:33.840705 24790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:33.841791 24790 log.cc:826] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:33.843761 24790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: No bootstrap required, opened a new log
W20260812 06:36:33.845201 25116 catalog_manager.cc:1594] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:33.845322 25116 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:33.843897 24961 master_runner.cc:187] Error getting master registration for 127.19.182.62:35785: OK, instance_id { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" instance_seqno: 1786516593486343 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:36:33.845836 24961 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:33.846824 24790 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:33.846998 24790 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:33.847059 24790 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ca3e3140b554813be67d29042c31ba6, State: Initialized, Role: FOLLOWER
I20260812 06:36:33.847469 24790 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:33.847901 25122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:33.847999 25122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:33.848562 24790 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:36:33.853634 25140 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:33.853791 25140 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:33.853634 24654 master_runner.cc:187] Error getting master registration for 127.19.182.61:34983: OK, instance_id { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" instance_seqno: 1786516593636681 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:36:33.855376 24654 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:33.870803 24948 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } attempt: 3
I20260812 06:36:33.876224 24948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: Bootstrap starting.
I20260812 06:36:33.878181 24948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:33.878871 24948 log.cc:826] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:33.881536 24948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: No bootstrap required, opened a new log
I20260812 06:36:33.884264 24948 raft_consensus.cc:359] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:33.884398 24948 raft_consensus.cc:385] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:33.884444 24948 raft_consensus.cc:740] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a64236e67a9c458d8160cf015bff12ac, State: Initialized, Role: FOLLOWER
I20260812 06:36:33.884831 24948 consensus_queue.cc:260] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:33.885269 25145 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:33.885422 25145 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:33.885859 24948 sys_catalog.cc:565] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: configured and running, proceeding with master startup.
W20260812 06:36:33.890473 25166 catalog_manager.cc:1594] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:36:33.890596 25166 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:36:33.893953 24792 master_runner.cc:264] No leader master found from master a64236e67a9c458d8160cf015bff12ac
I20260812 06:36:33.894037 24792 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:36:33.982875 24690 tablet.cc:2406] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:34.050951 25004 tablet.cc:2406] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:34.076593 25101 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:34.076823 25101 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:34.077953 25101 leader_election.cc:290] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983)
I20260812 06:36:34.078675 24739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:36:34.078985 24739 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e5df2c51e84400916b9e114c9aca13 in term 0.
I20260812 06:36:34.079473 24995 leader_election.cc:304] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13; no voters: 
I20260812 06:36:34.079900 25101 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:34.079895 24890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:36:34.079965 25101 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:34.080016 25101 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:34.080143 24890 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e5df2c51e84400916b9e114c9aca13 in term 0.
I20260812 06:36:34.081019 25101 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:34.081357 25101 leader_election.cc:290] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 1 election: Requested vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983)
I20260812 06:36:34.081677 24739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6"
I20260812 06:36:34.081794 24739 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:34.081897 24890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac"
I20260812 06:36:34.081992 24890 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:34.082861 24739 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e5df2c51e84400916b9e114c9aca13 in term 1.
I20260812 06:36:34.083045 24890 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e5df2c51e84400916b9e114c9aca13 in term 1.
I20260812 06:36:34.083259 24995 leader_election.cc:304] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13; no voters: 
I20260812 06:36:34.083442 25101 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:34.083666 25101 raft_consensus.cc:697] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 1 LEADER]: Becoming Leader. State: Replica: c6e5df2c51e84400916b9e114c9aca13, State: Running, Role: LEADER
I20260812 06:36:34.083976 25101 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:34.085783 25172 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:34.085883 25172 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:34.086354 25174 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:34.087319 25174 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:34.091691 24739 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Refusing update from remote peer c6e5df2c51e84400916b9e114c9aca13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:34.091745 24890 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Refusing update from remote peer c6e5df2c51e84400916b9e114c9aca13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:34.092247 25172 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:34.092413 25101 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:34.096004 25145 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:34.096004 25122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:34.096108 25145 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:34.096108 25122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:34.098091 25172 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:34.098192 25172 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:34.098518 25172 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:34.098606 25172 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:34.098644 25145 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:34.098724 25178 mvcc.cc:204] Tried to move back new op lower bound from 7317571969393836032 to 7317571969370562560. Current Snapshot: MvccSnapshot[applied={T|T < 7317571969393836032}]
I20260812 06:36:34.098747 25145 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:34.099409 25122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:34.099505 25122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:34.100129 25174 catalog_manager.cc:1383] Generated new cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:36:34.100188 25174 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:34.114503 25174 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:34.115446 25174 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:34.122188 25174 catalog_manager.cc:6092] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Generated new TSK 0
I20260812 06:36:34.122799 25174 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:34.126166 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.1:0
--local_ip_for_outbound_sockets=127.19.182.1
--webserver_interface=127.19.182.1
--webserver_port=0
--tserver_master_addrs=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 06:36:34.227419 25190 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:34.227581 25190 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:34.227627 25190 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:34.230789 25190 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:34.230885 25190 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.1
I20260812 06:36:34.234575 25190 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.182.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--never_fsync=true
--heap_profile_path=/tmp/kudu.25190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:34.235448 25190 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:34.236421 25190 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:34.242271 25198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:34.242348 25200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:34.242448 25190 server_base.cc:1061] running on GCE node
W20260812 06:36:34.242354 25205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:34.242882 25190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:34.243362 25190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:34.244503 25190 hybrid_clock.cc:648] HybridClock initialized: now 1786516594244491 us; error 34 us; skew 500 ppm
I20260812 06:36:34.245993 25190 webserver.cc:533] Webserver started at http://127.19.182.1:42305/ using document root <none> and password file <none>
I20260812 06:36:34.246516 25190 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:34.246574 25190 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:34.246747 25190 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:34.248103 25190 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/data/instance:
uuid: "4e25f5f8fe0f45af9927988652e84b3c"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.248528 25190 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/wal/instance:
uuid: "4e25f5f8fe0f45af9927988652e84b3c"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.251617 25190 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:34.253489 25220 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.254391 25190 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:34.254489 25190 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
uuid: "4e25f5f8fe0f45af9927988652e84b3c"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.254565 25190 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:34.270486 25190 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:34.270977 25190 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:34.271122 25190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:34.271577 25190 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:34.272476 25190 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:34.272522 25190 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.272569 25190 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:34.272596 25190 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.280846 25190 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.1:46275
I20260812 06:36:34.280877 25411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.1:46275 every 8 connection(s)
I20260812 06:36:34.281621 25190 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:34.289824 25413 heartbeater.cc:344] Connected to a master server at 127.19.182.62:35785
I20260812 06:36:34.289911 25412 heartbeater.cc:344] Connected to a master server at 127.19.182.60:36573
I20260812 06:36:34.290051 25413 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.290086 25414 heartbeater.cc:344] Connected to a master server at 127.19.182.61:34983
I20260812 06:36:34.290144 25414 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.290583 25414 heartbeater.cc:507] Master 127.19.182.61:34983 requested a full tablet report, sending...
I20260812 06:36:34.290583 25413 heartbeater.cc:507] Master 127.19.182.62:35785 requested a full tablet report, sending...
I20260812 06:36:34.290052 25412 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.290875 25412 heartbeater.cc:507] Master 127.19.182.60:36573 requested a full tablet report, sending...
I20260812 06:36:34.291519 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 25190
I20260812 06:36:34.291625 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:34.292063 25016 ts_manager.cc:194] Registered new tserver with Master: 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275)
I20260812 06:36:34.292062 24715 ts_manager.cc:194] Registered new tserver with Master: 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275)
I20260812 06:36:34.292062 24859 ts_manager.cc:194] Registered new tserver with Master: 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275)
I20260812 06:36:34.293493 25016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.1:34611
I20260812 06:36:34.294305 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.2:0
--local_ip_for_outbound_sockets=127.19.182.2
--webserver_interface=127.19.182.2
--webserver_port=0
--tserver_master_addrs=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 06:36:34.392589 25420 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:34.392740 25420 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:34.392799 25420 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:34.395934 25420 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:34.396040 25420 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.2
I20260812 06:36:34.399603 25420 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.182.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--never_fsync=true
--heap_profile_path=/tmp/kudu.25420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:34.400393 25420 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:34.401319 25420 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:34.406688 25436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:34.406685 25438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:34.406708 25441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:34.406939 25420 server_base.cc:1061] running on GCE node
I20260812 06:36:34.407259 25420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:34.407685 25420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:34.408828 25420 hybrid_clock.cc:648] HybridClock initialized: now 1786516594408817 us; error 29 us; skew 500 ppm
I20260812 06:36:34.410248 25420 webserver.cc:533] Webserver started at http://127.19.182.2:33897/ using document root <none> and password file <none>
I20260812 06:36:34.410712 25420 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:34.410775 25420 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:34.410948 25420 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:34.412237 25420 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/data/instance:
uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.412644 25420 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/instance:
uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.415493 25420 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:34.417281 25458 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.418187 25420 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:34.418287 25420 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.418360 25420 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:34.450532 25420 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:34.451079 25420 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:34.451246 25420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:34.451717 25420 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:34.452600 25420 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:34.452646 25420 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.452679 25420 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:34.452698 25420 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.461108 25420 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.2:43541
I20260812 06:36:34.461148 25660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.2:43541 every 8 connection(s)
I20260812 06:36:34.461918 25420 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:34.469420 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 25420
I20260812 06:36:34.469528 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:34.470307 25663 heartbeater.cc:344] Connected to a master server at 127.19.182.61:34983
I20260812 06:36:34.470324 25662 heartbeater.cc:344] Connected to a master server at 127.19.182.62:35785
I20260812 06:36:34.470534 25662 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.470534 25663 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.471060 25663 heartbeater.cc:507] Master 127.19.182.61:34983 requested a full tablet report, sending...
I20260812 06:36:34.471071 25662 heartbeater.cc:507] Master 127.19.182.62:35785 requested a full tablet report, sending...
I20260812 06:36:34.472044 24715 ts_manager.cc:194] Registered new tserver with Master: d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:34.472115 24859 ts_manager.cc:194] Registered new tserver with Master: d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:34.472492 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.182.3:0
--local_ip_for_outbound_sockets=127.19.182.3
--webserver_interface=127.19.182.3
--webserver_port=0
--tserver_master_addrs=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 06:36:34.474712 25661 heartbeater.cc:344] Connected to a master server at 127.19.182.60:36573
I20260812 06:36:34.474800 25661 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.474939 25661 heartbeater.cc:507] Master 127.19.182.60:36573 requested a full tablet report, sending...
I20260812 06:36:34.475476 25016 ts_manager.cc:194] Registered new tserver with Master: d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:34.475991 25016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.2:50197
W20260812 06:36:34.578516 25669 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:34.578689 25669 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:34.578742 25669 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:34.581876 25669 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:34.581974 25669 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.182.3
I20260812 06:36:34.585539 25669 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.182.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.182.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--never_fsync=true
--heap_profile_path=/tmp/kudu.25669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.182.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:34.586545 25669 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:34.587831 25669 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:34.595114 25681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:34.595106 25678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:34.595331 25669 server_base.cc:1061] running on GCE node
W20260812 06:36:34.595538 25679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:34.595876 25669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:34.596346 25669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:34.597491 25669 hybrid_clock.cc:648] HybridClock initialized: now 1786516594597476 us; error 29 us; skew 500 ppm
I20260812 06:36:34.599037 25669 webserver.cc:533] Webserver started at http://127.19.182.3:39549/ using document root <none> and password file <none>
I20260812 06:36:34.599534 25669 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:34.599586 25669 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:34.599766 25669 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:34.601127 25669 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/data/instance:
uuid: "7b051808a9564a54a44175cacdeaa851"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.601552 25669 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/instance:
uuid: "7b051808a9564a54a44175cacdeaa851"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.604449 25669 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:34.606419 25691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.607255 25669 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:34.607352 25669 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
uuid: "7b051808a9564a54a44175cacdeaa851"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.607429 25669 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:34.619990 25669 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:34.620512 25669 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:34.620656 25669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:34.621132 25669 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:36:34.622136 25669 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:34.622185 25669 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.622234 25669 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:34.622262 25669 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:34.622951 25709 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:36:34.623095 25709 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:34.623950 25709 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:34.624558 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:34.625073 24739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:36:34.625612 24834 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:34.625862 25709 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:36:34.631727 25669 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.3:37023
I20260812 06:36:34.631762 25900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.3:37023 every 8 connection(s)
I20260812 06:36:34.632539 25669 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:34.638480 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 25669
I20260812 06:36:34.638589 20184 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:34.641243 25912 heartbeater.cc:344] Connected to a master server at 127.19.182.60:36573
I20260812 06:36:34.641467 25912 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.641794 25916 heartbeater.cc:344] Connected to a master server at 127.19.182.62:35785
I20260812 06:36:34.641888 25916 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.641950 25912 heartbeater.cc:507] Master 127.19.182.60:36573 requested a full tablet report, sending...
I20260812 06:36:34.642097 25916 heartbeater.cc:507] Master 127.19.182.62:35785 requested a full tablet report, sending...
I20260812 06:36:34.643055 24715 ts_manager.cc:194] Registered new tserver with Master: 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:36:34.643050 25017 ts_manager.cc:194] Registered new tserver with Master: 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:36:34.643688 25017 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.19.182.3:47739
I20260812 06:36:34.646848 25917 heartbeater.cc:344] Connected to a master server at 127.19.182.61:34983
I20260812 06:36:34.646931 25917 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:34.647073 25917 heartbeater.cc:507] Master 127.19.182.61:34983 requested a full tablet report, sending...
I20260812 06:36:34.647652 24859 ts_manager.cc:194] Registered new tserver with Master: 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:36:34.657454 20184 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:34.664803 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 24654
I20260812 06:36:34.787771 25937 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:34.787955 25937 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260812 06:36:34.789664 25937 dir_manager.cc:729] IO error: Could not lock instance file. Make sure that Kudu is not already running and you are not trying to run Kudu with a different user than before: lock /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/data/block_manager_instance: Resource temporarily unavailable (error 11)
W20260812 06:36:34.789714 25937 dir_manager.cc:730] Proceeding without lock
I20260812 06:36:34.792004 25937 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 06:36:34.792166 25937 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
W20260812 06:36:34.794575 25413 heartbeater.cc:646] Failed to heartbeat to 127.19.182.62:35785 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.182.62:35785: connect: Connection refused (error 111)
I20260812 06:36:34.795063 25412 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
I20260812 06:36:34.805099 20184 master_failover-itest.cc:413] tablet: 00000000000000000000000000000000, peers: 1ca3e3140b554813be67d29042c31ba6 a64236e67a9c458d8160cf015bff12ac c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:34.892019 25166 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:36:34.892097 25166 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: loading cluster ID for follower catalog manager: success
I20260812 06:36:34.894342 25166 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: acquiring CA information for follower catalog manager: success
I20260812 06:36:34.895483 25166 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:34.913197 25950 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:34.913371 25950 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:34.918967 25950 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/instance:
uuid: "1ca3e3140b554813be67d29042c31ba6"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.922006 25950 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal/instance:
uuid: "1ca3e3140b554813be67d29042c31ba6"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:34.929585 25950 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.000s
W20260812 06:36:34.974078 25662 heartbeater.cc:646] Failed to heartbeat to 127.19.182.62:35785 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.182.62:35785: connect: Connection refused (error 111)
I20260812 06:36:34.977234 25661 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
I20260812 06:36:35.049496 25961 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:35.049674 25961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:35.053747 25961 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 06:36:35.055809 25974 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:35.056499 25961 fs_report.cc:389] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:35.056850 25961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:36:35.056895 25961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
uuid: "1ca3e3140b554813be67d29042c31ba6"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
W20260812 06:36:35.062108 25987 tool_action_local_replica.cc:343] Start to copy tablet 00000000000000000000000000000000
I20260812 06:36:35.062846 25987 tablet_copy_client.cc:323] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: tablet copy: Beginning tablet copy session from remote peer at address 127.19.182.60:36573
I20260812 06:36:35.069990 25058 tablet_copy_service.cc:140] P c6e5df2c51e84400916b9e114c9aca13: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 1ca3e3140b554813be67d29042c31ba6 ({username='slave'} at 127.0.0.1:60378)
I20260812 06:36:35.070210 25058 tablet_copy_service.cc:161] P c6e5df2c51e84400916b9e114c9aca13: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 1ca3e3140b554813be67d29042c31ba6 at {username='slave'} at 127.0.0.1:60378: session id = 1ca3e3140b554813be67d29042c31ba6-00000000000000000000000000000000
I20260812 06:36:35.071501 25058 tablet_copy_source_session.cc:215] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:35.074883 25987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:36:35.082065 25987 tablet_copy_client.cc:806] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:35.083271 25987 tablet_copy_client.cc:670] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:35.086344 25987 tablet_copy_client.cc:538] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:35.089993 25987 tool_action_local_replica.cc:343] Tablet 00000000000000000000000000000000 copy succeed.
I20260812 06:36:35.090080 25987 tool_action_local_replica.cc:343] 1/1 tablets, 1867 bytes copied, include 0 failed tablets.
I20260812 06:36:35.090641 25058 tablet_copy_service.cc:342] P c6e5df2c51e84400916b9e114c9aca13: Request end of tablet copy session 1ca3e3140b554813be67d29042c31ba6-00000000000000000000000000000000 received from {username='slave'} at 127.0.0.1:60378
I20260812 06:36:35.090735 25058 tablet_copy_service.cc:434] P c6e5df2c51e84400916b9e114c9aca13: ending tablet copy session 1ca3e3140b554813be67d29042c31ba6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 1ca3e3140b554813be67d29042c31ba6
I20260812 06:36:35.102151 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:35785
--webserver_interface=127.19.182.62
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:35.145141 25912 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
W20260812 06:36:35.145152 25916 heartbeater.cc:646] Failed to heartbeat to 127.19.182.62:35785 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.182.62:35785: connect: Connection refused (error 111)
W20260812 06:36:35.183676 24995 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.62:35785: connect: Connection refused (error 111)
W20260812 06:36:35.184499 24995 consensus_peers.cc:597] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 -> Peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Couldn't send request to peer 1ca3e3140b554813be67d29042c31ba6. Status: Network error: Client connection negotiation failed: client connection to 127.19.182.62:35785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 06:36:35.206465 26002 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:35.206673 26002 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:35.206737 26002 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:35.209872 26002 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:35.209918 26002 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:35.209936 26002 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:35.209966 26002 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:35.213644 26002 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.62:35785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.182.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.26002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:35.214545 26002 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:35.215533 26002 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:35.220325 26014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:35.220422 26020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:35.220418 26022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:35.220494 26002 server_base.cc:1061] running on GCE node
I20260812 06:36:35.221001 26002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:35.221840 26002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:35.222986 26002 hybrid_clock.cc:648] HybridClock initialized: now 1786516595222966 us; error 38 us; skew 500 ppm
I20260812 06:36:35.224568 26002 webserver.cc:533] Webserver started at http://127.19.182.62:36641/ using document root <none> and password file <none>
I20260812 06:36:35.225100 26002 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:35.225159 26002 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:35.228215 26002 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:35.229966 26032 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:35.230862 26002 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:35.230970 26002 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
uuid: "1ca3e3140b554813be67d29042c31ba6"
format_stamp: "Formatted at 2026-08-12 06:36:34 on dist-test-slave-q9h9"
I20260812 06:36:35.231307 26002 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:35.247502 26002 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:35.248039 26002 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:35.248188 26002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:35.254880 26002 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.62:35785
I20260812 06:36:35.254884 26121 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.62:35785 every 8 connection(s)
I20260812 06:36:35.255872 26002 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:35.257464 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 26002
I20260812 06:36:35.258795 25017 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.table_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:35.259824 25017 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:35.259963 26123 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:36:35.261545 26123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Bootstrap starting.
I20260812 06:36:35.268318 26123 log.cc:826] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:35.275015 26123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:35.275385 26123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Bootstrap complete.
I20260812 06:36:35.278780 25303 tablet_service.cc:1511] Processing CreateTablet for tablet 0e17fd797cb848f2bc9188bca1fb255f (DEFAULT_TABLE table=default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:35.279182 26123 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:35.279528 26123 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ca3e3140b554813be67d29042c31ba6, State: Initialized, Role: FOLLOWER
I20260812 06:36:35.279729 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e17fd797cb848f2bc9188bca1fb255f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:35.279536 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 0e17fd797cb848f2bc9188bca1fb255f (DEFAULT_TABLE table=default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:35.280041 26123 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:35.280359 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e17fd797cb848f2bc9188bca1fb255f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:35.281118 26150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:35.281236 26150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:35.282547 26123 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:35.284628 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 0e17fd797cb848f2bc9188bca1fb255f (DEFAULT_TABLE table=default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:35.285454 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e17fd797cb848f2bc9188bca1fb255f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:35.289328 26178 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:36:35.289387 26178 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: loading cluster ID for follower catalog manager: success
I20260812 06:36:35.290347 26189 tablet_bootstrap.cc:492] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:36:35.291688 26178 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: acquiring CA information for follower catalog manager: success
I20260812 06:36:35.292446 26189 tablet_bootstrap.cc:654] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:35.293018 26178 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:35.293067 26184 tablet_bootstrap.cc:492] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:36:35.293290 26189 log.cc:826] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:35.294975 26189 tablet_bootstrap.cc:492] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:36:35.295188 26189 ts_tablet_manager.cc:1403] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 06:36:35.298794 26189 raft_consensus.cc:359] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.298998 26189 raft_consensus.cc:385] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:35.299072 26189 raft_consensus.cc:740] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:36:35.299485 26189 consensus_queue.cc:260] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.299937 26184 tablet_bootstrap.cc:654] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:35.300308 26189 ts_tablet_manager.cc:1434] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:36:35.303197 26184 log.cc:826] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:35.303604 26194 tablet_bootstrap.cc:492] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:36:35.305619 26194 tablet_bootstrap.cc:654] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:35.306116 26184 tablet_bootstrap.cc:492] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:36:35.306296 26184 ts_tablet_manager.cc:1403] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.000s
I20260812 06:36:35.307340 26194 log.cc:826] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:35.309417 26184 raft_consensus.cc:359] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.309613 26184 raft_consensus.cc:385] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:35.309625 25413 heartbeater.cc:344] Connected to a master server at 127.19.182.62:35785
I20260812 06:36:35.309664 26184 raft_consensus.cc:740] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:36:35.311228 26059 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" instance_seqno: 1786516594278598) as {username='slave'} at 127.19.182.1:59263; Asking this server to re-register.
I20260812 06:36:35.311358 26194 tablet_bootstrap.cc:492] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:36:35.311563 26194 ts_tablet_manager.cc:1403] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.000s
I20260812 06:36:35.310289 26184 consensus_queue.cc:260] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.312400 26184 ts_tablet_manager.cc:1434] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:36:35.312412 25413 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:35.315380 26059 ts_manager.cc:194] Registered new tserver with Master: 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275)
I20260812 06:36:35.317063 25662 heartbeater.cc:344] Connected to a master server at 127.19.182.62:35785
I20260812 06:36:35.317800 26059 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" instance_seqno: 1786516594458851) as {username='slave'} at 127.19.182.2:33287; Asking this server to re-register.
I20260812 06:36:35.318149 25662 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:35.318856 26059 ts_manager.cc:194] Registered new tserver with Master: d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:35.319103 26194 raft_consensus.cc:359] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.319314 26194 raft_consensus.cc:385] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:35.319368 26194 raft_consensus.cc:740] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:36:35.319746 26194 consensus_queue.cc:260] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.322952 26194 ts_tablet_manager.cc:1434] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260812 06:36:35.325709 25916 heartbeater.cc:344] Connected to a master server at 127.19.182.62:35785
I20260812 06:36:35.326483 26059 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "7b051808a9564a54a44175cacdeaa851" instance_seqno: 1786516594629543) as {username='slave'} at 127.19.182.3:39757; Asking this server to re-register.
I20260812 06:36:35.327581 25916 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:35.328336 26059 ts_manager.cc:194] Registered new tserver with Master: 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
W20260812 06:36:35.384408 25918 tablet.cc:2406] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:35.422765 26199 raft_consensus.cc:493] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:35.422945 26199 raft_consensus.cc:515] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.424028 26199 leader_election.cc:290] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:35.428229 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e17fd797cb848f2bc9188bca1fb255f" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:36:35.428493 25576 raft_consensus.cc:2468] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 0.
I20260812 06:36:35.428565 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e17fd797cb848f2bc9188bca1fb255f" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851" is_pre_election: true
I20260812 06:36:35.428838 25816 raft_consensus.cc:2468] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 0.
I20260812 06:36:35.428956 25225 leader_election.cc:304] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:36:35.429183 26199 raft_consensus.cc:2804] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:35.429261 26199 raft_consensus.cc:493] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:35.429311 26199 raft_consensus.cc:3060] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:35.430254 26199 raft_consensus.cc:515] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.430548 26199 leader_election.cc:290] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 election: Requested vote from peers 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:35.430907 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e17fd797cb848f2bc9188bca1fb255f" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:36:35.430907 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e17fd797cb848f2bc9188bca1fb255f" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851"
I20260812 06:36:35.431022 25576 raft_consensus.cc:3060] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:35.431022 25816 raft_consensus.cc:3060] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:35.432039 25576 raft_consensus.cc:2468] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 1.
I20260812 06:36:35.432039 25816 raft_consensus.cc:2468] T 0e17fd797cb848f2bc9188bca1fb255f P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 1.
I20260812 06:36:35.432322 25225 leader_election.cc:304] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:36:35.432502 26199 raft_consensus.cc:2804] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:35.432710 26199 raft_consensus.cc:697] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [term 1 LEADER]: Becoming Leader. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Running, Role: LEADER
I20260812 06:36:35.433015 26199 consensus_queue.cc:237] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:35.436672 25017 catalog_manager.cc:5719] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1). New cstate: current_term: 1 leader_uuid: "4e25f5f8fe0f45af9927988652e84b3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } }
W20260812 06:36:35.462556 25268 tablet_service.cc:3018] Rejecting scan request for tablet 0e17fd797cb848f2bc9188bca1fb255f: Uninitialized: clean time has not yet been initialized
W20260812 06:36:35.464017 25665 tablet.cc:2406] T 0e17fd797cb848f2bc9188bca1fb255f P d43d2bb88704495eb5d341bf58c6a1e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:36:35.535001 25415 tablet.cc:2406] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:35.613577 26139 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:35.613723 26139 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:35.620940 26150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:35.621081 26150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:36:35.664525 25268 tablet_service.cc:3018] Rejecting scan request for tablet 0e17fd797cb848f2bc9188bca1fb255f: Uninitialized: clean time has not yet been initialized
I20260812 06:36:35.929016 26199 consensus_queue.cc:1048] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:35.937111 26212 consensus_queue.cc:1048] T 0e17fd797cb848f2bc9188bca1fb255f P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:36:36.068688 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.613s	user 0.002s	sys 0.000s
I20260812 06:36:36.080421 25017 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.table_0_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:36.080910 25017 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:36.082876 26139 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:36.083000 26139 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:36.090229 25303 tablet_service.cc:1511] Processing CreateTablet for tablet a517de0c6d8544f0b357b83e96afbdea (DEFAULT_TABLE table=default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:36.090306 25542 tablet_service.cc:1511] Processing CreateTablet for tablet a517de0c6d8544f0b357b83e96afbdea (DEFAULT_TABLE table=default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:36.090373 25743 tablet_service.cc:1511] Processing CreateTablet for tablet a517de0c6d8544f0b357b83e96afbdea (DEFAULT_TABLE table=default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:36.090554 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a517de0c6d8544f0b357b83e96afbdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:36.090623 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a517de0c6d8544f0b357b83e96afbdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:36.090622 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a517de0c6d8544f0b357b83e96afbdea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:36.092296 26246 tablet_bootstrap.cc:492] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:36:36.092928 26248 tablet_bootstrap.cc:492] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:36:36.093417 26246 tablet_bootstrap.cc:654] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:36.093868 26248 tablet_bootstrap.cc:654] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:36.094130 26247 tablet_bootstrap.cc:492] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:36:36.094753 26246 tablet_bootstrap.cc:492] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:36:36.094858 26246 ts_tablet_manager.cc:1403] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:36:36.095082 26247 tablet_bootstrap.cc:654] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:36.095477 26246 raft_consensus.cc:359] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.095649 26246 raft_consensus.cc:385] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:36.095737 26246 raft_consensus.cc:740] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:36:36.095973 26246 consensus_queue.cc:260] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.096333 26246 ts_tablet_manager.cc:1434] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20260812 06:36:36.096740 26247 tablet_bootstrap.cc:492] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:36:36.096832 26247 ts_tablet_manager.cc:1403] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:36:36.097420 26247 raft_consensus.cc:359] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.097563 26247 raft_consensus.cc:385] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:36.097621 26247 raft_consensus.cc:740] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:36:36.097795 26247 consensus_queue.cc:260] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.098131 26247 ts_tablet_manager.cc:1434] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20260812 06:36:36.098798 26248 tablet_bootstrap.cc:492] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:36:36.098918 26248 ts_tablet_manager.cc:1403] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.006s	user 0.002s	sys 0.000s
I20260812 06:36:36.099522 26248 raft_consensus.cc:359] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.099653 26248 raft_consensus.cc:385] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:36.099707 26248 raft_consensus.cc:740] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:36:36.099879 26248 consensus_queue.cc:260] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.100168 26248 ts_tablet_manager.cc:1434] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:36:36.418375 26227 raft_consensus.cc:493] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:36.418493 26227 raft_consensus.cc:515] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.419418 26227 leader_election.cc:290] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:36.423776 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a517de0c6d8544f0b357b83e96afbdea" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:36:36.423811 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a517de0c6d8544f0b357b83e96afbdea" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:36:36.423911 25576 raft_consensus.cc:2468] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:36:36.424003 25338 raft_consensus.cc:2468] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:36:36.424306 25697 leader_election.cc:304] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b051808a9564a54a44175cacdeaa851, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:36:36.424540 26227 raft_consensus.cc:2804] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:36.424597 26227 raft_consensus.cc:493] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:36.424624 26227 raft_consensus.cc:3060] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:36.425429 26227 raft_consensus.cc:515] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.425736 26227 leader_election.cc:290] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:36.426108 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a517de0c6d8544f0b357b83e96afbdea" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:36:36.426138 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a517de0c6d8544f0b357b83e96afbdea" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:36:36.426229 25338 raft_consensus.cc:3060] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:36.426229 25576 raft_consensus.cc:3060] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:36.427166 25576 raft_consensus.cc:2468] T a517de0c6d8544f0b357b83e96afbdea P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:36:36.427166 25338 raft_consensus.cc:2468] T a517de0c6d8544f0b357b83e96afbdea P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:36:36.427433 25697 leader_election.cc:304] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b051808a9564a54a44175cacdeaa851, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:36:36.427597 26227 raft_consensus.cc:2804] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:36.427793 26227 raft_consensus.cc:697] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [term 1 LEADER]: Becoming Leader. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Running, Role: LEADER
I20260812 06:36:36.428068 26227 consensus_queue.cc:237] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:36.430548 25011 catalog_manager.cc:5719] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b051808a9564a54a44175cacdeaa851 (127.19.182.3). New cstate: current_term: 1 leader_uuid: "7b051808a9564a54a44175cacdeaa851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:36.455490 25740 tablet_service.cc:3018] Rejecting scan request for tablet a517de0c6d8544f0b357b83e96afbdea: Uninitialized: clean time has not yet been initialized
W20260812 06:36:36.657253 25740 tablet_service.cc:3018] Rejecting scan request for tablet a517de0c6d8544f0b357b83e96afbdea: Uninitialized: clean time has not yet been initialized
I20260812 06:36:36.866151 26227 consensus_queue.cc:1048] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:36.870608 26260 consensus_queue.cc:1048] T a517de0c6d8544f0b357b83e96afbdea P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:36.934187 26285 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:36:36.934343 26285 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:36.934813 26285 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:36.935478 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:36:37.061501 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.612s	user 0.002s	sys 0.000s
I20260812 06:36:37.073316 25016 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.table_0_1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:37.073834 25016 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0_1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:37.082854 25303 tablet_service.cc:1511] Processing CreateTablet for tablet db0783c62f6d45af9320a0da67f0f7ab (DEFAULT_TABLE table=default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:37.082912 25542 tablet_service.cc:1511] Processing CreateTablet for tablet db0783c62f6d45af9320a0da67f0f7ab (DEFAULT_TABLE table=default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:37.083082 25743 tablet_service.cc:1511] Processing CreateTablet for tablet db0783c62f6d45af9320a0da67f0f7ab (DEFAULT_TABLE table=default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:37.083161 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0783c62f6d45af9320a0da67f0f7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:37.083161 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0783c62f6d45af9320a0da67f0f7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:37.083369 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0783c62f6d45af9320a0da67f0f7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:37.085836 26302 tablet_bootstrap.cc:492] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:36:37.085938 26303 tablet_bootstrap.cc:492] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:36:37.086905 26303 tablet_bootstrap.cc:654] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:37.086905 26302 tablet_bootstrap.cc:654] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:37.087860 26303 tablet_bootstrap.cc:492] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:36:37.087944 26303 ts_tablet_manager.cc:1403] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:37.087944 26302 tablet_bootstrap.cc:492] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:36:37.088025 26302 ts_tablet_manager.cc:1403] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:37.088426 26303 raft_consensus.cc:359] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.088533 26303 raft_consensus.cc:385] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:37.088500 26302 raft_consensus.cc:359] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.088567 26303 raft_consensus.cc:740] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:36:37.088596 26302 raft_consensus.cc:385] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:37.088626 26302 raft_consensus.cc:740] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:36:37.088701 26303 consensus_queue.cc:260] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.088780 26302 consensus_queue.cc:260] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.088973 26303 ts_tablet_manager.cc:1434] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:36:37.090073 26302 ts_tablet_manager.cc:1434] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:37.087527 26301 tablet_bootstrap.cc:492] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:36:37.092170 26301 tablet_bootstrap.cc:654] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:37.093218 26301 tablet_bootstrap.cc:492] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:36:37.093315 26301 ts_tablet_manager.cc:1403] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.006s	user 0.002s	sys 0.000s
I20260812 06:36:37.093715 26301 raft_consensus.cc:359] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.093808 26301 raft_consensus.cc:385] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:37.093838 26301 raft_consensus.cc:740] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:36:37.093961 26301 consensus_queue.cc:260] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.094241 26301 ts_tablet_manager.cc:1434] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:36:37.424933 26277 raft_consensus.cc:493] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:37.425045 26277 raft_consensus.cc:515] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.425372 26277 leader_election.cc:290] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:37.425774 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0783c62f6d45af9320a0da67f0f7ab" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:36:37.425817 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0783c62f6d45af9320a0da67f0f7ab" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:36:37.425921 25338 raft_consensus.cc:2468] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:36:37.425959 25576 raft_consensus.cc:2468] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:36:37.426301 25697 leader_election.cc:304] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b051808a9564a54a44175cacdeaa851, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:36:37.426487 26277 raft_consensus.cc:2804] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:37.426542 26277 raft_consensus.cc:493] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:37.426569 26277 raft_consensus.cc:3060] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:37.427415 26277 raft_consensus.cc:515] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.427729 26277 leader_election.cc:290] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:37.428062 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0783c62f6d45af9320a0da67f0f7ab" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:36:37.428184 25338 raft_consensus.cc:3060] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:37.428613 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0783c62f6d45af9320a0da67f0f7ab" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:36:37.428726 25576 raft_consensus.cc:3060] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:37.429221 25338 raft_consensus.cc:2468] T db0783c62f6d45af9320a0da67f0f7ab P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:36:37.429504 25697 leader_election.cc:304] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:36:37.429683 25576 raft_consensus.cc:2468] T db0783c62f6d45af9320a0da67f0f7ab P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:36:37.429697 26277 raft_consensus.cc:2804] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:37.429791 26277 raft_consensus.cc:697] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [term 1 LEADER]: Becoming Leader. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Running, Role: LEADER
I20260812 06:36:37.429929 26277 consensus_queue.cc:237] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:37.431618 25011 catalog_manager.cc:5719] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b051808a9564a54a44175cacdeaa851 (127.19.182.3). New cstate: current_term: 1 leader_uuid: "7b051808a9564a54a44175cacdeaa851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:37.444646 25740 tablet_service.cc:3018] Rejecting scan request for tablet db0783c62f6d45af9320a0da67f0f7ab: Uninitialized: clean time has not yet been initialized
W20260812 06:36:37.646255 25740 tablet_service.cc:3018] Rejecting scan request for tablet db0783c62f6d45af9320a0da67f0f7ab: Uninitialized: clean time has not yet been initialized
I20260812 06:36:37.808499 26277 consensus_queue.cc:1048] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:37.811954 26227 consensus_queue.cc:1048] T db0783c62f6d45af9320a0da67f0f7ab P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:37.936034 26320 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:36:37.936192 26320 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:37.937322 26320 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:37.937728 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:36:38.048830 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.002s	sys 0.000s
I20260812 06:36:38.051126 24890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:36:38.051280 24890 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ca3e3140b554813be67d29042c31ba6 in term 1.
I20260812 06:36:38.052901 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac; no voters: c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:38.054669 26320 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:36:38.054808 26320 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:36:38.054880 26320 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:36:38.055418 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:36:38.055979 24834 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:38.056308 26329 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:36:38.057070 26320 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:38.057416 26320 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 2 election: Requested vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:38.057723 24890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac"
I20260812 06:36:38.632973 26333 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:36:38.633124 26333 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:38.633622 26333 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:38.634092 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:36:38.634317 26079 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a64236e67a9c458d8160cf015bff12ac in current term 2: Already voted for candidate 1ca3e3140b554813be67d29042c31ba6 in this term.
W20260812 06:36:38.752957 26035 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.694s (SENT)
W20260812 06:36:39.449036 26035 leader_election.cc:336] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.694s (SENT)
I20260812 06:36:39.449136 26035 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6; no voters: a64236e67a9c458d8160cf015bff12ac, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:39.449440 26336 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260812 06:36:39.498868 24834 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.864s (SENT) [suppressed 2 similar messages]
I20260812 06:36:39.985729 26339 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:39.985865 26339 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:39.986344 26339 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:39.986781 24890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:36:39.986920 24890 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ca3e3140b554813be67d29042c31ba6 in term 1.
I20260812 06:36:39.987270 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac; no voters: 
I20260812 06:36:39.987447 26339 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 06:36:39.987510 26339 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:39.987537 26339 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:36:39.988412 26339 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:39.988744 26339 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 3 election: Requested vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:39.989069 24890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac"
I20260812 06:36:39.989202 24890 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 1 FOLLOWER]: Advancing to term 3
I20260812 06:36:39.989965 24890 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ca3e3140b554813be67d29042c31ba6 in term 3.
I20260812 06:36:39.990293 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac; no voters: 
I20260812 06:36:39.990463 26339 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:36:39.990607 26339 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 3 LEADER]: Becoming Leader. State: Replica: 1ca3e3140b554813be67d29042c31ba6, State: Running, Role: LEADER
I20260812 06:36:39.990900 26339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:39.991892 26340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:39.992005 26340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:39.992296 26342 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:39.993767 26342 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59]
I20260812 06:36:39.994052 26342 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c]
I20260812 06:36:39.994285 26342 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8]
I20260812 06:36:39.995177 26342 tablet_loader.cc:96] loaded metadata for tablet 0e17fd797cb848f2bc9188bca1fb255f (table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c])
I20260812 06:36:39.995391 26342 tablet_loader.cc:96] loaded metadata for tablet a517de0c6d8544f0b357b83e96afbdea (table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8])
I20260812 06:36:39.995558 26342 tablet_loader.cc:96] loaded metadata for tablet db0783c62f6d45af9320a0da67f0f7ab (table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59])
I20260812 06:36:39.995656 26342 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:39.996009 26342 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:36:39.996053 26342 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:39.996572 26342 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:39.996943 26342 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Loaded TSK: 0
I20260812 06:36:39.997493 26342 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 06:36:40.364990 24834 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.864s (SENT)
I20260812 06:36:40.365108 24834 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:40.365412 26343 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:36:40.606194 24890 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Refusing update from remote peer 1ca3e3140b554813be67d29042c31ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 06:36:40.606726 26340 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 06:36:40.608525 26343 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:40.608650 26343 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:40.609750 26351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:40.609869 26351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:40.610118 26343 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:40.610219 26343 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:40.822117 25413 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
I20260812 06:36:40.822150 25662 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
I20260812 06:36:40.843600 25916 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
W20260812 06:36:41.199669 26035 leader_election.cc:336] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.605s (SENT)
I20260812 06:36:41.544584 26359 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:41.544727 26359 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:41.545107 26359 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:41.545500 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:36:42.185613 26035 leader_election.cc:336] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 1.097s (SENT)
W20260812 06:36:42.779498 24834 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.616s (SENT)
I20260812 06:36:42.779606 24834 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:42.779965 26367 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 06:36:43.599081 26369 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:43.599226 26369 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:43.599684 26369 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:43.600116 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:36:44.978852 24834 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.688s (SENT)
I20260812 06:36:44.978966 24834 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:44.979321 26374 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 06:36:45.699951 26377 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:45.700073 26377 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:45.700493 26377 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:45.700891 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:36:46.316815 24834 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.615s (SENT) [suppressed 2 similar messages]
W20260812 06:36:46.933355 24834 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.615s (SENT)
I20260812 06:36:46.933465 24834 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:46.933820 26382 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 06:36:48.061673 25931 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.182.60:36573)
I20260812 06:36:48.067126 26059 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39840:
name: "default.table_0_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:48.069829 26059 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:48.084669 25743 tablet_service.cc:1511] Processing CreateTablet for tablet d3126e10ad6a4327a05196f6e02f2e55 (DEFAULT_TABLE table=default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:48.084797 25303 tablet_service.cc:1511] Processing CreateTablet for tablet d3126e10ad6a4327a05196f6e02f2e55 (DEFAULT_TABLE table=default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:48.084796 25542 tablet_service.cc:1511] Processing CreateTablet for tablet d3126e10ad6a4327a05196f6e02f2e55 (DEFAULT_TABLE table=default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:48.084988 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3126e10ad6a4327a05196f6e02f2e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:48.085078 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3126e10ad6a4327a05196f6e02f2e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:48.085083 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3126e10ad6a4327a05196f6e02f2e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:48.086964 26423 tablet_bootstrap.cc:492] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:36:48.087483 26428 tablet_bootstrap.cc:492] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:36:48.087985 26423 tablet_bootstrap.cc:654] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:48.088266 26428 tablet_bootstrap.cc:654] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:48.088866 26424 tablet_bootstrap.cc:492] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:36:48.088932 26423 tablet_bootstrap.cc:492] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:36:48.089030 26423 ts_tablet_manager.cc:1403] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:48.089287 26428 tablet_bootstrap.cc:492] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:36:48.089358 26428 ts_tablet_manager.cc:1403] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:48.089411 26423 raft_consensus.cc:359] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.089507 26423 raft_consensus.cc:385] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:48.089545 26423 raft_consensus.cc:740] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:36:48.089668 26423 consensus_queue.cc:260] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.089798 26428 raft_consensus.cc:359] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.089917 26428 raft_consensus.cc:385] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:48.089938 26423 ts_tablet_manager.cc:1434] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:36:48.089967 26428 raft_consensus.cc:740] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:36:48.090158 26428 consensus_queue.cc:260] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.090440 26428 ts_tablet_manager.cc:1434] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:36:48.091612 26424 tablet_bootstrap.cc:654] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:48.092691 26424 tablet_bootstrap.cc:492] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:36:48.092782 26424 ts_tablet_manager.cc:1403] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260812 06:36:48.093190 26424 raft_consensus.cc:359] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.093277 26424 raft_consensus.cc:385] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:48.093304 26424 raft_consensus.cc:740] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:36:48.093436 26424 consensus_queue.cc:260] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.093770 26424 ts_tablet_manager.cc:1434] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:36:48.102659 26433 raft_consensus.cc:493] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:48.102756 26433 raft_consensus.cc:515] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.103717 26433 leader_election.cc:290] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:36:48.106979 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3126e10ad6a4327a05196f6e02f2e55" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:36:48.107105 25338 raft_consensus.cc:2468] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 0.
I20260812 06:36:48.107100 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3126e10ad6a4327a05196f6e02f2e55" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851" is_pre_election: true
I20260812 06:36:48.107209 25816 raft_consensus.cc:2468] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 0.
I20260812 06:36:48.107472 25467 leader_election.cc:304] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:36:48.107694 26433 raft_consensus.cc:2804] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:48.107752 26433 raft_consensus.cc:493] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:48.107797 26433 raft_consensus.cc:3060] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:48.108523 26433 raft_consensus.cc:515] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.108824 26433 leader_election.cc:290] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:36:48.109143 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3126e10ad6a4327a05196f6e02f2e55" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:36:48.109172 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3126e10ad6a4327a05196f6e02f2e55" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851"
I20260812 06:36:48.109252 25338 raft_consensus.cc:3060] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:48.109277 25816 raft_consensus.cc:3060] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:48.110132 25816 raft_consensus.cc:2468] T d3126e10ad6a4327a05196f6e02f2e55 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 1.
I20260812 06:36:48.110183 25338 raft_consensus.cc:2468] T d3126e10ad6a4327a05196f6e02f2e55 P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 1.
I20260812 06:36:48.110440 25467 leader_election.cc:304] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:36:48.110607 26433 raft_consensus.cc:2804] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:48.110798 26433 raft_consensus.cc:697] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 LEADER]: Becoming Leader. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Running, Role: LEADER
I20260812 06:36:48.111053 26433 consensus_queue.cc:237] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:36:48.113354 26059 catalog_manager.cc:5719] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2). New cstate: current_term: 1 leader_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: HEALTHY } } }
W20260812 06:36:48.126413 25505 tablet_service.cc:3018] Rejecting scan request for tablet d3126e10ad6a4327a05196f6e02f2e55: Uninitialized: clean time has not yet been initialized
W20260812 06:36:48.328208 25505 tablet_service.cc:3018] Rejecting scan request for tablet d3126e10ad6a4327a05196f6e02f2e55: Uninitialized: clean time has not yet been initialized
I20260812 06:36:48.503427 26433 consensus_queue.cc:1048] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:48.507215 26442 consensus_queue.cc:1048] T d3126e10ad6a4327a05196f6e02f2e55 P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:48.617717 26453 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:48.617838 26453 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:48.618222 26453 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:48.618602 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 17 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:36:48.732403 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.612s	user 0.002s	sys 0.000s
I20260812 06:36:48.732956 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 24792
I20260812 06:36:48.733747 25034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:36:48.736253 25009 catalog_manager.cc:5552] Ignoring report from unknown tablet d3126e10ad6a4327a05196f6e02f2e55
I20260812 06:36:48.736817 25027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.737053 25029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.737259 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.737701 25024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 17 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.737884 25033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.738075 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.738270 25038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 14 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.738433 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.741369 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:36:48.741441 25012 catalog_manager.cc:5552] Ignoring report from unknown tablet d3126e10ad6a4327a05196f6e02f2e55
I20260812 06:36:48.741688 25029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13"
W20260812 06:36:48.744113 25008 catalog_manager.cc:5552] Ignoring report from unknown tablet d3126e10ad6a4327a05196f6e02f2e55
I20260812 06:36:48.745862 26079 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 3 LEADER]: Rejecting Update request from peer c6e5df2c51e84400916b9e114c9aca13 for earlier term 1. Current term is 3. Ops: []
I20260812 06:36:48.746366 26460 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 }, Status: INVALID_TERM, Last received: 1.13, Next index: 14, Last known committed idx: 17, Time since last communication: 0.000s
I20260812 06:36:48.746497 26460 consensus_queue.cc:1243] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Peer 1ca3e3140b554813be67d29042c31ba6 log is divergent from this leader: its last log entry 3.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260812 06:36:48.746555 26460 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 06:36:48.746588 26460 raft_consensus.cc:740] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6e5df2c51e84400916b9e114c9aca13, State: Running, Role: LEADER
I20260812 06:36:48.746735 26460 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 13, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:48.746860 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13"
I20260812 06:36:48.746990 26460 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 1 FOLLOWER]: Advancing to term 3
I20260812 06:36:48.747134 25033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13"
I20260812 06:36:48.747877 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 3 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:48.748628 25039 raft_consensus.cc:2368] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ca3e3140b554813be67d29042c31ba6 for earlier term 2. Current term is 3.
I20260812 06:36:48.749125 25024 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Refusing update from remote peer 1ca3e3140b554813be67d29042c31ba6: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 06:36:48.749889 26454 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260812 06:36:48.749989 25038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13"
I20260812 06:36:48.750123 25038 raft_consensus.cc:2368] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ca3e3140b554813be67d29042c31ba6 for earlier term 2. Current term is 3.
I20260812 06:36:48.752044 26460 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:48.752208 26460 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:48.752341 26460 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:48.752471 26460 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:48.756615 26461 mvcc.cc:204] Tried to move back new op lower bound from 7317572026836045824 to 7317571993565089792. Current Snapshot: MvccSnapshot[applied={T|T < 7317572026836045824}]
W20260812 06:36:48.759027 24988 connection.cc:573] client connection to 127.19.182.61:34983 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:36:48.759112 24988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:36:48.759331 24988 connection.cc:573] server connection from 127.0.0.1:60366 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:36:48.759421 24961 master_runner.cc:187] Error getting master registration for 127.19.182.61:34983: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107), 
I20260812 06:36:48.759495 24961 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:36:48.892400 26468 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:48.892582 26468 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260812 06:36:48.894310 26468 dir_manager.cc:729] IO error: Could not lock instance file. Make sure that Kudu is not already running and you are not trying to run Kudu with a different user than before: lock /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/data/block_manager_instance: Resource temporarily unavailable (error 11)
W20260812 06:36:48.894366 26468 dir_manager.cc:730] Proceeding without lock
I20260812 06:36:48.896901 26468 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 06:36:48.897070 26468 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:36:33 on dist-test-slave-q9h9"
I20260812 06:36:48.909639 20184 master_failover-itest.cc:413] tablet: 00000000000000000000000000000000, peers: 1ca3e3140b554813be67d29042c31ba6 a64236e67a9c458d8160cf015bff12ac c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:49.016090 26485 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:49.016315 26485 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:49.022653 26485 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/instance:
uuid: "a64236e67a9c458d8160cf015bff12ac"
format_stamp: "Formatted at 2026-08-12 06:36:49 on dist-test-slave-q9h9"
I20260812 06:36:49.025712 26485 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal/instance:
uuid: "a64236e67a9c458d8160cf015bff12ac"
format_stamp: "Formatted at 2026-08-12 06:36:49 on dist-test-slave-q9h9"
I20260812 06:36:49.034845 26485 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.000s
I20260812 06:36:49.149116 26498 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:49.149291 26498 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:49.153119 26498 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 06:36:49.154992 26512 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:49.155650 26498 fs_report.cc:389] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:49.155994 26498 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:49.156037 26498 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
uuid: "a64236e67a9c458d8160cf015bff12ac"
format_stamp: "Formatted at 2026-08-12 06:36:49 on dist-test-slave-q9h9"
W20260812 06:36:49.161170 26517 tool_action_local_replica.cc:343] Start to copy tablet 00000000000000000000000000000000
I20260812 06:36:49.161890 26517 tablet_copy_client.cc:323] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: tablet copy: Beginning tablet copy session from remote peer at address 127.19.182.60:36573
I20260812 06:36:49.168985 25058 tablet_copy_service.cc:140] P c6e5df2c51e84400916b9e114c9aca13: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a64236e67a9c458d8160cf015bff12ac ({username='slave'} at 127.0.0.1:46244)
I20260812 06:36:49.169073 25058 tablet_copy_service.cc:161] P c6e5df2c51e84400916b9e114c9aca13: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a64236e67a9c458d8160cf015bff12ac at {username='slave'} at 127.0.0.1:46244: session id = a64236e67a9c458d8160cf015bff12ac-00000000000000000000000000000000
I20260812 06:36:49.169950 25058 tablet_copy_source_session.cc:215] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:36:49.172720 26517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:36:49.179085 26517 tablet_copy_client.cc:806] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: tablet copy: Starting download of 0 data blocks...
I20260812 06:36:49.180323 26517 tablet_copy_client.cc:670] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: tablet copy: Starting download of 1 WAL segments...
I20260812 06:36:49.183061 26517 tablet_copy_client.cc:538] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:36:49.186658 26517 tool_action_local_replica.cc:343] Tablet 00000000000000000000000000000000 copy succeed.
I20260812 06:36:49.186705 26517 tool_action_local_replica.cc:343] 1/1 tablets, 6607 bytes copied, include 0 failed tablets.
I20260812 06:36:49.187115 25058 tablet_copy_service.cc:342] P c6e5df2c51e84400916b9e114c9aca13: Request end of tablet copy session a64236e67a9c458d8160cf015bff12ac-00000000000000000000000000000000 received from {username='slave'} at 127.0.0.1:46244
I20260812 06:36:49.187183 25058 tablet_copy_service.cc:434] P c6e5df2c51e84400916b9e114c9aca13: ending tablet copy session a64236e67a9c458d8160cf015bff12ac-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a64236e67a9c458d8160cf015bff12ac
I20260812 06:36:49.200165 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:34983
--webserver_interface=127.19.182.61
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
I20260812 06:36:49.252061 26459 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:49.252224 26459 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:49.252763 26459 leader_election.cc:290] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983)
I20260812 06:36:49.253154 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 17 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:36:49.254074 24988 leader_election.cc:336] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983): Network error: Client connection negotiation failed: client connection to 127.19.182.61:34983: connect: Connection refused (error 111)
I20260812 06:36:49.254146 24988 leader_election.cc:304] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6e5df2c51e84400916b9e114c9aca13; no voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac
I20260812 06:36:49.254276 26459 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 06:36:49.255752 26033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.182.61:34983: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260812 06:36:49.256640 26033 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 -> Peer a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983): Couldn't send request to peer a64236e67a9c458d8160cf015bff12ac. Status: Network error: Client connection negotiation failed: client connection to 127.19.182.61:34983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:36:49.275264 26540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:49.275399 26540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
W20260812 06:36:49.307689 26539 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:49.307871 26539 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:49.307996 26539 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:49.311264 26539 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:49.311312 26539 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:49.311331 26539 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:49.311347 26539 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:49.315034 26539 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.61:34983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.182.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.26539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:49.315937 26539 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:49.316953 26539 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:49.322360 26557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:49.322487 26539 server_base.cc:1061] running on GCE node
W20260812 06:36:49.322496 26559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:49.322379 26556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:49.323028 26539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:49.323812 26539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:49.324956 26539 hybrid_clock.cc:648] HybridClock initialized: now 1786516609324940 us; error 35 us; skew 500 ppm
I20260812 06:36:49.326536 26539 webserver.cc:533] Webserver started at http://127.19.182.61:43681/ using document root <none> and password file <none>
I20260812 06:36:49.327046 26539 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:49.327113 26539 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:49.330128 26539 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:36:49.331812 26570 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:49.332700 26539 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:49.332800 26539 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
uuid: "a64236e67a9c458d8160cf015bff12ac"
format_stamp: "Formatted at 2026-08-12 06:36:49 on dist-test-slave-q9h9"
I20260812 06:36:49.333140 26539 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:49.345147 26539 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:49.345649 26539 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:49.345795 26539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:49.352239 26539 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.61:34983
I20260812 06:36:49.352249 26664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.61:34983 every 8 connection(s)
I20260812 06:36:49.353168 26539 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/info.pb
I20260812 06:36:49.355228 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 26539
I20260812 06:36:49.356431 26059 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39840:
name: "default.table_1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:36:49.356930 26059 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:49.357151 26665 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:36:49.358976 26665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: Bootstrap starting.
I20260812 06:36:49.365916 25303 tablet_service.cc:1511] Processing CreateTablet for tablet 1697cc6d44874f6fa37896fdf764b482 (DEFAULT_TABLE table=default.table_1 [id=52190151f319499187f516b738595e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:49.366082 26665 log.cc:826] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:49.366263 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1697cc6d44874f6fa37896fdf764b482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:49.366487 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 1697cc6d44874f6fa37896fdf764b482 (DEFAULT_TABLE table=default.table_1 [id=52190151f319499187f516b738595e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:49.366695 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 1697cc6d44874f6fa37896fdf764b482 (DEFAULT_TABLE table=default.table_1 [id=52190151f319499187f516b738595e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:36:49.366767 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1697cc6d44874f6fa37896fdf764b482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:49.366966 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1697cc6d44874f6fa37896fdf764b482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:49.368886 26678 tablet_bootstrap.cc:492] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:36:49.369277 26680 tablet_bootstrap.cc:492] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:36:49.369953 26678 tablet_bootstrap.cc:654] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:49.370107 26680 tablet_bootstrap.cc:654] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:49.370666 26684 tablet_bootstrap.cc:492] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:36:49.371104 26680 tablet_bootstrap.cc:492] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:36:49.371246 26680 ts_tablet_manager.cc:1403] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:36:49.371286 26678 tablet_bootstrap.cc:492] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:36:49.371433 26678 ts_tablet_manager.cc:1403] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:36:49.371589 26684 tablet_bootstrap.cc:654] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:49.371702 26680 raft_consensus.cc:359] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.371876 26680 raft_consensus.cc:385] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:49.371963 26680 raft_consensus.cc:740] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:36:49.372191 26680 consensus_queue.cc:260] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.372540 26680 ts_tablet_manager.cc:1434] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:36:49.372637 26684 tablet_bootstrap.cc:492] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:36:49.372721 26684 ts_tablet_manager.cc:1403] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:49.372712 26678 raft_consensus.cc:359] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.372804 26678 raft_consensus.cc:385] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:49.372836 26678 raft_consensus.cc:740] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:36:49.372961 26678 consensus_queue.cc:260] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.373113 26684 raft_consensus.cc:359] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.373199 26684 raft_consensus.cc:385] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:49.373229 26684 raft_consensus.cc:740] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:36:49.373229 26678 ts_tablet_manager.cc:1434] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:36:49.373354 26684 consensus_queue.cc:260] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.373600 26684 ts_tablet_manager.cc:1434] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:36:49.381109 26665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=11 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:36:49.381464 26665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: Bootstrap complete.
I20260812 06:36:49.384711 26665 raft_consensus.cc:359] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:49.385102 26665 raft_consensus.cc:740] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: a64236e67a9c458d8160cf015bff12ac, State: Initialized, Role: FOLLOWER
I20260812 06:36:49.385538 26665 consensus_queue.cc:260] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 3.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:49.385958 26695 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:49.386096 26695 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:49.386704 26665 sys_catalog.cc:565] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:49.386890 25663 heartbeater.cc:344] Connected to a master server at 127.19.182.61:34983
I20260812 06:36:49.386920 25414 heartbeater.cc:344] Connected to a master server at 127.19.182.61:34983
I20260812 06:36:49.388466 25917 heartbeater.cc:344] Connected to a master server at 127.19.182.61:34983
I20260812 06:36:49.389745 26595 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "7b051808a9564a54a44175cacdeaa851" instance_seqno: 1786516594629543) as {username='slave'} at 127.19.182.3:34245; Asking this server to re-register.
I20260812 06:36:49.389775 26596 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" instance_seqno: 1786516594458851) as {username='slave'} at 127.19.182.2:44203; Asking this server to re-register.
I20260812 06:36:49.390166 25663 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:49.391168 25917 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:49.391268 26596 ts_manager.cc:194] Registered new tserver with Master: d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:36:49.392022 26596 ts_manager.cc:194] Registered new tserver with Master: 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:36:49.393297 26716 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:36:49.393342 26716 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: loading cluster ID for follower catalog manager: success
I20260812 06:36:49.395303 26716 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: acquiring CA information for follower catalog manager: success
I20260812 06:36:49.396435 26716 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:36:49.442512 26212 raft_consensus.cc:493] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:49.442633 26212 raft_consensus.cc:515] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.443061 26212 leader_election.cc:290] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541), 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:36:49.443464 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1697cc6d44874f6fa37896fdf764b482" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851" is_pre_election: true
I20260812 06:36:49.443477 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1697cc6d44874f6fa37896fdf764b482" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:36:49.443604 25816 raft_consensus.cc:2468] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 0.
I20260812 06:36:49.443624 25576 raft_consensus.cc:2468] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 0.
I20260812 06:36:49.443960 25222 leader_election.cc:304] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:36:49.444149 26212 raft_consensus.cc:2804] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:49.444211 26212 raft_consensus.cc:493] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:49.444249 26212 raft_consensus.cc:3060] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:49.445251 26212 raft_consensus.cc:515] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.445621 26212 leader_election.cc:290] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 election: Requested vote from peers d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541), 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:36:49.445901 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1697cc6d44874f6fa37896fdf764b482" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:36:49.446040 25576 raft_consensus.cc:3060] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:49.446058 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1697cc6d44874f6fa37896fdf764b482" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851"
I20260812 06:36:49.446156 25816 raft_consensus.cc:3060] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:49.446979 25576 raft_consensus.cc:2468] T 1697cc6d44874f6fa37896fdf764b482 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 1.
I20260812 06:36:49.447041 25816 raft_consensus.cc:2468] T 1697cc6d44874f6fa37896fdf764b482 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 1.
I20260812 06:36:49.447315 25225 leader_election.cc:304] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:36:49.447531 26212 raft_consensus.cc:2804] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:49.447696 26212 raft_consensus.cc:697] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [term 1 LEADER]: Becoming Leader. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Running, Role: LEADER
I20260812 06:36:49.447852 26212 consensus_queue.cc:237] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:36:49.449690 26596 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" instance_seqno: 1786516594278598) as {username='slave'} at 127.19.182.1:34849; Asking this server to re-register.
I20260812 06:36:49.449631 26058 catalog_manager.cc:5719] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1). New cstate: current_term: 1 leader_uuid: "4e25f5f8fe0f45af9927988652e84b3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:49.450151 25414 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:49.451002 26596 ts_manager.cc:194] Registered new tserver with Master: 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275)
W20260812 06:36:49.468868 25268 tablet_service.cc:3018] Rejecting scan request for tablet 1697cc6d44874f6fa37896fdf764b482: Uninitialized: clean time has not yet been initialized
W20260812 06:36:49.670655 25268 tablet_service.cc:3018] Rejecting scan request for tablet 1697cc6d44874f6fa37896fdf764b482: Uninitialized: clean time has not yet been initialized
I20260812 06:36:49.674512 26543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:49.674649 26543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:49.681565 26695 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:49.681710 26695 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:49.740841 25116 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 06:36:49.743325 25083 debug-util.cc:398] Leaking SignalData structure 0x55eabb27e2a0 after lost signal to thread 26127
I20260812 06:36:49.953799 26732 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:49.953917 26732 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:49.954378 26732 leader_election.cc:290] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983)
I20260812 06:36:49.954744 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:36:49.957827 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:36:49.958374 24988 leader_election.cc:304] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6e5df2c51e84400916b9e114c9aca13; no voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac
I20260812 06:36:49.958575 26732 raft_consensus.cc:2749] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 06:36:49.973418 26212 consensus_queue.cc:1048] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:49.977672 26739 consensus_queue.cc:1048] T 1697cc6d44874f6fa37896fdf764b482 P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:36:50.073493 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.607s	user 0.001s	sys 0.000s
I20260812 06:36:50.179708 26695 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:50.179888 26695 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:50.181082 26695 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:50.181564 25038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:36:50.523895 26744 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:50.524001 26744 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:50.524456 26744 leader_election.cc:290] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983)
I20260812 06:36:50.524837 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:36:50.524994 26613 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e5df2c51e84400916b9e114c9aca13 in term 3.
I20260812 06:36:50.525279 24988 leader_election.cc:304] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac, c6e5df2c51e84400916b9e114c9aca13; no voters: 
I20260812 06:36:50.525470 26744 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 06:36:50.525527 26744 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:36:50.525571 26744 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:36:50.526422 26744 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:50.526764 26744 leader_election.cc:290] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 election: Requested vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983)
I20260812 06:36:50.527099 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac"
I20260812 06:36:50.527204 26613 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:36:50.528818 26613 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e5df2c51e84400916b9e114c9aca13 in term 4.
I20260812 06:36:50.529109 24988 leader_election.cc:304] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac, c6e5df2c51e84400916b9e114c9aca13; no voters: 
I20260812 06:36:50.529284 26744 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 06:36:50.529433 26744 raft_consensus.cc:697] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 4 LEADER]: Becoming Leader. State: Replica: c6e5df2c51e84400916b9e114c9aca13, State: Running, Role: LEADER
I20260812 06:36:50.529568 26744 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 3.20, Last appended by leader: 20, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:50.530198 26746 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 4 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:50.530308 26746 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:50.530553 26750 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:50.531605 26750 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003]
I20260812 06:36:50.531870 26750 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=52190151f319499187f516b738595e22]
I20260812 06:36:50.532076 26750 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59]
I20260812 06:36:50.532262 26750 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c]
I20260812 06:36:50.532434 26750 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8]
I20260812 06:36:50.533092 26750 tablet_loader.cc:96] loaded metadata for tablet 0e17fd797cb848f2bc9188bca1fb255f (table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c])
I20260812 06:36:50.533280 26750 tablet_loader.cc:96] loaded metadata for tablet 1697cc6d44874f6fa37896fdf764b482 (table default.table_1 [id=52190151f319499187f516b738595e22])
I20260812 06:36:50.533445 26750 tablet_loader.cc:96] loaded metadata for tablet a517de0c6d8544f0b357b83e96afbdea (table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8])
I20260812 06:36:50.533600 26750 tablet_loader.cc:96] loaded metadata for tablet d3126e10ad6a4327a05196f6e02f2e55 (table default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003])
I20260812 06:36:50.533757 26750 tablet_loader.cc:96] loaded metadata for tablet db0783c62f6d45af9320a0da67f0f7ab (table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59])
I20260812 06:36:50.533938 26750 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:50.534389 26750 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:36:50.534435 26750 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:50.535104 26750 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:50.535496 26750 catalog_manager.cc:6103] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Loaded TSK: 0
I20260812 06:36:50.535862 26750 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 06:36:50.862344 26573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.680s (SENT)
I20260812 06:36:51.070732 26613 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Refusing update from remote peer c6e5df2c51e84400916b9e114c9aca13: Log matching property violated. Preceding OpId in replica: term: 3 index: 20. Preceding OpId from leader: term: 4 index: 21. (index mismatch)
I20260812 06:36:51.071209 26746 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260812 06:36:51.072481 26754 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 4 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:51.072618 26754 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:51.073559 26756 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:51.073664 26756 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:51.074051 26754 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:36:51.074157 26754 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:36:51.388799 25412 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
I20260812 06:36:51.481979 25661 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
I20260812 06:36:51.483255 25912 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
W20260812 06:36:51.544348 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.680s (SENT)
I20260812 06:36:51.544449 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:51.544696 26754 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 06:36:51.601655 24995 leader_election.cc:336] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.536s (SENT)
W20260812 06:36:51.779343 24995 leader_election.cc:336] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.626s (SENT)
I20260812 06:36:53.250353 26761 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:36:53.250474 26761 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:53.250873 26761 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:53.251372 25038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:36:54.379871 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.563s (SENT)
I20260812 06:36:54.379961 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:54.380232 26766 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 06:36:55.124864 26767 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:36:55.124992 26767 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:55.125409 26767 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:55.125936 25038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:36:56.331003 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.601s (SENT)
I20260812 06:36:56.331094 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:36:56.331408 26772 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 06:36:58.850827 26775 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:36:58.850947 26775 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:36:58.851352 26775 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:36:58.851806 25038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:36:59.467211 26573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.614s (SENT) [suppressed 2 similar messages]
W20260812 06:37:00.083269 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.614s (SENT)
I20260812 06:37:00.083357 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:00.083611 26786 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 06:37:00.085840 25931 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.182.62:35785)
I20260812 06:37:00.087574 25007 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.table_1_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:00.088092 25007 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:00.096318 25303 tablet_service.cc:1511] Processing CreateTablet for tablet 87fd933f4c3b43179984c2053e390217 (DEFAULT_TABLE table=default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:00.096477 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 87fd933f4c3b43179984c2053e390217 (DEFAULT_TABLE table=default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:00.096650 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fd933f4c3b43179984c2053e390217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:00.096710 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fd933f4c3b43179984c2053e390217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:00.098624 26799 tablet_bootstrap.cc:492] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:37:00.098759 26798 tablet_bootstrap.cc:492] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:37:00.099040 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 87fd933f4c3b43179984c2053e390217 (DEFAULT_TABLE table=default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:00.099315 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fd933f4c3b43179984c2053e390217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:00.099514 26799 tablet_bootstrap.cc:654] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:00.099603 26798 tablet_bootstrap.cc:654] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:00.100541 26798 tablet_bootstrap.cc:492] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:37:00.100587 26799 tablet_bootstrap.cc:492] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:37:00.100672 26799 ts_tablet_manager.cc:1403] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:00.100697 26798 ts_tablet_manager.cc:1403] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:00.101091 26799 raft_consensus.cc:359] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.101184 26799 raft_consensus.cc:385] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:00.101132 26798 raft_consensus.cc:359] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.101218 26799 raft_consensus.cc:740] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:37:00.101231 26798 raft_consensus.cc:385] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:00.101254 26798 raft_consensus.cc:740] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:37:00.101332 26799 consensus_queue.cc:260] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.101362 26798 consensus_queue.cc:260] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.101611 26799 ts_tablet_manager.cc:1434] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:00.101630 26798 ts_tablet_manager.cc:1434] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:00.101956 26805 tablet_bootstrap.cc:492] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:37:00.104420 26805 tablet_bootstrap.cc:654] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:00.105913 26805 tablet_bootstrap.cc:492] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:37:00.105983 26805 ts_tablet_manager.cc:1403] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.004s	user 0.001s	sys 0.000s
I20260812 06:37:00.106316 26805 raft_consensus.cc:359] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.106400 26805 raft_consensus.cc:385] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:00.106421 26805 raft_consensus.cc:740] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:37:00.106531 26805 consensus_queue.cc:260] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.106791 26805 ts_tablet_manager.cc:1434] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:00.287940 26743 raft_consensus.cc:493] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:00.288060 26743 raft_consensus.cc:515] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.288589 26743 leader_election.cc:290] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:00.288936 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fd933f4c3b43179984c2053e390217" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:37:00.288985 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fd933f4c3b43179984c2053e390217" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:37:00.289073 25338 raft_consensus.cc:2468] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:37:00.289113 25576 raft_consensus.cc:2468] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:37:00.289389 25697 leader_election.cc:304] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:37:00.289568 26743 raft_consensus.cc:2804] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:00.289630 26743 raft_consensus.cc:493] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:00.289669 26743 raft_consensus.cc:3060] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:00.290561 26743 raft_consensus.cc:515] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.290869 26743 leader_election.cc:290] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:00.291155 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fd933f4c3b43179984c2053e390217" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:37:00.291276 25338 raft_consensus.cc:3060] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:00.291252 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87fd933f4c3b43179984c2053e390217" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:37:00.291363 25576 raft_consensus.cc:3060] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:00.292044 25338 raft_consensus.cc:2468] T 87fd933f4c3b43179984c2053e390217 P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:37:00.292172 25576 raft_consensus.cc:2468] T 87fd933f4c3b43179984c2053e390217 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:37:00.292330 25697 leader_election.cc:304] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:37:00.292485 26743 raft_consensus.cc:2804] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:00.292671 26743 raft_consensus.cc:697] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [term 1 LEADER]: Becoming Leader. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Running, Role: LEADER
I20260812 06:37:00.292810 26743 consensus_queue.cc:237] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.294421 25009 catalog_manager.cc:5719] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b051808a9564a54a44175cacdeaa851 (127.19.182.3). New cstate: current_term: 1 leader_uuid: "7b051808a9564a54a44175cacdeaa851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: HEALTHY } } }
W20260812 06:37:00.328065 25740 tablet_service.cc:3018] Rejecting scan request for tablet 87fd933f4c3b43179984c2053e390217: Uninitialized: clean time has not yet been initialized
W20260812 06:37:00.529546 25740 tablet_service.cc:3018] Rejecting scan request for tablet 87fd933f4c3b43179984c2053e390217: Uninitialized: clean time has not yet been initialized
I20260812 06:37:00.798164 26815 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:00.798281 26815 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:00.798681 26815 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:00.799075 25038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 24 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:00.806787 26743 consensus_queue.cc:1048] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:00.810742 26743 consensus_queue.cc:1048] T 87fd933f4c3b43179984c2053e390217 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:37:00.932094 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.001s	sys 0.000s
I20260812 06:37:00.933431 26048 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39840:
name: "default.table_1_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:37:00.933662 26540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:00.933775 26540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:00.934419 26613 raft_consensus.cc:1240] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Rejecting Update request from peer 1ca3e3140b554813be67d29042c31ba6 for earlier term 3. Current term is 4. Ops: []
W20260812 06:37:00.934007 26048 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:00.934952 26540 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 }, Status: INVALID_TERM, Last received: 3.20, Next index: 21, Last known committed idx: 24, Time since last communication: 0.001s
I20260812 06:37:00.935762 26540 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 06:37:00.935810 26540 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ca3e3140b554813be67d29042c31ba6, State: Running, Role: LEADER
I20260812 06:37:00.935951 26540 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 3.20, Last appended by leader: 20, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
W20260812 06:37:00.935472 26049 catalog_manager.cc:5552] Ignoring report from unknown tablet 87fd933f4c3b43179984c2053e390217
I20260812 06:37:00.936218 26540 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:00.936825 26068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.936997 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.937251 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6"
I20260812 06:37:00.937418 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6"
I20260812 06:37:00.937568 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:00.937638 26048 catalog_manager.cc:2228] Illegal state: an error occurred while writing to the sys-catalog: replica 1ca3e3140b554813be67d29042c31ba6 is not leader of this config: current role FOLLOWER
I20260812 06:37:00.937799 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.937939 26063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 24 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.938068 26066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.938263 26067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.938503 26077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.938675 26069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.938848 26061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 4 candidate_status { last_received { term: 3 index: 20 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.939028 26065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 5 candidate_status { last_received { term: 4 index: 21 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:00.939446 25038 raft_consensus.cc:1240] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 4 LEADER]: Rejecting Update request from peer 1ca3e3140b554813be67d29042c31ba6 for earlier term 3. Current term is 4. Ops: []
I20260812 06:37:00.939561 26068 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a64236e67a9c458d8160cf015bff12ac in term 4.
I20260812 06:37:00.940373 26071 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Refusing update from remote peer c6e5df2c51e84400916b9e114c9aca13: Log matching property violated. Preceding OpId in replica: term: 3 index: 20. Preceding OpId from leader: term: 4 index: 21. (index mismatch)
I20260812 06:37:00.941781 26830 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260812 06:37:00.943805 25009 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.table_1_1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:37:00.943948 26540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:00.944032 26540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:00.944209 26547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 4 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:00.944288 26547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:37:00.944275 25009 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1_1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:00.945161 26834 mvcc.cc:204] Tried to move back new op lower bound from 7317572076729487360 to 7317572036730445824. Current Snapshot: MvccSnapshot[applied={T|T < 7317572076729487360}]
I20260812 06:37:00.945847 26830 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:00.945945 26830 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:00.951839 25303 tablet_service.cc:1511] Processing CreateTablet for tablet 42ffa80ba4a649449fff998741215f5d (DEFAULT_TABLE table=default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:00.952019 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 42ffa80ba4a649449fff998741215f5d (DEFAULT_TABLE table=default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:00.952142 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ffa80ba4a649449fff998741215f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:00.952244 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 42ffa80ba4a649449fff998741215f5d (DEFAULT_TABLE table=default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:00.952311 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ffa80ba4a649449fff998741215f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:00.952492 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ffa80ba4a649449fff998741215f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:00.953863 26850 tablet_bootstrap.cc:492] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:37:00.954702 26852 tablet_bootstrap.cc:492] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:37:00.954778 26850 tablet_bootstrap.cc:654] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:00.954921 26851 tablet_bootstrap.cc:492] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:37:00.955636 26852 tablet_bootstrap.cc:654] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:00.955893 26851 tablet_bootstrap.cc:654] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:00.955958 26850 tablet_bootstrap.cc:492] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:37:00.956048 26850 ts_tablet_manager.cc:1403] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:00.956415 26850 raft_consensus.cc:359] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.956507 26850 raft_consensus.cc:385] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:00.956538 26850 raft_consensus.cc:740] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:37:00.956662 26850 consensus_queue.cc:260] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.956835 26851 tablet_bootstrap.cc:492] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:37:00.956931 26850 ts_tablet_manager.cc:1434] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:00.957330 26851 ts_tablet_manager.cc:1403] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:00.957804 26851 raft_consensus.cc:359] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.957947 26851 raft_consensus.cc:385] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:00.957996 26851 raft_consensus.cc:740] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:37:00.958163 26851 consensus_queue.cc:260] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.958328 26852 tablet_bootstrap.cc:492] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:37:00.958671 26851 ts_tablet_manager.cc:1434] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:00.959578 26852 ts_tablet_manager.cc:1403] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.000s
I20260812 06:37:00.960054 26852 raft_consensus.cc:359] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.960660 26852 raft_consensus.cc:385] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:00.960775 26852 raft_consensus.cc:740] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:37:00.960987 26852 consensus_queue.cc:260] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.961326 26852 ts_tablet_manager.cc:1434] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:00.997378 26499 raft_consensus.cc:493] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:00.997519 26499 raft_consensus.cc:515] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:00.997967 26499 leader_election.cc:290] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:37:00.998435 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ffa80ba4a649449fff998741215f5d" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851" is_pre_election: true
I20260812 06:37:00.998435 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ffa80ba4a649449fff998741215f5d" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:37:00.998593 25338 raft_consensus.cc:2468] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 0.
I20260812 06:37:00.998593 25816 raft_consensus.cc:2468] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 0.
I20260812 06:37:00.998912 25461 leader_election.cc:304] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b051808a9564a54a44175cacdeaa851, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:37:00.999097 26499 raft_consensus.cc:2804] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:00.999169 26499 raft_consensus.cc:493] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:00.999197 26499 raft_consensus.cc:3060] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:01.000038 26499 raft_consensus.cc:515] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:01.000375 26499 leader_election.cc:290] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:37:01.000727 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ffa80ba4a649449fff998741215f5d" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:37:01.000725 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ffa80ba4a649449fff998741215f5d" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851"
I20260812 06:37:01.000854 25338 raft_consensus.cc:3060] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:01.000859 25816 raft_consensus.cc:3060] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:01.001791 25338 raft_consensus.cc:2468] T 42ffa80ba4a649449fff998741215f5d P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 1.
I20260812 06:37:01.001808 25816 raft_consensus.cc:2468] T 42ffa80ba4a649449fff998741215f5d P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 1.
I20260812 06:37:01.002094 25467 leader_election.cc:304] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:37:01.002254 26499 raft_consensus.cc:2804] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:01.002499 26499 raft_consensus.cc:697] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 LEADER]: Becoming Leader. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Running, Role: LEADER
I20260812 06:37:01.002640 26499 consensus_queue.cc:237] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:01.004848 25009 catalog_manager.cc:5719] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2). New cstate: current_term: 1 leader_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:01.017181 25505 tablet_service.cc:3018] Rejecting scan request for tablet 42ffa80ba4a649449fff998741215f5d: Uninitialized: clean time has not yet been initialized
W20260812 06:37:01.219027 25505 tablet_service.cc:3018] Rejecting scan request for tablet 42ffa80ba4a649449fff998741215f5d: Uninitialized: clean time has not yet been initialized
I20260812 06:37:01.406491 26499 consensus_queue.cc:1048] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:01.411849 26499 consensus_queue.cc:1048] T 42ffa80ba4a649449fff998741215f5d P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:01.509091 26882 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:01.509200 26882 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:01.509666 26882 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:01.510094 25038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 5 candidate_status { last_received { term: 4 index: 27 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:37:01.621659 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.001s	sys 0.000s
I20260812 06:37:01.622421 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:01.623201 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 5 candidate_status { last_received { term: 4 index: 27 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:37:01.623497 26815 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 06:37:01.624145 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6; no voters: a64236e67a9c458d8160cf015bff12ac, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:01.624873 26882 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 06:37:02.135157 26891 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:02.135280 26891 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:02.135679 26891 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:02.136013 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 5 candidate_status { last_received { term: 4 index: 27 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:37:02.136148 26613 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ca3e3140b554813be67d29042c31ba6 in term 4.
I20260812 06:37:02.136428 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac; no voters: 
I20260812 06:37:02.136607 26891 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 06:37:02.136669 26891 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:02.136713 26891 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:02.137580 26891 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:02.137907 26891 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 5 election: Requested vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:02.138290 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 5 candidate_status { last_received { term: 4 index: 27 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac"
I20260812 06:37:02.138417 26613 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:02.139168 26613 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ca3e3140b554813be67d29042c31ba6 in term 5.
I20260812 06:37:02.139433 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac; no voters: 
I20260812 06:37:02.139590 26891 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 06:37:02.139724 26891 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 5 LEADER]: Becoming Leader. State: Replica: 1ca3e3140b554813be67d29042c31ba6, State: Running, Role: LEADER
I20260812 06:37:02.139858 26891 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 4.27, Last appended by leader: 27, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:02.140441 26892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 5 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:02.140552 26892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:02.140801 26896 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:02.141726 26896 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003]
I20260812 06:37:02.141947 26896 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=52190151f319499187f516b738595e22]
I20260812 06:37:02.142181 26896 catalog_manager.cc:679] Loaded metadata for table default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe]
I20260812 06:37:02.142382 26896 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59]
I20260812 06:37:02.142563 26896 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c]
I20260812 06:37:02.142763 26896 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8]
I20260812 06:37:02.142976 26896 catalog_manager.cc:679] Loaded metadata for table default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386]
I20260812 06:37:02.143564 26896 tablet_loader.cc:96] loaded metadata for tablet 0e17fd797cb848f2bc9188bca1fb255f (table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c])
I20260812 06:37:02.143761 26896 tablet_loader.cc:96] loaded metadata for tablet 1697cc6d44874f6fa37896fdf764b482 (table default.table_1 [id=52190151f319499187f516b738595e22])
I20260812 06:37:02.143927 26896 tablet_loader.cc:96] loaded metadata for tablet 42ffa80ba4a649449fff998741215f5d (table default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe])
I20260812 06:37:02.144097 26896 tablet_loader.cc:96] loaded metadata for tablet 87fd933f4c3b43179984c2053e390217 (table default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386])
I20260812 06:37:02.144268 26896 tablet_loader.cc:96] loaded metadata for tablet a517de0c6d8544f0b357b83e96afbdea (table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8])
I20260812 06:37:02.144428 26896 tablet_loader.cc:96] loaded metadata for tablet d3126e10ad6a4327a05196f6e02f2e55 (table default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003])
I20260812 06:37:02.144587 26896 tablet_loader.cc:96] loaded metadata for tablet db0783c62f6d45af9320a0da67f0f7ab (table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59])
I20260812 06:37:02.144754 26896 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:02.145154 26896 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:37:02.145197 26896 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:02.145738 26896 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:02.146160 26896 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Loaded TSK: 0
I20260812 06:37:02.146409 26896 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:02.650439 26613 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Refusing update from remote peer 1ca3e3140b554813be67d29042c31ba6: Log matching property violated. Preceding OpId in replica: term: 4 index: 25. Preceding OpId from leader: term: 5 index: 28. (index mismatch)
I20260812 06:37:02.650893 26892 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 24, Time since last communication: 0.000s
I20260812 06:37:02.652624 26897 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 5 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:02.652733 26897 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:02.653795 26903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:02.653913 26903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:02.654182 26897 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:02.654287 26897 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:02.795156 25662 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
W20260812 06:37:02.879153 26035 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.742s (SENT)
I20260812 06:37:02.916079 25413 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
I20260812 06:37:02.918311 25916 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
W20260812 06:37:03.623611 26035 leader_election.cc:336] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.742s (SENT)
I20260812 06:37:03.638466 26909 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:03.638559 26909 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:03.638911 26909 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:03.639274 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 28 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:03.924466 26035 leader_election.cc:336] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.892s (SENT)
W20260812 06:37:04.749487 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.554s (SENT)
I20260812 06:37:04.749575 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:04.749831 26920 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 06:37:06.953438 26921 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:06.953558 26921 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:06.953964 26921 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:06.954373 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 28 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:07.580523 26573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.625s (SENT) [suppressed 1 similar messages]
W20260812 06:37:08.207109 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.625s (SENT)
I20260812 06:37:08.207209 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:08.207521 26928 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 06:37:08.915109 26929 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:08.915235 26929 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:08.915647 26929 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:08.916059 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 28 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:10.324990 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.703s (SENT)
I20260812 06:37:10.325086 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:10.325356 26935 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 06:37:11.324553 26940 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:11.324668 26940 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:11.325062 26940 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:11.325412 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 28 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:11.634652 25931 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.182.60:36573)
I20260812 06:37:11.636482 26053 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39840:
name: "default.table_1_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:11.636993 26053 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:11.644888 25303 tablet_service.cc:1511] Processing CreateTablet for tablet f26bffa545e6482eb8329826cd005b77 (DEFAULT_TABLE table=default.table_1_2 [id=251e093bedb44656b809fbd14d1f5372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:11.645105 25542 tablet_service.cc:1511] Processing CreateTablet for tablet f26bffa545e6482eb8329826cd005b77 (DEFAULT_TABLE table=default.table_1_2 [id=251e093bedb44656b809fbd14d1f5372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:11.645198 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26bffa545e6482eb8329826cd005b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:11.645391 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26bffa545e6482eb8329826cd005b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:11.645396 25743 tablet_service.cc:1511] Processing CreateTablet for tablet f26bffa545e6482eb8329826cd005b77 (DEFAULT_TABLE table=default.table_1_2 [id=251e093bedb44656b809fbd14d1f5372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:11.645653 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26bffa545e6482eb8329826cd005b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:11.646984 26958 tablet_bootstrap.cc:492] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:37:11.647856 26960 tablet_bootstrap.cc:492] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:37:11.648057 26958 tablet_bootstrap.cc:654] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:11.648331 26959 tablet_bootstrap.cc:492] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:37:11.648943 26960 tablet_bootstrap.cc:654] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:11.649207 26958 tablet_bootstrap.cc:492] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:37:11.649299 26958 ts_tablet_manager.cc:1403] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:11.649389 26959 tablet_bootstrap.cc:654] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:11.649768 26958 raft_consensus.cc:359] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.649859 26958 raft_consensus.cc:385] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:11.649890 26958 raft_consensus.cc:740] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:37:11.650038 26958 consensus_queue.cc:260] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.650125 26960 tablet_bootstrap.cc:492] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:37:11.650255 26960 ts_tablet_manager.cc:1403] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:11.650384 26958 ts_tablet_manager.cc:1434] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:11.650487 26959 tablet_bootstrap.cc:492] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:37:11.650588 26959 ts_tablet_manager.cc:1403] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:11.650732 26960 raft_consensus.cc:359] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.650846 26960 raft_consensus.cc:385] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:11.650889 26960 raft_consensus.cc:740] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:37:11.651007 26960 consensus_queue.cc:260] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.651007 26959 raft_consensus.cc:359] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.651098 26959 raft_consensus.cc:385] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:11.651135 26959 raft_consensus.cc:740] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:37:11.651252 26959 consensus_queue.cc:260] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.651280 26960 ts_tablet_manager.cc:1434] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:11.651491 26959 ts_tablet_manager.cc:1434] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
W20260812 06:37:11.684561 25918 tablet.cc:2406] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:37:11.763669 25665 tablet.cc:2406] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:37:11.836679 25415 tablet.cc:2406] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:11.958575 26873 raft_consensus.cc:493] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:11.958696 26873 raft_consensus.cc:515] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.959096 26873 leader_election.cc:290] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:11.959466 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26bffa545e6482eb8329826cd005b77" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:37:11.959543 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26bffa545e6482eb8329826cd005b77" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:37:11.959628 25338 raft_consensus.cc:2468] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:37:11.959671 25574 raft_consensus.cc:2468] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:37:11.959964 25697 leader_election.cc:304] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b051808a9564a54a44175cacdeaa851, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:37:11.960135 26873 raft_consensus.cc:2804] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:11.960204 26873 raft_consensus.cc:493] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:11.960250 26873 raft_consensus.cc:3060] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:11.961074 26873 raft_consensus.cc:515] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.961386 26873 leader_election.cc:290] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:11.961747 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26bffa545e6482eb8329826cd005b77" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:37:11.961774 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26bffa545e6482eb8329826cd005b77" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:37:11.961865 25574 raft_consensus.cc:3060] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:11.961865 25338 raft_consensus.cc:3060] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:11.962828 25338 raft_consensus.cc:2468] T f26bffa545e6482eb8329826cd005b77 P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:37:11.962828 25574 raft_consensus.cc:2468] T f26bffa545e6482eb8329826cd005b77 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:37:11.963100 25697 leader_election.cc:304] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:37:11.963256 26873 raft_consensus.cc:2804] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:11.963349 26873 raft_consensus.cc:697] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [term 1 LEADER]: Becoming Leader. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Running, Role: LEADER
I20260812 06:37:11.963488 26873 consensus_queue.cc:237] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:11.965358 26053 catalog_manager.cc:5719] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b051808a9564a54a44175cacdeaa851 (127.19.182.3). New cstate: current_term: 1 leader_uuid: "7b051808a9564a54a44175cacdeaa851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: HEALTHY } } }
W20260812 06:37:12.007397 25740 tablet_service.cc:3018] Rejecting scan request for tablet f26bffa545e6482eb8329826cd005b77: Uninitialized: clean time has not yet been initialized
W20260812 06:37:12.209038 25740 tablet_service.cc:3018] Rejecting scan request for tablet f26bffa545e6482eb8329826cd005b77: Uninitialized: clean time has not yet been initialized
I20260812 06:37:12.542405 26873 consensus_queue.cc:1048] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:12.546789 26977 consensus_queue.cc:1048] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:37:12.611351 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.001s	sys 0.001s
I20260812 06:37:12.611893 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 24961
W20260812 06:37:12.623608 26571 connection.cc:573] server connection from 127.0.0.1:49464 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:12.623656 25931 connection.cc:573] client connection to 127.19.182.60:36573 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:12.623991 25695 connection.cc:573] client connection to 127.19.182.60:36573 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:12.624012 25464 connection.cc:573] client connection to 127.19.182.60:36573 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:12.624073 26573 connection.cc:573] client connection to 127.19.182.60:36573 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:12.624197 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:37:12.624274 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
W20260812 06:37:12.624737 26035 connection.cc:573] client connection to 127.19.182.60:36573 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:12.624825 26035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
W20260812 06:37:12.625108 25223 connection.cc:573] client connection to 127.19.182.60:36573 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:37:12.625764 26993 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 06:37:12.627307 26035 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 -> Peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Couldn't send request to peer c6e5df2c51e84400916b9e114c9aca13. Status: Network error: Client connection negotiation failed: client connection to 127.19.182.60:36573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:12.733309 27006 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:12.733464 27006 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
W20260812 06:37:12.735124 27006 dir_manager.cc:729] IO error: Could not lock instance file. Make sure that Kudu is not already running and you are not trying to run Kudu with a different user than before: lock /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data/data/block_manager_instance: Resource temporarily unavailable (error 11)
W20260812 06:37:12.735178 27006 dir_manager.cc:730] Proceeding without lock
I20260812 06:37:12.737388 27006 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:12.737557 27006 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-1/wal
uuid: "a64236e67a9c458d8160cf015bff12ac"
format_stamp: "Formatted at 2026-08-12 06:36:49 on dist-test-slave-q9h9"
I20260812 06:37:12.749761 20184 master_failover-itest.cc:413] tablet: 00000000000000000000000000000000, peers: 1ca3e3140b554813be67d29042c31ba6 a64236e67a9c458d8160cf015bff12ac c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:12.853765 27015 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:12.853935 27015 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:12.859149 27015 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/instance:
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:37:12 on dist-test-slave-q9h9"
I20260812 06:37:12.861815 27015 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal/instance:
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:37:12 on dist-test-slave-q9h9"
I20260812 06:37:12.869158 27015 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.003s
I20260812 06:37:12.990494 27030 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:12.990696 27030 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:12.994828 27030 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:37:12.996788 27045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:12.997464 27030 fs_report.cc:389] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:12.997823 27030 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:12.997869 27030 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:37:12 on dist-test-slave-q9h9"
W20260812 06:37:13.003043 27050 tool_action_local_replica.cc:343] Start to copy tablet 00000000000000000000000000000000
I20260812 06:37:13.003825 27050 tablet_copy_client.cc:323] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: tablet copy: Beginning tablet copy session from remote peer at address 127.19.182.61:34983
I20260812 06:37:13.016618 26628 tablet_copy_service.cc:140] P a64236e67a9c458d8160cf015bff12ac: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c6e5df2c51e84400916b9e114c9aca13 ({username='slave'} at 127.0.0.1:46590)
I20260812 06:37:13.016747 26628 tablet_copy_service.cc:161] P a64236e67a9c458d8160cf015bff12ac: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c6e5df2c51e84400916b9e114c9aca13 at {username='slave'} at 127.0.0.1:46590: session id = c6e5df2c51e84400916b9e114c9aca13-00000000000000000000000000000000
I20260812 06:37:13.017791 26628 tablet_copy_source_session.cc:215] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:37:13.021224 27050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:37:13.028663 27050 tablet_copy_client.cc:806] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: tablet copy: Starting download of 0 data blocks...
I20260812 06:37:13.029791 27050 tablet_copy_client.cc:670] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: tablet copy: Starting download of 1 WAL segments...
I20260812 06:37:13.033025 27050 tablet_copy_client.cc:538] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:37:13.036820 27050 tool_action_local_replica.cc:343] Tablet 00000000000000000000000000000000 copy succeed.
I20260812 06:37:13.036867 27050 tool_action_local_replica.cc:343] 1/1 tablets, 11601 bytes copied, include 0 failed tablets.
I20260812 06:37:13.037328 26628 tablet_copy_service.cc:342] P a64236e67a9c458d8160cf015bff12ac: Request end of tablet copy session c6e5df2c51e84400916b9e114c9aca13-00000000000000000000000000000000 received from {username='slave'} at 127.0.0.1:46590
I20260812 06:37:13.037415 26628 tablet_copy_service.cc:434] P a64236e67a9c458d8160cf015bff12ac: ending tablet copy session c6e5df2c51e84400916b9e114c9aca13-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:13.049552 20184 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
/tmp/dist-test-taskAKyXY_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:36573
--webserver_interface=127.19.182.60
--webserver_port=0
--builtin_ntp_servers=127.19.182.20:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--leader_failure_max_missed_heartbeat_periods=1.0 with env {}
W20260812 06:37:13.152733 27062 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:13.152920 27062 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:13.152959 27062 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:13.156237 27062 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:13.156292 27062 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:13.156311 27062 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:13.156329 27062 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:13.160140 27062 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.182.20:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.182.62:35785,127.19.182.61:34983,127.19.182.60:36573
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.182.60:36573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.182.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.27062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:13.161108 27062 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:13.162187 27062 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:13.167418 27076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:13.167413 27080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:13.167517 27062 server_base.cc:1061] running on GCE node
W20260812 06:37:13.167413 27075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:13.168095 27062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:13.168922 27062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:13.170070 27062 hybrid_clock.cc:648] HybridClock initialized: now 1786516633170063 us; error 27 us; skew 500 ppm
I20260812 06:37:13.171669 27062 webserver.cc:533] Webserver started at http://127.19.182.60:38075/ using document root <none> and password file <none>
I20260812 06:37:13.172194 27062 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:13.172254 27062 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:13.175478 27062 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:13.177258 27091 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:13.178185 27062 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:13.178289 27062 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data,/tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
uuid: "c6e5df2c51e84400916b9e114c9aca13"
format_stamp: "Formatted at 2026-08-12 06:37:12 on dist-test-slave-q9h9"
I20260812 06:37:13.178632 27062 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:13.206254 27062 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:13.206810 27062 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:13.206972 27062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:13.213804 27183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.182.60:36573 every 8 connection(s)
I20260812 06:37:13.213810 27062 rpc_server.cc:307] RPC server started. Bound to: 127.19.182.60:36573
I20260812 06:37:13.214880 27062 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAKyXY_/test-tmp/master_failover-itest.0.HmsConfigurations_MasterFailoverTest.TestMasterPermanentFailure_0.1786516565560733-20184-0/minicluster-data/master-2/data/info.pb
I20260812 06:37:13.215310 20184 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu as pid 27062
I20260812 06:37:13.216420 26058 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39840:
name: "default.table_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:13.216955 26058 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:13.219251 27184 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:37:13.221019 27184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Bootstrap starting.
I20260812 06:37:13.226564 25303 tablet_service.cc:1511] Processing CreateTablet for tablet 44efea9a35b548e89e737eb626335cb4 (DEFAULT_TABLE table=default.table_2 [id=c2d2820a03084cf4986c250cde83bb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:13.226562 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 44efea9a35b548e89e737eb626335cb4 (DEFAULT_TABLE table=default.table_2 [id=c2d2820a03084cf4986c250cde83bb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:13.226722 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 44efea9a35b548e89e737eb626335cb4 (DEFAULT_TABLE table=default.table_2 [id=c2d2820a03084cf4986c250cde83bb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:13.226876 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44efea9a35b548e89e737eb626335cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:13.226878 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44efea9a35b548e89e737eb626335cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:13.226982 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44efea9a35b548e89e737eb626335cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:13.229558 27204 tablet_bootstrap.cc:492] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:37:13.229558 27202 tablet_bootstrap.cc:492] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:37:13.230233 27206 tablet_bootstrap.cc:492] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:37:13.230571 27204 tablet_bootstrap.cc:654] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:13.230571 27202 tablet_bootstrap.cc:654] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:13.230819 27184 log.cc:826] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:13.231284 27206 tablet_bootstrap.cc:654] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:13.231667 27202 tablet_bootstrap.cc:492] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:37:13.231766 27202 ts_tablet_manager.cc:1403] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:13.231863 27204 tablet_bootstrap.cc:492] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:37:13.231945 27204 ts_tablet_manager.cc:1403] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:13.232218 27202 raft_consensus.cc:359] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.232319 27202 raft_consensus.cc:385] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:13.232350 27202 raft_consensus.cc:740] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:37:13.232398 27204 raft_consensus.cc:359] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.232501 27204 raft_consensus.cc:385] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:13.232478 27202 consensus_queue.cc:260] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.232533 27204 raft_consensus.cc:740] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:37:13.232662 27204 consensus_queue.cc:260] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.232769 27202 ts_tablet_manager.cc:1434] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:13.232949 27204 ts_tablet_manager.cc:1434] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:13.237954 27206 tablet_bootstrap.cc:492] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:37:13.238068 27206 ts_tablet_manager.cc:1403] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.008s	user 0.002s	sys 0.000s
I20260812 06:37:13.238561 27206 raft_consensus.cc:359] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.238730 27206 raft_consensus.cc:385] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:13.238823 27206 raft_consensus.cc:740] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:37:13.239017 27206 consensus_queue.cc:260] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.241806 27206 ts_tablet_manager.cc:1434] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.000s
I20260812 06:37:13.245414 25912 heartbeater.cc:344] Connected to a master server at 127.19.182.60:36573
I20260812 06:37:13.248165 25412 heartbeater.cc:344] Connected to a master server at 127.19.182.60:36573
I20260812 06:37:13.248539 25661 heartbeater.cc:344] Connected to a master server at 127.19.182.60:36573
I20260812 06:37:13.252651 27184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Bootstrap replayed 1/1 log segments. Stats: ops{read=31 overwritten=0 applied=31 ignored=0} inserts{seen=19 ignored=0} mutations{seen=16 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:13.252947 27184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Bootstrap complete.
I20260812 06:37:13.255883 27184 raft_consensus.cc:359] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:13.256181 27184 raft_consensus.cc:740] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e5df2c51e84400916b9e114c9aca13, State: Initialized, Role: FOLLOWER
I20260812 06:37:13.256573 27184 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 31, Last appended: 5.31, Last appended by leader: 31, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:13.256978 27223 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:13.257094 27223 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:13.257608 27184 sys_catalog.cc:565] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:13.262250 27242 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:37:13.262297 27242 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: loading cluster ID for follower catalog manager: success
I20260812 06:37:13.264079 27242 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: acquiring CA information for follower catalog manager: success
I20260812 06:37:13.265509 27242 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:37:13.431759 27144 raft_consensus.cc:1217] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 4.27->[5.28-5.33]   Dedup: 5.31->[5.32-5.33]
I20260812 06:37:13.435050 27223 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 5 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:13.435190 27223 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:13.477667 26977 raft_consensus.cc:493] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:13.477785 26977 raft_consensus.cc:515] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.478247 26977 leader_election.cc:290] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:13.478652 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44efea9a35b548e89e737eb626335cb4" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:37:13.478696 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44efea9a35b548e89e737eb626335cb4" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:37:13.478818 25574 raft_consensus.cc:2468] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:37:13.478817 25338 raft_consensus.cc:2468] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:37:13.479136 25697 leader_election.cc:304] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:37:13.479305 26977 raft_consensus.cc:2804] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:13.479369 26977 raft_consensus.cc:493] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:13.479418 26977 raft_consensus.cc:3060] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:13.480233 26977 raft_consensus.cc:515] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.480536 26977 leader_election.cc:290] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:13.480829 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44efea9a35b548e89e737eb626335cb4" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:37:13.480942 25338 raft_consensus.cc:3060] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:13.480943 25574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44efea9a35b548e89e737eb626335cb4" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:37:13.481033 25574 raft_consensus.cc:3060] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:13.481936 25574 raft_consensus.cc:2468] T 44efea9a35b548e89e737eb626335cb4 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:37:13.481936 25338 raft_consensus.cc:2468] T 44efea9a35b548e89e737eb626335cb4 P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:37:13.482223 25697 leader_election.cc:304] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:37:13.482384 26977 raft_consensus.cc:2804] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:13.482474 26977 raft_consensus.cc:697] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [term 1 LEADER]: Becoming Leader. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Running, Role: LEADER
I20260812 06:37:13.482609 26977 consensus_queue.cc:237] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:13.484513 26058 catalog_manager.cc:5719] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b051808a9564a54a44175cacdeaa851 (127.19.182.3). New cstate: current_term: 1 leader_uuid: "7b051808a9564a54a44175cacdeaa851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:13.484686 27124 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "7b051808a9564a54a44175cacdeaa851" instance_seqno: 1786516594629543) as {username='slave'} at 127.19.182.3:45907; Asking this server to re-register.
I20260812 06:37:13.485126 25912 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:13.486279 27040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:13.486387 27040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:13.486418 27124 ts_manager.cc:194] Registered new tserver with Master: 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
W20260812 06:37:13.518078 25740 tablet_service.cc:3018] Rejecting scan request for tablet 44efea9a35b548e89e737eb626335cb4: Uninitialized: clean time has not yet been initialized
W20260812 06:37:13.719601 25740 tablet_service.cc:3018] Rejecting scan request for tablet 44efea9a35b548e89e737eb626335cb4: Uninitialized: clean time has not yet been initialized
I20260812 06:37:13.751494 27124 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" instance_seqno: 1786516594278598) as {username='slave'} at 127.19.182.1:32771; Asking this server to re-register.
I20260812 06:37:13.751926 25412 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:13.752152 27124 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" instance_seqno: 1786516594458851) as {username='slave'} at 127.19.182.2:46607; Asking this server to re-register.
I20260812 06:37:13.752565 25661 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:13.752959 27124 ts_manager.cc:194] Registered new tserver with Master: 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275)
I20260812 06:37:13.753494 27126 ts_manager.cc:194] Registered new tserver with Master: d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:13.949121 26977 consensus_queue.cc:1048] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:13.951380 26977 consensus_queue.cc:1048] T 44efea9a35b548e89e737eb626335cb4 P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:13.988417 27270 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:13.988587 27270 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:13.988912 27271 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:13.989017 27271 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:13.989423 27271 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:13.989842 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 34 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:13.990053 27270 leader_election.cc:290] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983)
I20260812 06:37:13.990513 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 6 candidate_status { last_received { term: 5 index: 34 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:13.990513 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 6 candidate_status { last_received { term: 5 index: 34 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:37:13.990636 26613 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6e5df2c51e84400916b9e114c9aca13 in term 5.
I20260812 06:37:13.991190 27093 leader_election.cc:304] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac, c6e5df2c51e84400916b9e114c9aca13; no voters: 1ca3e3140b554813be67d29042c31ba6
I20260812 06:37:13.991432 27270 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 06:37:13.991505 27270 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:13.991565 27270 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:13.993570 27270 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:13.993903 27270 leader_election.cc:290] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 6 election: Requested vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983)
I20260812 06:37:13.994128 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 6 candidate_status { last_received { term: 5 index: 34 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:13.994217 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 6 candidate_status { last_received { term: 5 index: 34 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6"
I20260812 06:37:13.994364 27144 raft_consensus.cc:2393] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a64236e67a9c458d8160cf015bff12ac in current term 6: Already voted for candidate c6e5df2c51e84400916b9e114c9aca13 in this term.
I20260812 06:37:13.994488 26613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e5df2c51e84400916b9e114c9aca13" candidate_term: 6 candidate_status { last_received { term: 5 index: 34 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac"
I20260812 06:37:13.994597 26613 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:13.994701 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:13.995395 26613 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6e5df2c51e84400916b9e114c9aca13 in term 6.
I20260812 06:37:13.995486 27271 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 06:37:13.995697 27093 leader_election.cc:304] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac, c6e5df2c51e84400916b9e114c9aca13; no voters: 1ca3e3140b554813be67d29042c31ba6
I20260812 06:37:13.995882 27270 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 06:37:13.996057 27270 raft_consensus.cc:697] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 6 LEADER]: Becoming Leader. State: Replica: c6e5df2c51e84400916b9e114c9aca13, State: Running, Role: LEADER
I20260812 06:37:13.996300 27270 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 5.34, Last appended by leader: 34, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:13.997006 27281 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 6 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:13.997108 27281 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:13.997377 27282 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:13.998907 27282 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003]
I20260812 06:37:13.999183 27282 catalog_manager.cc:679] Loaded metadata for table default.table_1_2 [id=251e093bedb44656b809fbd14d1f5372]
I20260812 06:37:13.999397 27282 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=52190151f319499187f516b738595e22]
I20260812 06:37:13.999596 27282 catalog_manager.cc:679] Loaded metadata for table default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe]
I20260812 06:37:13.999804 27282 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59]
I20260812 06:37:14.000001 27282 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c]
I20260812 06:37:14.000193 27282 catalog_manager.cc:679] Loaded metadata for table default.table_2 [id=c2d2820a03084cf4986c250cde83bb1c]
I20260812 06:37:14.000385 27282 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8]
I20260812 06:37:14.000569 27282 catalog_manager.cc:679] Loaded metadata for table default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386]
I20260812 06:37:14.001502 27282 tablet_loader.cc:96] loaded metadata for tablet 0e17fd797cb848f2bc9188bca1fb255f (table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c])
I20260812 06:37:14.001715 27282 tablet_loader.cc:96] loaded metadata for tablet 1697cc6d44874f6fa37896fdf764b482 (table default.table_1 [id=52190151f319499187f516b738595e22])
I20260812 06:37:14.001900 27282 tablet_loader.cc:96] loaded metadata for tablet 42ffa80ba4a649449fff998741215f5d (table default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe])
I20260812 06:37:14.002094 27282 tablet_loader.cc:96] loaded metadata for tablet 44efea9a35b548e89e737eb626335cb4 (table default.table_2 [id=c2d2820a03084cf4986c250cde83bb1c])
I20260812 06:37:14.002257 27282 tablet_loader.cc:96] loaded metadata for tablet 87fd933f4c3b43179984c2053e390217 (table default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386])
I20260812 06:37:14.002417 27282 tablet_loader.cc:96] loaded metadata for tablet a517de0c6d8544f0b357b83e96afbdea (table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8])
I20260812 06:37:14.002578 27282 tablet_loader.cc:96] loaded metadata for tablet d3126e10ad6a4327a05196f6e02f2e55 (table default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003])
I20260812 06:37:14.002740 27282 tablet_loader.cc:96] loaded metadata for tablet db0783c62f6d45af9320a0da67f0f7ab (table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59])
I20260812 06:37:14.002905 27282 tablet_loader.cc:96] loaded metadata for tablet f26bffa545e6482eb8329826cd005b77 (table default.table_1_2 [id=251e093bedb44656b809fbd14d1f5372])
I20260812 06:37:14.003005 27282 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:14.003400 27282 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:37:14.003444 27282 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:14.003954 27282 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:14.004354 27282 catalog_manager.cc:6103] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Loaded TSK: 0
I20260812 06:37:14.004930 27282 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:14.040560 27144 raft_consensus.cc:1240] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 6 LEADER]: Rejecting Update request from peer 1ca3e3140b554813be67d29042c31ba6 for earlier term 5. Current term is 6. Ops: []
I20260812 06:37:14.041041 27288 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 }, Status: INVALID_TERM, Last received: 5.34, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260812 06:37:14.041260 27288 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Peer c6e5df2c51e84400916b9e114c9aca13 log is divergent from this leader: its last log entry 6.35 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 34
I20260812 06:37:14.041342 27289 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 06:37:14.041414 27289 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1ca3e3140b554813be67d29042c31ba6, State: Running, Role: LEADER
I20260812 06:37:14.041571 27289 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 5.34, Last appended by leader: 34, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:14.041752 27289 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 5 FOLLOWER]: Advancing to term 6
W20260812 06:37:14.121948 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.000s	sys 0.002s
I20260812 06:37:14.512115 26613 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Refusing update from remote peer c6e5df2c51e84400916b9e114c9aca13: Log matching property violated. Preceding OpId in replica: term: 5 index: 34. Preceding OpId from leader: term: 6 index: 35. (index mismatch)
I20260812 06:37:14.512585 27290 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260812 06:37:14.513754 27291 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 6 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:14.513856 27291 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:14.515127 27294 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:14.515288 27294 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:14.515359 27291 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:14.515465 27291 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:14.960140 25661 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
I20260812 06:37:14.960208 25412 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
I20260812 06:37:14.960261 25912 heartbeater.cc:499] Master 127.19.182.60:36573 was elected leader, sending a full tablet report...
I20260812 06:37:15.016265 27303 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:15.016390 27303 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:15.016955 27303 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:15.017388 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:37:15.612175 26573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.594s (SENT) [suppressed 2 similar messages]
W20260812 06:37:16.207651 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.594s (SENT)
I20260812 06:37:16.207770 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:16.208093 27309 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 06:37:17.487203 27314 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:17.487321 27314 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:17.487677 27314 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:17.488039 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:37:18.824124 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.667s (SENT)
I20260812 06:37:18.824277 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:18.824721 27327 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 06:37:20.354362 27329 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:20.354504 27329 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:20.354990 27329 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:20.355454 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:37:20.877521 26573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.521s (SENT) [suppressed 1 similar messages]
W20260812 06:37:21.400559 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.521s (SENT)
I20260812 06:37:21.400671 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:21.400975 27336 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 06:37:21.923338 27337 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:21.923502 27337 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:21.923894 27337 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:21.924360 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:37:23.314260 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785): Timed out: RequestConsensusVote RPC to 127.19.182.62:35785 timed out after 0.694s (SENT)
I20260812 06:37:23.314358 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:23.314659 27346 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 06:37:24.135071 25931 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.182.62:35785)
I20260812 06:37:24.140470 27126 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57168:
name: "default.table_2_0"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:24.143301 27126 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:24.157120 25743 tablet_service.cc:1511] Processing CreateTablet for tablet a9d2318474494c4eb1d67047152207df (DEFAULT_TABLE table=default.table_2_0 [id=388a4316fb224c53b3d2bfdacfc2b9ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:24.157467 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d2318474494c4eb1d67047152207df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:24.157650 25303 tablet_service.cc:1511] Processing CreateTablet for tablet a9d2318474494c4eb1d67047152207df (DEFAULT_TABLE table=default.table_2_0 [id=388a4316fb224c53b3d2bfdacfc2b9ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:24.157933 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d2318474494c4eb1d67047152207df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:24.159667 27378 tablet_bootstrap.cc:492] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:37:24.161042 27378 tablet_bootstrap.cc:654] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:24.161158 27379 tablet_bootstrap.cc:492] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:37:24.161206 25542 tablet_service.cc:1511] Processing CreateTablet for tablet a9d2318474494c4eb1d67047152207df (DEFAULT_TABLE table=default.table_2_0 [id=388a4316fb224c53b3d2bfdacfc2b9ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:24.161502 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9d2318474494c4eb1d67047152207df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:24.162119 27379 tablet_bootstrap.cc:654] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:24.162211 27378 tablet_bootstrap.cc:492] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:37:24.162305 27378 ts_tablet_manager.cc:1403] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:24.162820 27378 raft_consensus.cc:359] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.162925 27378 raft_consensus.cc:385] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:24.162953 27378 raft_consensus.cc:740] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:37:24.163080 27378 consensus_queue.cc:260] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.163130 27379 tablet_bootstrap.cc:492] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:37:24.163196 27379 ts_tablet_manager.cc:1403] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:37:24.163352 27378 ts_tablet_manager.cc:1434] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:24.163591 27379 raft_consensus.cc:359] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.163928 27379 raft_consensus.cc:385] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:24.163971 27379 raft_consensus.cc:740] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:37:24.164099 27379 consensus_queue.cc:260] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.165001 27379 ts_tablet_manager.cc:1434] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:37:24.166627 27386 tablet_bootstrap.cc:492] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:37:24.167624 27386 tablet_bootstrap.cc:654] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:24.168615 27386 tablet_bootstrap.cc:492] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:37:24.168691 27386 ts_tablet_manager.cc:1403] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:24.169054 27386 raft_consensus.cc:359] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.169137 27386 raft_consensus.cc:385] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:24.169165 27386 raft_consensus.cc:740] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:37:24.169286 27386 consensus_queue.cc:260] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.169524 27386 ts_tablet_manager.cc:1434] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:24.304306 27328 raft_consensus.cc:493] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:24.304414 27328 raft_consensus.cc:515] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.304818 27328 leader_election.cc:290] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:24.305146 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9d2318474494c4eb1d67047152207df" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:37:24.305222 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9d2318474494c4eb1d67047152207df" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:37:24.305285 25338 raft_consensus.cc:2468] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:37:24.305377 25576 raft_consensus.cc:2468] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 0.
I20260812 06:37:24.305596 25697 leader_election.cc:304] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:37:24.305773 27328 raft_consensus.cc:2804] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:24.305827 27328 raft_consensus.cc:493] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:24.305871 27328 raft_consensus.cc:3060] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:24.306726 27328 raft_consensus.cc:515] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.307034 27328 leader_election.cc:290] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:24.307338 25338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9d2318474494c4eb1d67047152207df" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:37:24.307442 25338 raft_consensus.cc:3060] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:24.307421 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9d2318474494c4eb1d67047152207df" candidate_uuid: "7b051808a9564a54a44175cacdeaa851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:37:24.307530 25576 raft_consensus.cc:3060] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:24.308168 25338 raft_consensus.cc:2468] T a9d2318474494c4eb1d67047152207df P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:37:24.308272 25576 raft_consensus.cc:2468] T a9d2318474494c4eb1d67047152207df P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b051808a9564a54a44175cacdeaa851 in term 1.
I20260812 06:37:24.308440 25697 leader_election.cc:304] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, 7b051808a9564a54a44175cacdeaa851; no voters: 
I20260812 06:37:24.308610 27328 raft_consensus.cc:2804] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:24.308804 27328 raft_consensus.cc:697] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [term 1 LEADER]: Becoming Leader. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Running, Role: LEADER
I20260812 06:37:24.308943 27328 consensus_queue.cc:237] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.310858 27122 catalog_manager.cc:5719] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b051808a9564a54a44175cacdeaa851 (127.19.182.3). New cstate: current_term: 1 leader_uuid: "7b051808a9564a54a44175cacdeaa851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:24.341132 25740 tablet_service.cc:3018] Rejecting scan request for tablet a9d2318474494c4eb1d67047152207df: Uninitialized: clean time has not yet been initialized
W20260812 06:37:24.542698 25740 tablet_service.cc:3018] Rejecting scan request for tablet a9d2318474494c4eb1d67047152207df: Uninitialized: clean time has not yet been initialized
I20260812 06:37:24.738938 27328 consensus_queue.cc:1048] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:24.743492 27388 consensus_queue.cc:1048] T a9d2318474494c4eb1d67047152207df P 7b051808a9564a54a44175cacdeaa851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:24.815115 27406 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:24.815214 27406 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:24.815553 27406 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:24.815944 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 38 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:37:24.944957 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.001s	sys 0.001s
I20260812 06:37:24.946710 26068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.946866 26067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.947125 26063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 38 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.947292 26071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.947448 26066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.947636 26061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.947795 26077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.947834 26065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.947925 26069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 7 candidate_status { last_received { term: 6 index: 35 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
I20260812 06:37:24.946866 26068 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a64236e67a9c458d8160cf015bff12ac in term 6.
I20260812 06:37:24.948529 26079 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Refusing update from remote peer c6e5df2c51e84400916b9e114c9aca13: Log matching property violated. Preceding OpId in replica: term: 5 index: 34. Preceding OpId from leader: term: 6 index: 35. (index mismatch)
I20260812 06:37:24.949010 27408 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260812 06:37:24.951154 27417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:24.951305 27417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:24.954079 27412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e5df2c51e84400916b9e114c9aca13. Latest consensus state: current_term: 6 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:24.954167 27412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:24.956528 27122 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57168:
name: "default.table_2_1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:24.956945 27122 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2_1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:24.958521 27421 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "c6e5df2c51e84400916b9e114c9aca13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:24.958675 27421 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:24.964226 25743 tablet_service.cc:1511] Processing CreateTablet for tablet ff4a8a192d3c46bc8cfe6664e6d048cb (DEFAULT_TABLE table=default.table_2_1 [id=dab2e9d3d6cf44b1bfbad0904e114949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:24.964527 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4a8a192d3c46bc8cfe6664e6d048cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:24.964525 25303 tablet_service.cc:1511] Processing CreateTablet for tablet ff4a8a192d3c46bc8cfe6664e6d048cb (DEFAULT_TABLE table=default.table_2_1 [id=dab2e9d3d6cf44b1bfbad0904e114949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:24.964600 25542 tablet_service.cc:1511] Processing CreateTablet for tablet ff4a8a192d3c46bc8cfe6664e6d048cb (DEFAULT_TABLE table=default.table_2_1 [id=dab2e9d3d6cf44b1bfbad0904e114949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:24.964800 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4a8a192d3c46bc8cfe6664e6d048cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:24.964845 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4a8a192d3c46bc8cfe6664e6d048cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:24.966635 27429 tablet_bootstrap.cc:492] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:37:24.966946 27431 tablet_bootstrap.cc:492] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:37:24.967020 27435 tablet_bootstrap.cc:492] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:37:24.968035 27435 tablet_bootstrap.cc:654] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:24.968318 27431 tablet_bootstrap.cc:654] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:24.968930 27429 tablet_bootstrap.cc:654] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:24.969259 27435 tablet_bootstrap.cc:492] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:37:24.969354 27435 ts_tablet_manager.cc:1403] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:24.969714 27431 tablet_bootstrap.cc:492] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:37:24.969841 27431 ts_tablet_manager.cc:1403] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:24.969836 27435 raft_consensus.cc:359] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.969969 27435 raft_consensus.cc:385] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:24.970037 27435 raft_consensus.cc:740] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:37:24.970161 27429 tablet_bootstrap.cc:492] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:37:24.970176 27435 consensus_queue.cc:260] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.970254 27429 ts_tablet_manager.cc:1403] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260812 06:37:24.970362 27431 raft_consensus.cc:359] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.970508 27431 raft_consensus.cc:385] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:24.970543 27435 ts_tablet_manager.cc:1434] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:24.970593 27431 raft_consensus.cc:740] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:37:24.970809 27431 consensus_queue.cc:260] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.973301 27431 ts_tablet_manager.cc:1434] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.003s	user 0.001s	sys 0.000s
I20260812 06:37:24.974257 27429 raft_consensus.cc:359] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.974448 27429 raft_consensus.cc:385] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:24.974542 27429 raft_consensus.cc:740] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:37:24.974754 27429 consensus_queue.cc:260] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:24.975150 27429 ts_tablet_manager.cc:1434] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
I20260812 06:37:25.134330 26212 raft_consensus.cc:493] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:25.134461 26212 raft_consensus.cc:515] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:25.134989 26212 leader_election.cc:290] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:25.135387 25814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4a8a192d3c46bc8cfe6664e6d048cb" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851" is_pre_election: true
I20260812 06:37:25.135373 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4a8a192d3c46bc8cfe6664e6d048cb" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" is_pre_election: true
I20260812 06:37:25.135526 25576 raft_consensus.cc:2468] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 0.
I20260812 06:37:25.135526 25814 raft_consensus.cc:2468] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 0.
I20260812 06:37:25.135805 25225 leader_election.cc:304] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:37:25.135977 26212 raft_consensus.cc:2804] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:25.136039 26212 raft_consensus.cc:493] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:25.136076 26212 raft_consensus.cc:3060] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:25.136883 26212 raft_consensus.cc:515] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:25.137204 26212 leader_election.cc:290] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 election: Requested vote from peers 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023), d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2:43541)
I20260812 06:37:25.137524 25814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4a8a192d3c46bc8cfe6664e6d048cb" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851"
I20260812 06:37:25.137542 25576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff4a8a192d3c46bc8cfe6664e6d048cb" candidate_uuid: "4e25f5f8fe0f45af9927988652e84b3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d43d2bb88704495eb5d341bf58c6a1e7"
I20260812 06:37:25.137629 25814 raft_consensus.cc:3060] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:25.137639 25576 raft_consensus.cc:3060] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:25.138425 25576 raft_consensus.cc:2468] T ff4a8a192d3c46bc8cfe6664e6d048cb P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 1.
I20260812 06:37:25.138497 25814 raft_consensus.cc:2468] T ff4a8a192d3c46bc8cfe6664e6d048cb P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e25f5f8fe0f45af9927988652e84b3c in term 1.
I20260812 06:37:25.138688 25225 leader_election.cc:304] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:37:25.138877 26212 raft_consensus.cc:2804] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:25.138967 26212 raft_consensus.cc:697] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [term 1 LEADER]: Becoming Leader. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Running, Role: LEADER
I20260812 06:37:25.139104 26212 consensus_queue.cc:237] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } }
I20260812 06:37:25.140851 27126 catalog_manager.cc:5719] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1). New cstate: current_term: 1 leader_uuid: "4e25f5f8fe0f45af9927988652e84b3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:25.151196 25268 tablet_service.cc:3018] Rejecting scan request for tablet ff4a8a192d3c46bc8cfe6664e6d048cb: Uninitialized: clean time has not yet been initialized
W20260812 06:37:25.352806 25268 tablet_service.cc:3018] Rejecting scan request for tablet ff4a8a192d3c46bc8cfe6664e6d048cb: Uninitialized: clean time has not yet been initialized
I20260812 06:37:25.547871 26212 consensus_queue.cc:1048] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:25.553710 26212 consensus_queue.cc:1048] T ff4a8a192d3c46bc8cfe6664e6d048cb P 4e25f5f8fe0f45af9927988652e84b3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:25.644506 27461 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:25.644649 27461 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:25.645212 27461 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:25.645632 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
W20260812 06:37:25.755170 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.001s	sys 0.001s
I20260812 06:37:25.756098 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:25.756872 27465 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 06:37:25.756907 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:37:25.757866 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6; no voters: a64236e67a9c458d8160cf015bff12ac, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:25.758306 27461 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 06:37:26.317756 27469 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:26.317914 27469 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:26.318543 27469 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:26.319021 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac" is_pre_election: true
I20260812 06:37:26.319199 26612 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ca3e3140b554813be67d29042c31ba6 in term 6.
I20260812 06:37:26.319535 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac; no voters: 
I20260812 06:37:26.319731 27469 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 06:37:26.319808 27469 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6e5df2c51e84400916b9e114c9aca13)
I20260812 06:37:26.319856 27469 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:26.320978 27469 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:26.321344 27469 leader_election.cc:290] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 7 election: Requested vote from peers a64236e67a9c458d8160cf015bff12ac (127.19.182.61:34983), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:26.321715 26612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "a64236e67a9c458d8160cf015bff12ac"
I20260812 06:37:26.321838 26612 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:26.322850 26612 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ca3e3140b554813be67d29042c31ba6 in term 7.
I20260812 06:37:26.323132 26033 leader_election.cc:304] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ca3e3140b554813be67d29042c31ba6, a64236e67a9c458d8160cf015bff12ac; no voters: 
I20260812 06:37:26.323297 27469 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 06:37:26.323437 27469 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 7 LEADER]: Becoming Leader. State: Replica: 1ca3e3140b554813be67d29042c31ba6, State: Running, Role: LEADER
I20260812 06:37:26.323593 27469 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 6.41, Last appended by leader: 41, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:26.324257 27470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 7 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:26.324366 27470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:26.324622 27473 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:26.325517 27473 catalog_manager.cc:679] Loaded metadata for table default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003]
I20260812 06:37:26.325736 27473 catalog_manager.cc:679] Loaded metadata for table default.table_1_2 [id=251e093bedb44656b809fbd14d1f5372]
I20260812 06:37:26.325963 27473 catalog_manager.cc:679] Loaded metadata for table default.table_2_0 [id=388a4316fb224c53b3d2bfdacfc2b9ed]
I20260812 06:37:26.326200 27473 catalog_manager.cc:679] Loaded metadata for table default.table_1 [id=52190151f319499187f516b738595e22]
I20260812 06:37:26.326388 27473 catalog_manager.cc:679] Loaded metadata for table default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe]
I20260812 06:37:26.326565 27473 catalog_manager.cc:679] Loaded metadata for table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59]
I20260812 06:37:26.326747 27473 catalog_manager.cc:679] Loaded metadata for table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c]
I20260812 06:37:26.326915 27473 catalog_manager.cc:679] Loaded metadata for table default.table_2 [id=c2d2820a03084cf4986c250cde83bb1c]
I20260812 06:37:26.327081 27473 catalog_manager.cc:679] Loaded metadata for table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8]
I20260812 06:37:26.327272 27473 catalog_manager.cc:679] Loaded metadata for table default.table_2_1 [id=dab2e9d3d6cf44b1bfbad0904e114949]
I20260812 06:37:26.327445 27473 catalog_manager.cc:679] Loaded metadata for table default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386]
I20260812 06:37:26.328028 27473 tablet_loader.cc:96] loaded metadata for tablet 0e17fd797cb848f2bc9188bca1fb255f (table default.table_0 [id=9d4b4a9286b04f3e883d60746117a53c])
I20260812 06:37:26.328209 27473 tablet_loader.cc:96] loaded metadata for tablet 1697cc6d44874f6fa37896fdf764b482 (table default.table_1 [id=52190151f319499187f516b738595e22])
I20260812 06:37:26.328374 27473 tablet_loader.cc:96] loaded metadata for tablet 42ffa80ba4a649449fff998741215f5d (table default.table_1_1 [id=6868ea092d524c50914eadb5f9cfacfe])
I20260812 06:37:26.328533 27473 tablet_loader.cc:96] loaded metadata for tablet 44efea9a35b548e89e737eb626335cb4 (table default.table_2 [id=c2d2820a03084cf4986c250cde83bb1c])
I20260812 06:37:26.328696 27473 tablet_loader.cc:96] loaded metadata for tablet 87fd933f4c3b43179984c2053e390217 (table default.table_1_0 [id=f4ee997fef244b5ea8bab8c981068386])
I20260812 06:37:26.328866 27473 tablet_loader.cc:96] loaded metadata for tablet a517de0c6d8544f0b357b83e96afbdea (table default.table_0_0 [id=cf414a313e5249ff87d007d4d969f2a8])
I20260812 06:37:26.329023 27473 tablet_loader.cc:96] loaded metadata for tablet a9d2318474494c4eb1d67047152207df (table default.table_2_0 [id=388a4316fb224c53b3d2bfdacfc2b9ed])
I20260812 06:37:26.329185 27473 tablet_loader.cc:96] loaded metadata for tablet d3126e10ad6a4327a05196f6e02f2e55 (table default.table_0_2 [id=15c0fb539c324e2987bdd946b8fe3003])
I20260812 06:37:26.329339 27473 tablet_loader.cc:96] loaded metadata for tablet db0783c62f6d45af9320a0da67f0f7ab (table default.table_0_1 [id=7398d1dd61ba4870a552a96152731b59])
I20260812 06:37:26.329494 27473 tablet_loader.cc:96] loaded metadata for tablet f26bffa545e6482eb8329826cd005b77 (table default.table_1_2 [id=251e093bedb44656b809fbd14d1f5372])
I20260812 06:37:26.329653 27473 tablet_loader.cc:96] loaded metadata for tablet ff4a8a192d3c46bc8cfe6664e6d048cb (table default.table_2_1 [id=dab2e9d3d6cf44b1bfbad0904e114949])
I20260812 06:37:26.329847 27473 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:26.330289 27473 catalog_manager.cc:1295] Loaded cluster ID: 5311ea0e21c4459db9b79ffe4584e110
I20260812 06:37:26.330335 27473 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:26.330894 27473 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:26.331302 27473 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6: Loaded TSK: 0
I20260812 06:37:26.331516 27473 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:26.725298 26612 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Refusing update from remote peer 1ca3e3140b554813be67d29042c31ba6: Log matching property violated. Preceding OpId in replica: term: 6 index: 39. Preceding OpId from leader: term: 7 index: 42. (index mismatch)
I20260812 06:37:26.725726 27470 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 38, Time since last communication: 0.000s
I20260812 06:37:26.727541 27479 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 7 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:26.727730 27479 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:26.728469 27469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:26.728576 27469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:26.728794 27479 sys_catalog.cc:455] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:26.728893 27479 sys_catalog.cc:458] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:27.046911 25413 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
I20260812 06:37:27.056413 25916 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
I20260812 06:37:27.059909 25662 heartbeater.cc:499] Master 127.19.182.62:35785 was elected leader, sending a full tablet report...
W20260812 06:37:27.165935 26035 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.846s (SENT) [suppressed 1 similar messages]
I20260812 06:37:27.228961 27479 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:27.229096 27479 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:27.229602 27479 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:27.229976 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:27.807123 26573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.576s (SENT) [suppressed 1 similar messages]
W20260812 06:37:28.013891 26035 leader_election.cc:336] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.846s (SENT)
W20260812 06:37:28.384856 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.576s (SENT)
I20260812 06:37:28.384951 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:28.385270 27500 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 06:37:28.433163 26035 leader_election.cc:336] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 1.054s (SENT)
I20260812 06:37:29.211171 27502 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:29.211300 27502 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:29.211737 27502 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:29.212098 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:30.315454 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.551s (SENT)
I20260812 06:37:30.315551 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:30.315826 27508 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 06:37:31.159984 27511 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:31.160105 27511 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:31.160537 27511 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:31.161041 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:32.368065 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.602s (SENT)
I20260812 06:37:32.368160 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:32.368453 27520 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 06:37:33.027017 27522 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:33.027179 27522 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:33.027642 27522 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:33.028117 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:33.652448 26573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.623s (SENT) [suppressed 2 similar messages]
W20260812 06:37:34.277503 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.623s (SENT)
I20260812 06:37:34.277595 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:34.277884 27532 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 06:37:35.040794 27535 raft_consensus.cc:493] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1ca3e3140b554813be67d29042c31ba6)
I20260812 06:37:35.040939 27535 raft_consensus.cc:515] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
I20260812 06:37:35.041451 27535 leader_election.cc:290] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1ca3e3140b554813be67d29042c31ba6 (127.19.182.62:35785), c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573)
I20260812 06:37:35.041911 26079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "1ca3e3140b554813be67d29042c31ba6" is_pre_election: true
W20260812 06:37:35.563125 25412 heartbeater.cc:646] Failed to heartbeat to 127.19.182.60:36573 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.60:36573 timed out after 1.000s (SENT)
W20260812 06:37:35.768088 25931 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.182.60:36573)
I20260812 06:37:35.769644 26044 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39840:
name: "default.table_2_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:35.770210 26044 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:35.778442 25303 tablet_service.cc:1511] Processing CreateTablet for tablet 7697daf876504cfe9a27cbc736c20904 (DEFAULT_TABLE table=default.table_2_2 [id=2386225bd4404c7692707e8d20b56ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:35.778630 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 7697daf876504cfe9a27cbc736c20904 (DEFAULT_TABLE table=default.table_2_2 [id=2386225bd4404c7692707e8d20b56ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:35.778765 25303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7697daf876504cfe9a27cbc736c20904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:35.778769 25743 tablet_service.cc:1511] Processing CreateTablet for tablet 7697daf876504cfe9a27cbc736c20904 (DEFAULT_TABLE table=default.table_2_2 [id=2386225bd4404c7692707e8d20b56ae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:35.778904 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7697daf876504cfe9a27cbc736c20904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:35.779053 25743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7697daf876504cfe9a27cbc736c20904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:35.781184 27550 tablet_bootstrap.cc:492] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851: Bootstrap starting.
I20260812 06:37:35.781680 27551 tablet_bootstrap.cc:492] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7: Bootstrap starting.
I20260812 06:37:35.782074 27552 tablet_bootstrap.cc:492] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c: Bootstrap starting.
I20260812 06:37:35.782351 27550 tablet_bootstrap.cc:654] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:35.782739 27551 tablet_bootstrap.cc:654] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:35.783205 27552 tablet_bootstrap.cc:654] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:35.783545 27550 tablet_bootstrap.cc:492] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851: No bootstrap required, opened a new log
I20260812 06:37:35.783638 27550 ts_tablet_manager.cc:1403] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:35.783847 27551 tablet_bootstrap.cc:492] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7: No bootstrap required, opened a new log
I20260812 06:37:35.783941 27551 ts_tablet_manager.cc:1403] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:35.784106 27550 raft_consensus.cc:359] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.784192 27550 raft_consensus.cc:385] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:35.784232 27550 raft_consensus.cc:740] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b051808a9564a54a44175cacdeaa851, State: Initialized, Role: FOLLOWER
I20260812 06:37:35.784317 27552 tablet_bootstrap.cc:492] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c: No bootstrap required, opened a new log
I20260812 06:37:35.784397 27552 ts_tablet_manager.cc:1403] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:35.784361 27550 consensus_queue.cc:260] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.784410 27551 raft_consensus.cc:359] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.784502 27551 raft_consensus.cc:385] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:35.784633 27550 ts_tablet_manager.cc:1434] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:35.784864 27552 raft_consensus.cc:359] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.784970 27552 raft_consensus.cc:385] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:35.785038 27552 raft_consensus.cc:740] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e25f5f8fe0f45af9927988652e84b3c, State: Initialized, Role: FOLLOWER
I20260812 06:37:35.784533 27551 raft_consensus.cc:740] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Initialized, Role: FOLLOWER
I20260812 06:37:35.785205 27552 consensus_queue.cc:260] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.785226 27551 consensus_queue.cc:260] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.785588 27551 ts_tablet_manager.cc:1434] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:35.786759 27552 ts_tablet_manager.cc:1434] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:35.925701 27561 raft_consensus.cc:493] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:35.925817 27561 raft_consensus.cc:515] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.926349 27561 leader_election.cc:290] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:37:35.926695 25337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7697daf876504cfe9a27cbc736c20904" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c" is_pre_election: true
I20260812 06:37:35.926692 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7697daf876504cfe9a27cbc736c20904" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851" is_pre_election: true
I20260812 06:37:35.926838 25337 raft_consensus.cc:2468] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 0.
I20260812 06:37:35.926838 25816 raft_consensus.cc:2468] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 0.
I20260812 06:37:35.927152 25467 leader_election.cc:304] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:37:35.927313 27561 raft_consensus.cc:2804] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:35.927376 27561 raft_consensus.cc:493] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:35.927402 27561 raft_consensus.cc:3060] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:35.928191 27561 raft_consensus.cc:515] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.928485 27561 leader_election.cc:290] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275), 7b051808a9564a54a44175cacdeaa851 (127.19.182.3:37023)
I20260812 06:37:35.928795 25337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7697daf876504cfe9a27cbc736c20904" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e25f5f8fe0f45af9927988652e84b3c"
I20260812 06:37:35.928828 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7697daf876504cfe9a27cbc736c20904" candidate_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b051808a9564a54a44175cacdeaa851"
I20260812 06:37:35.928910 25337 raft_consensus.cc:3060] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:35.928936 25816 raft_consensus.cc:3060] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:35.929697 25337 raft_consensus.cc:2468] T 7697daf876504cfe9a27cbc736c20904 P 4e25f5f8fe0f45af9927988652e84b3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 1.
I20260812 06:37:35.929695 25816 raft_consensus.cc:2468] T 7697daf876504cfe9a27cbc736c20904 P 7b051808a9564a54a44175cacdeaa851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d43d2bb88704495eb5d341bf58c6a1e7 in term 1.
I20260812 06:37:35.929989 25467 leader_election.cc:304] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e25f5f8fe0f45af9927988652e84b3c, d43d2bb88704495eb5d341bf58c6a1e7; no voters: 
I20260812 06:37:35.930154 27561 raft_consensus.cc:2804] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:35.930266 27561 raft_consensus.cc:697] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [term 1 LEADER]: Becoming Leader. State: Replica: d43d2bb88704495eb5d341bf58c6a1e7, State: Running, Role: LEADER
I20260812 06:37:35.930413 27561 consensus_queue.cc:237] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } }
I20260812 06:37:35.932229 26054 catalog_manager.cc:5719] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d43d2bb88704495eb5d341bf58c6a1e7 (127.19.182.2). New cstate: current_term: 1 leader_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d43d2bb88704495eb5d341bf58c6a1e7" member_type: VOTER last_known_addr { host: "127.19.182.2" port: 43541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:35.966693 25505 tablet_service.cc:3018] Rejecting scan request for tablet 7697daf876504cfe9a27cbc736c20904: Uninitialized: clean time has not yet been initialized
W20260812 06:37:36.065666 25912 heartbeater.cc:646] Failed to heartbeat to 127.19.182.60:36573 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.60:36573 timed out after 1.000s (SENT)
W20260812 06:37:36.067800 25661 heartbeater.cc:646] Failed to heartbeat to 127.19.182.60:36573 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.19.182.60:36573 timed out after 1.000s (SENT)
W20260812 06:37:36.168324 25505 tablet_service.cc:3018] Rejecting scan request for tablet 7697daf876504cfe9a27cbc736c20904: Uninitialized: clean time has not yet been initialized
I20260812 06:37:36.429397 27561 consensus_queue.cc:1048] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b051808a9564a54a44175cacdeaa851" member_type: VOTER last_known_addr { host: "127.19.182.3" port: 37023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:36.433629 27561 consensus_queue.cc:1048] T 7697daf876504cfe9a27cbc736c20904 P d43d2bb88704495eb5d341bf58c6a1e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e25f5f8fe0f45af9927988652e84b3c" member_type: VOTER last_known_addr { host: "127.19.182.1" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:37:36.520077 26573 leader_election.cc:336] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c6e5df2c51e84400916b9e114c9aca13 (127.19.182.60:36573): Timed out: RequestConsensusVote RPC to 127.19.182.60:36573 timed out after 0.738s (SENT)
I20260812 06:37:36.520170 26573 leader_election.cc:304] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a64236e67a9c458d8160cf015bff12ac; no voters: 1ca3e3140b554813be67d29042c31ba6, c6e5df2c51e84400916b9e114c9aca13
I20260812 06:37:36.520548 27578 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 06:37:36.570551 20184 scanner-internal.cc:458] Time spent opening tablet: real 0.606s	user 0.002s	sys 0.000s
I20260812 06:37:36.571091 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 25190
I20260812 06:37:36.571456 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.572327 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.572593 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.572860 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.573113 27139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.573339 27137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.573565 27132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.573797 27131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.574060 27129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.577039 27110 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57168:
name: "default.table_2_2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:36.577559 27110 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2_2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 06:37:36.580875 27109 catalog_manager.cc:5552] Ignoring report from unknown tablet 7697daf876504cfe9a27cbc736c20904
I20260812 06:37:36.583113 26079 raft_consensus.cc:1217] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 7 LEADER]: Deduplicated request from leader. Original: 6.41->[6.42-6.42]   Dedup: 6.42->[]
I20260812 06:37:36.583292 26079 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [term 7 LEADER]: Rejecting Update request from peer c6e5df2c51e84400916b9e114c9aca13 for earlier term 6. Current term is 7. Ops: [6.42-6.42]
I20260812 06:37:36.584285 27580 consensus_queue.cc:1059] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 }, Status: INVALID_TERM, Last received: 6.41, Next index: 42, Last known committed idx: 45, Time since last communication: 0.000s
I20260812 06:37:36.584600 27580 consensus_queue.cc:1243] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [LEADER]: Peer 1ca3e3140b554813be67d29042c31ba6 log is divergent from this leader: its last log entry 7.45 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 45
I20260812 06:37:36.584740 27580 raft_consensus.cc:3055] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 6 LEADER]: Stepping down as leader of term 6
I20260812 06:37:36.584839 27580 raft_consensus.cc:740] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6e5df2c51e84400916b9e114c9aca13, State: Running, Role: LEADER
I20260812 06:37:36.585085 27580 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 41, Last appended: 6.42, Last appended by leader: 42, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } }
W20260812 06:37:36.584793 27109 catalog_manager.cc:5552] Ignoring report from unknown tablet 7697daf876504cfe9a27cbc736c20904
I20260812 06:37:36.585268 27137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.585431 27139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13"
I20260812 06:37:36.585494 27580 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:36.585768 27131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13"
I20260812 06:37:36.585989 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a64236e67a9c458d8160cf015bff12ac" candidate_term: 8 candidate_status { last_received { term: 7 index: 42 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.586586 27129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1ca3e3140b554813be67d29042c31ba6" candidate_term: 7 candidate_status { last_received { term: 6 index: 41 } } ignore_live_leader: false dest_uuid: "c6e5df2c51e84400916b9e114c9aca13" is_pre_election: true
I20260812 06:37:36.586997 26612 raft_consensus.cc:1217] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Deduplicated request from leader. Original: 6.39->[6.40-6.41]   Dedup: 6.41->[]
I20260812 06:37:36.587121 26612 raft_consensus.cc:1240] T 00000000000000000000000000000000 P a64236e67a9c458d8160cf015bff12ac [term 7 FOLLOWER]: Rejecting Update request from peer c6e5df2c51e84400916b9e114c9aca13 for earlier term 6. Current term is 7. Ops: [6.40-6.41]
I20260812 06:37:36.588132 27137 raft_consensus.cc:2410] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ca3e3140b554813be67d29042c31ba6 for term 7 because replica has last-logged OpId of term: 6 index: 42, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 41.
I20260812 06:37:36.590085 27132 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [term 7 FOLLOWER]: Refusing update from remote peer 1ca3e3140b554813be67d29042c31ba6: Log matching property violated. Preceding OpId in replica: term: 6 index: 42. Preceding OpId from leader: term: 7 index: 42. (term mismatch)
I20260812 06:37:36.590157 27132 pending_rounds.cc:85] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Aborting all ops after (but not including) 41
I20260812 06:37:36.590241 27132 pending_rounds.cc:107] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13: Aborting uncommitted WRITE_OP operation due to leader change: 6.42
W20260812 06:37:36.590560 27110 catalog_manager.cc:2228] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20260812 06:37:36.591102 27536 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1ca3e3140b554813be67d29042c31ba6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260812 06:37:36.592857 27581 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:36.593007 27581 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:36.593372 27580 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca3e3140b554813be67d29042c31ba6. Latest consensus state: current_term: 7 leader_uuid: "1ca3e3140b554813be67d29042c31ba6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ca3e3140b554813be67d29042c31ba6" member_type: VOTER last_known_addr { host: "127.19.182.62" port: 35785 } } peers { permanent_uuid: "a64236e67a9c458d8160cf015bff12ac" member_type: VOTER last_known_addr { host: "127.19.182.61" port: 34983 } } peers { permanent_uuid: "c6e5df2c51e84400916b9e114c9aca13" member_type: VOTER last_known_addr { host: "127.19.182.60" port: 36573 } } }
I20260812 06:37:36.593518 27580 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e5df2c51e84400916b9e114c9aca13 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:37:36.593550 27582 mvcc.cc:204] Tried to move back new op lower bound from 7317572222701928448 to 7317572183342915584. Current Snapshot: MvccSnapshot[applied={T|T < 7317572222701928448}]
W20260812 06:37:36.600148 25697 connection.cc:573] client connection to 127.19.182.1:46275 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:36.600265 25697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:36.600762 27096 connection.cc:573] server connection from 127.19.182.1:32771 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:37:36.601159 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 25420
W20260812 06:37:36.606902 25697 consensus_peers.cc:597] T f26bffa545e6482eb8329826cd005b77 P 7b051808a9564a54a44175cacdeaa851 -> Peer 4e25f5f8fe0f45af9927988652e84b3c (127.19.182.1:46275): Couldn't send request to peer 4e25f5f8fe0f45af9927988652e84b3c. Status: Network error: Client connection negotiation failed: client connection to 127.19.182.1:46275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:36.617223 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 25669
I20260812 06:37:36.633855 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 26002
I20260812 06:37:36.641706 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 26539
I20260812 06:37:36.652521 20184 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAKyXY_/build/debug/bin/kudu with pid 27062
2026-08-12T06:37:36Z chronyd exiting
[       OK ] HmsConfigurations/MasterFailoverTest.TestMasterPermanentFailure/0 (63361 ms)
[----------] 4 tests from HmsConfigurations/MasterFailoverTest (91118 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (91118 ms total)
[  PASSED  ] 4 tests.
