[==========] Running 14 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 12 tests from RaftConsensusElectionITest
[ RUN      ] RaftConsensusElectionITest.TestNewLeaderCantResolvePeers
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 08:00:38.914613 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:00:38.914745 32702 ts_itest-base.cc:116] --------------
I20260812 08:00:38.914757 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:00:38.914770 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:00:38.914781 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:00:38Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:00:38Z Disabled control of system clock
I20260812 08:00:38.930342 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:37095
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:41907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:37095
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:00:39.043680 32716 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:39.043932 32716 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:39.043973 32716 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:39.047528 32716 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:00:39.047602 32716 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:39.047624 32716 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:00:39.047642 32716 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:00:39.051708 32716 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:37095
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:37095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.32716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:39.053151 32716 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:39.055088 32716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:00:39.064420 32725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:39.067246 32723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:39.067360 32716 server_base.cc:1061] running on GCE node
W20260812 08:00:39.067503 32722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:39.068212 32716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:39.069582 32716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:39.070770 32716 hybrid_clock.cc:648] HybridClock initialized: now 1786521639070736 us; error 91 us; skew 500 ppm
I20260812 08:00:39.073217 32716 webserver.cc:533] Webserver started at http://127.31.239.190:37309/ using document root <none> and password file <none>
I20260812 08:00:39.073951 32716 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:39.074038 32716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:39.074394 32716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:39.076159 32716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/data/instance:
uuid: "bab0338af35a46e5a53a40c00214fa15"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.076704 32716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/wal/instance:
uuid: "bab0338af35a46e5a53a40c00214fa15"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.080798 32716 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:00:39.083446 32732 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.084673 32716 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:00:39.084830 32716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/wal
uuid: "bab0338af35a46e5a53a40c00214fa15"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.084947 32716 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:39.109014 32716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:39.109876 32716 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:39.110193 32716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:39.121748 32716 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:37095
I20260812 08:00:39.121744   326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:37095 every 8 connection(s)
I20260812 08:00:39.123303 32716 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/data/info.pb
I20260812 08:00:39.127421   327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:39.128880 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 32716
I20260812 08:00:39.129159 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/master-0/wal/instance
I20260812 08:00:39.133746   327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15: Bootstrap starting.
I20260812 08:00:39.136624   327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:39.137786   327 log.cc:826] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:39.140300   327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15: No bootstrap required, opened a new log
I20260812 08:00:39.144230   327 raft_consensus.cc:359] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab0338af35a46e5a53a40c00214fa15" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37095 } }
I20260812 08:00:39.144541   327 raft_consensus.cc:385] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:39.144613   327 raft_consensus.cc:740] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab0338af35a46e5a53a40c00214fa15, State: Initialized, Role: FOLLOWER
I20260812 08:00:39.145336   327 consensus_queue.cc:260] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab0338af35a46e5a53a40c00214fa15" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37095 } }
I20260812 08:00:39.145515   327 raft_consensus.cc:399] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:00:39.145653   327 raft_consensus.cc:493] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:00:39.145799   327 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:39.146878   327 raft_consensus.cc:515] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab0338af35a46e5a53a40c00214fa15" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37095 } }
I20260812 08:00:39.147348   327 leader_election.cc:304] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bab0338af35a46e5a53a40c00214fa15; no voters: 
I20260812 08:00:39.147739   327 leader_election.cc:290] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:00:39.147862   332 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:00:39.148065   332 raft_consensus.cc:697] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [term 1 LEADER]: Becoming Leader. State: Replica: bab0338af35a46e5a53a40c00214fa15, State: Running, Role: LEADER
I20260812 08:00:39.148483   332 consensus_queue.cc:237] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab0338af35a46e5a53a40c00214fa15" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37095 } }
I20260812 08:00:39.149343   327 sys_catalog.cc:565] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:00:39.151051   334 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bab0338af35a46e5a53a40c00214fa15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab0338af35a46e5a53a40c00214fa15" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37095 } } }
I20260812 08:00:39.151196   334 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [sys.catalog]: This master's current role is: LEADER
I20260812 08:00:39.151710   343 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:00:39.152235   335 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab0338af35a46e5a53a40c00214fa15. Latest consensus state: current_term: 1 leader_uuid: "bab0338af35a46e5a53a40c00214fa15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab0338af35a46e5a53a40c00214fa15" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37095 } } }
I20260812 08:00:39.152340   335 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15 [sys.catalog]: This master's current role is: LEADER
I20260812 08:00:39.155124   343 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:00:39.161455   343 catalog_manager.cc:1383] Generated new cluster ID: 964be63c98b549f391d321010ec77c7a
I20260812 08:00:39.161545   343 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:00:39.173236   343 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:00:39.174279   343 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:00:39.179674   343 catalog_manager.cc:6092] T 00000000000000000000000000000000 P bab0338af35a46e5a53a40c00214fa15: Generated new TSK 0
I20260812 08:00:39.180480   343 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:00:39.190691 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37095
--builtin_ntp_servers=127.31.239.148:41907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--dns_resolver_cache_capacity_mb=0
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=3
--leader_failure_max_missed_heartbeat_periods=10
--leader_failure_exp_backoff_max_delta_ms=5000 with env {}
W20260812 08:00:39.300284   354 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:00:39.300545   354 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:39.300567   354 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:39.300654   354 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:39.304302   354 flags.cc:432] Enabled experimental flag: --leader_failure_exp_backoff_max_delta_ms=5000
W20260812 08:00:39.304389   354 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:39.304503   354 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:00:39.308751   354 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--leader_failure_exp_backoff_max_delta_ms=5000
--leader_failure_max_missed_heartbeat_periods=10
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37095
--never_fsync=true
--heap_profile_path=/tmp/kudu.354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--dns_resolver_cache_capacity_mb=0
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:39.309990   354 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:39.311224   354 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:00:39.314038   354 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 08:00:39.318326   360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:39.318348   365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:39.318322   362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:39.318627   354 server_base.cc:1061] running on GCE node
I20260812 08:00:39.319108   354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:39.319715   354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:39.320930   354 hybrid_clock.cc:648] HybridClock initialized: now 1786521639320913 us; error 35 us; skew 500 ppm
I20260812 08:00:39.322958   354 webserver.cc:533] Webserver started at http://127.31.239.129:33221/ using document root <none> and password file <none>
I20260812 08:00:39.323596   354 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:39.323683   354 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:39.323920   354 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:39.325534   354 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/data/instance:
uuid: "c1a687f3fb454a9f9cc428bf19152316"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.326061   354 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/wal/instance:
uuid: "c1a687f3fb454a9f9cc428bf19152316"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.329912   354 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:00:39.332319   374 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.333393   354 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:00:39.333525   354 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/wal
uuid: "c1a687f3fb454a9f9cc428bf19152316"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.333632   354 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:39.350871   354 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:39.351624   354 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:39.351843   354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:39.352466   354 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:39.353664   354 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:39.353745   354 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.353826   354 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:39.353864   354 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.365353   354 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:40943
I20260812 08:00:39.365379   512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:40943 every 8 connection(s)
I20260812 08:00:39.366494   354 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/data/info.pb
I20260812 08:00:39.367792 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 354
I20260812 08:00:39.367911 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-0/wal/instance
I20260812 08:00:39.370751 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37095
--builtin_ntp_servers=127.31.239.148:41907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--dns_resolver_cache_capacity_mb=0
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=3
--leader_failure_max_missed_heartbeat_periods=10
--leader_failure_exp_backoff_max_delta_ms=5000 with env {}
I20260812 08:00:39.377933   514 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37095
I20260812 08:00:39.378309   514 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:39.378922   514 heartbeater.cc:507] Master 127.31.239.190:37095 requested a full tablet report, sending...
I20260812 08:00:39.381043 32750 ts_manager.cc:194] Registered new tserver with Master: c1a687f3fb454a9f9cc428bf19152316 (127.31.239.129:40943)
I20260812 08:00:39.383275 32750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:44063
W20260812 08:00:39.512323   519 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:00:39.512849   519 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:39.512915   519 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:39.513021   519 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:39.518698   519 flags.cc:432] Enabled experimental flag: --leader_failure_exp_backoff_max_delta_ms=5000
W20260812 08:00:39.518834   519 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:39.518949   519 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:00:39.525206   519 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--leader_failure_exp_backoff_max_delta_ms=5000
--leader_failure_max_missed_heartbeat_periods=10
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37095
--never_fsync=true
--heap_profile_path=/tmp/kudu.519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--dns_resolver_cache_capacity_mb=0
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:39.527211   519 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:39.529130   519 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:00:39.534150   519 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 08:00:39.540123   526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:39.540372   525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:39.540728   528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:39.541020   519 server_base.cc:1061] running on GCE node
I20260812 08:00:39.541715   519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:39.542701   519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:39.543885   519 hybrid_clock.cc:648] HybridClock initialized: now 1786521639543854 us; error 50 us; skew 500 ppm
I20260812 08:00:39.545812   519 webserver.cc:533] Webserver started at http://127.31.239.130:46195/ using document root <none> and password file <none>
I20260812 08:00:39.546582   519 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:39.546696   519 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:39.546908   519 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:39.548532   519 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/data/instance:
uuid: "340a9e5f3e3e4d589e1f549ceec37ba1"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.549110   519 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/wal/instance:
uuid: "340a9e5f3e3e4d589e1f549ceec37ba1"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.552958   519 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260812 08:00:39.555294   534 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.556454   519 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:00:39.556598   519 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/wal
uuid: "340a9e5f3e3e4d589e1f549ceec37ba1"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.556728   519 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:39.575676   519 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:39.576552   519 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:39.576774   519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:39.577464   519 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:39.578681   519 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:39.578750   519 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.578819   519 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:39.578866   519 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.590497   519 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:40369
I20260812 08:00:39.590600   664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:40369 every 8 connection(s)
I20260812 08:00:39.591552   519 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/data/info.pb
I20260812 08:00:39.600500   665 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37095
I20260812 08:00:39.600813   665 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:39.600976 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 519
I20260812 08:00:39.601097 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/wal/instance
I20260812 08:00:39.601408   665 heartbeater.cc:507] Master 127.31.239.190:37095 requested a full tablet report, sending...
I20260812 08:00:39.602584 32748 ts_manager.cc:194] Registered new tserver with Master: 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369)
I20260812 08:00:39.603189 32748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:36515
I20260812 08:00:39.603514 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37095
--builtin_ntp_servers=127.31.239.148:41907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--dns_resolver_cache_capacity_mb=0
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=3
--leader_failure_max_missed_heartbeat_periods=10
--leader_failure_exp_backoff_max_delta_ms=5000 with env {}
W20260812 08:00:39.714366   668 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:00:39.714608   668 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:39.714632   668 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:39.714675   668 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:39.718284   668 flags.cc:432] Enabled experimental flag: --leader_failure_exp_backoff_max_delta_ms=5000
W20260812 08:00:39.718362   668 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:39.718437   668 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:00:39.722506   668 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--leader_failure_exp_backoff_max_delta_ms=5000
--leader_failure_max_missed_heartbeat_periods=10
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37095
--never_fsync=true
--heap_profile_path=/tmp/kudu.668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--dns_resolver_cache_capacity_mb=0
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:39.723668   668 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:39.724783   668 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:00:39.727420   668 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 08:00:39.730952   673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:39.730958   675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:39.730962   677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:39.731344   668 server_base.cc:1061] running on GCE node
I20260812 08:00:39.731714   668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:39.732263   668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:39.733426   668 hybrid_clock.cc:648] HybridClock initialized: now 1786521639733395 us; error 47 us; skew 500 ppm
I20260812 08:00:39.735318   668 webserver.cc:533] Webserver started at http://127.31.239.131:44517/ using document root <none> and password file <none>
I20260812 08:00:39.735888   668 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:39.735944   668 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:39.736177   668 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:39.737913   668 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/data/instance:
uuid: "e5df7d5022e74b4f89fd86ed4c822d85"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.738596   668 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/wal/instance:
uuid: "e5df7d5022e74b4f89fd86ed4c822d85"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.742121   668 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:00:39.744632   685 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.745793   668 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:00:39.745898   668 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/wal
uuid: "e5df7d5022e74b4f89fd86ed4c822d85"
format_stamp: "Formatted at 2026-08-12 08:00:39 on dist-test-slave-9jjr"
I20260812 08:00:39.746037   668 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:39.774431   668 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:39.775107   668 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:39.775262   668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:39.775803   668 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:39.776793   668 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:39.776842   668 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.776885   668 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:39.776899   668 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:39.789634   668 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:45251
I20260812 08:00:39.789722   812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:45251 every 8 connection(s)
I20260812 08:00:39.790752   668 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/data/info.pb
I20260812 08:00:39.791435 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 668
I20260812 08:00:39.791554 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-2/wal/instance
I20260812 08:00:39.800086   813 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37095
I20260812 08:00:39.800442   813 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:39.801035   813 heartbeater.cc:507] Master 127.31.239.190:37095 requested a full tablet report, sending...
I20260812 08:00:39.802294 32748 ts_manager.cc:194] Registered new tserver with Master: e5df7d5022e74b4f89fd86ed4c822d85 (127.31.239.131:45251)
I20260812 08:00:39.802845 32748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:51545
I20260812 08:00:39.806934 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:00:39.825138 32748 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55766:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:00:39.826467 32748 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:00:39.844570   590 tablet_service.cc:1511] Processing CreateTablet for tablet 27034a31a6ef476bb3c3b88a2e89c8fc (DEFAULT_TABLE table=test-workload [id=dabc5e5fad4c47c880a0eab216882510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:39.844627   432 tablet_service.cc:1511] Processing CreateTablet for tablet 27034a31a6ef476bb3c3b88a2e89c8fc (DEFAULT_TABLE table=test-workload [id=dabc5e5fad4c47c880a0eab216882510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:39.844619   737 tablet_service.cc:1511] Processing CreateTablet for tablet 27034a31a6ef476bb3c3b88a2e89c8fc (DEFAULT_TABLE table=test-workload [id=dabc5e5fad4c47c880a0eab216882510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:39.845564   590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27034a31a6ef476bb3c3b88a2e89c8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:39.846500   737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27034a31a6ef476bb3c3b88a2e89c8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:39.847023   432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27034a31a6ef476bb3c3b88a2e89c8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:39.851263   834 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: Bootstrap starting.
I20260812 08:00:39.853070   836 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: Bootstrap starting.
I20260812 08:00:39.854564   835 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85: Bootstrap starting.
I20260812 08:00:39.854991   834 tablet_bootstrap.cc:654] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:39.855463   836 tablet_bootstrap.cc:654] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:39.856001   834 log.cc:826] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:39.856297   836 log.cc:826] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:39.856704   835 tablet_bootstrap.cc:654] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:39.857661   835 log.cc:826] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:39.858233   836 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: No bootstrap required, opened a new log
I20260812 08:00:39.858256   834 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: No bootstrap required, opened a new log
I20260812 08:00:39.858453   834 ts_tablet_manager.cc:1403] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: Time spent bootstrapping tablet: real 0.007s	user 0.006s	sys 0.000s
I20260812 08:00:39.858453   836 ts_tablet_manager.cc:1403] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:00:39.859964   835 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85: No bootstrap required, opened a new log
I20260812 08:00:39.860191   835 ts_tablet_manager.cc:1403] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:00:39.861310   834 raft_consensus.cc:359] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:39.861562   834 raft_consensus.cc:740] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a9e5f3e3e4d589e1f549ceec37ba1, State: Initialized, Role: FOLLOWER
I20260812 08:00:39.861763   836 raft_consensus.cc:359] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:39.861970   836 raft_consensus.cc:740] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1a687f3fb454a9f9cc428bf19152316, State: Initialized, Role: FOLLOWER
I20260812 08:00:39.862349   836 consensus_queue.cc:260] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:39.862534   834 consensus_queue.cc:260] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:39.863384   665 heartbeater.cc:499] Master 127.31.239.190:37095 was elected leader, sending a full tablet report...
I20260812 08:00:39.863391   836 ts_tablet_manager.cc:1434] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:00:39.863621   835 raft_consensus.cc:359] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:39.863762   514 heartbeater.cc:499] Master 127.31.239.190:37095 was elected leader, sending a full tablet report...
I20260812 08:00:39.863816   835 raft_consensus.cc:740] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5df7d5022e74b4f89fd86ed4c822d85, State: Initialized, Role: FOLLOWER
I20260812 08:00:39.863813   834 ts_tablet_manager.cc:1434] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:00:39.864104   835 consensus_queue.cc:260] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:39.865144   835 ts_tablet_manager.cc:1434] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:00:39.865190   813 heartbeater.cc:499] Master 127.31.239.190:37095 was elected leader, sending a full tablet report...
W20260812 08:00:39.867794   515 tablet.cc:2406] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:00:39.898445   659 generic_service.cc:139] {username='slave'} at 127.0.0.1:33844 forcing change of non-runtime-safe flag fail_dns_resolution_hostports
I20260812 08:00:39.898567   659 generic_service.cc:175] {username='slave'} at 127.0.0.1:33844 changed flags via RPC: fail_dns_resolution_hostports from '' to '127.31.239.130:40369'
W20260812 08:00:39.899783   659 generic_service.cc:139] {username='slave'} at 127.0.0.1:33844 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:39.899860   659 generic_service.cc:175] {username='slave'} at 127.0.0.1:33844 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
W20260812 08:00:39.904096   807 generic_service.cc:139] {username='slave'} at 127.0.0.1:54764 forcing change of non-runtime-safe flag fail_dns_resolution_hostports
I20260812 08:00:39.904219   807 generic_service.cc:175] {username='slave'} at 127.0.0.1:54764 changed flags via RPC: fail_dns_resolution_hostports from '' to '127.31.239.130:40369'
W20260812 08:00:39.905092   807 generic_service.cc:139] {username='slave'} at 127.0.0.1:54764 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:39.905155   807 generic_service.cc:175] {username='slave'} at 127.0.0.1:54764 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
W20260812 08:00:39.909586   505 generic_service.cc:139] {username='slave'} at 127.0.0.1:41334 forcing change of non-runtime-safe flag fail_dns_resolution_hostports
I20260812 08:00:39.909706   505 generic_service.cc:175] {username='slave'} at 127.0.0.1:41334 changed flags via RPC: fail_dns_resolution_hostports from '' to '127.31.239.130:40369'
W20260812 08:00:39.910880   505 generic_service.cc:139] {username='slave'} at 127.0.0.1:41334 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:39.910949   505 generic_service.cc:175] {username='slave'} at 127.0.0.1:41334 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
I20260812 08:00:39.912053   760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27034a31a6ef476bb3c3b88a2e89c8fc"
dest_uuid: "e5df7d5022e74b4f89fd86ed4c822d85"
 from {username='slave'} at 127.0.0.1:54756
I20260812 08:00:39.912371   760 raft_consensus.cc:493] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:00:39.912485   760 raft_consensus.cc:3060] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:39.913470   760 raft_consensus.cc:515] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:39.914835   760 leader_election.cc:290] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [CANDIDATE]: Term 1 election: Requested vote from peers 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369), c1a687f3fb454a9f9cc428bf19152316 (127.31.239.129:40943)
W20260812 08:00:39.915136   846 leader_election.cc:336] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369
I20260812 08:00:39.918963   458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27034a31a6ef476bb3c3b88a2e89c8fc" candidate_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c1a687f3fb454a9f9cc428bf19152316"
I20260812 08:00:39.919281   458 raft_consensus.cc:3060] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:39.920838   458 raft_consensus.cc:2468] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5df7d5022e74b4f89fd86ed4c822d85 in term 1.
I20260812 08:00:39.921277   686 leader_election.cc:304] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1a687f3fb454a9f9cc428bf19152316, e5df7d5022e74b4f89fd86ed4c822d85; no voters: 340a9e5f3e3e4d589e1f549ceec37ba1
I20260812 08:00:39.921555   842 raft_consensus.cc:2804] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:00:39.921897   842 raft_consensus.cc:697] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 1 LEADER]: Becoming Leader. State: Replica: e5df7d5022e74b4f89fd86ed4c822d85, State: Running, Role: LEADER
I20260812 08:00:39.922317   842 consensus_queue.cc:237] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:39.926522 32750 catalog_manager.cc:5719] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5df7d5022e74b4f89fd86ed4c822d85 (127.31.239.131). New cstate: current_term: 1 leader_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } health_report { overall_health: HEALTHY } } }
W20260812 08:00:40.035811   846 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 1: this message will repeat every 5th retry.
W20260812 08:00:40.041833   814 tablet.cc:2406] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:00:40.047223   842 consensus_queue.cc:1048] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:00:40.092705   666 tablet.cc:2406] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:00:40.494222   846 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 6: this message will repeat every 5th retry.
W20260812 08:00:40.954237   846 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 11: this message will repeat every 5th retry.
W20260812 08:00:41.495687   846 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 16: this message will repeat every 5th retry.
W20260812 08:00:42.004789   846 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 21: this message will repeat every 5th retry.
W20260812 08:00:42.506657   846 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 26: this message will repeat every 5th retry.
I20260812 08:00:42.934096   842 consensus_queue.cc:579] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [LEADER]: Leader has been unable to successfully communicate with peer 340a9e5f3e3e4d589e1f549ceec37ba1 for more than 3 seconds (3.011s)
W20260812 08:00:42.936935 32750 catalog_manager.cc:5397] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 27034a31a6ef476bb3c3b88a2e89c8fc with cas_config_opid_index -1: no extra replica candidate found for tablet 27034a31a6ef476bb3c3b88a2e89c8fc (table test-workload [id=dabc5e5fad4c47c880a0eab216882510]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
W20260812 08:00:42.997586   659 generic_service.cc:139] {username='slave'} at 127.0.0.1:33844 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:42.997694   659 generic_service.cc:175] {username='slave'} at 127.0.0.1:33844 changed flags via RPC: fail_dns_resolution from 'true' to 'false'
W20260812 08:00:42.998804   807 generic_service.cc:139] {username='slave'} at 127.0.0.1:54764 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:42.998885   807 generic_service.cc:175] {username='slave'} at 127.0.0.1:54764 changed flags via RPC: fail_dns_resolution from 'true' to 'false'
W20260812 08:00:42.999780   505 generic_service.cc:139] {username='slave'} at 127.0.0.1:41334 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:42.999855   505 generic_service.cc:175] {username='slave'} at 127.0.0.1:41334 changed flags via RPC: fail_dns_resolution from 'true' to 'false'
I20260812 08:00:43.029352   616 raft_consensus.cc:3060] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:43.166368 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.132:0
--local_ip_for_outbound_sockets=127.31.239.132
--webserver_interface=127.31.239.132
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37095
--builtin_ntp_servers=127.31.239.148:41907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--dns_resolver_cache_capacity_mb=0
--enable_leader_failure_detection=false
--raft_heartbeat_interval_ms=100
--follower_unavailable_considered_failed_sec=3
--leader_failure_max_missed_heartbeat_periods=10
--leader_failure_exp_backoff_max_delta_ms=5000 with env {}
W20260812 08:00:43.279917   859 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:00:43.280206   859 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:43.280231   859 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:43.280318   859 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:43.284056   859 flags.cc:432] Enabled experimental flag: --leader_failure_exp_backoff_max_delta_ms=5000
W20260812 08:00:43.284143   859 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:43.284291   859 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.132
I20260812 08:00:43.288535   859 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--enable_leader_failure_detection=false
--leader_failure_exp_backoff_max_delta_ms=5000
--leader_failure_max_missed_heartbeat_periods=10
--raft_heartbeat_interval_ms=100
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.31.239.132
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37095
--never_fsync=true
--heap_profile_path=/tmp/kudu.859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--dns_resolver_cache_capacity_mb=0
--local_ip_for_outbound_sockets=127.31.239.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:43.290035   859 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:43.291409   859 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:00:43.294239   859 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 08:00:43.298225   870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:43.298352   867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:43.298688   866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:43.298698   859 server_base.cc:1061] running on GCE node
I20260812 08:00:43.299124   859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:43.299752   859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:43.300937   859 hybrid_clock.cc:648] HybridClock initialized: now 1786521643300919 us; error 40 us; skew 500 ppm
I20260812 08:00:43.303117   859 webserver.cc:533] Webserver started at http://127.31.239.132:33237/ using document root <none> and password file <none>
I20260812 08:00:43.303766   859 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:43.303850   859 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:43.304095   859 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:43.305862   859 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/data/instance:
uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a"
format_stamp: "Formatted at 2026-08-12 08:00:43 on dist-test-slave-9jjr"
I20260812 08:00:43.306399   859 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/wal/instance:
uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a"
format_stamp: "Formatted at 2026-08-12 08:00:43 on dist-test-slave-9jjr"
I20260812 08:00:43.310250   859 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:00:43.312806   877 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:43.313966   859 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:00:43.314170   859 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/wal
uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a"
format_stamp: "Formatted at 2026-08-12 08:00:43 on dist-test-slave-9jjr"
I20260812 08:00:43.314298   859 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:43.332408   859 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:43.333154   859 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:43.333357   859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:43.333987   859 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:43.335151   859 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:43.335227   859 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:43.335296   859 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:43.335336   859 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:43.348759   859 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.132:35503
I20260812 08:00:43.348781  1016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.132:35503 every 8 connection(s)
I20260812 08:00:43.349875   859 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/data/info.pb
I20260812 08:00:43.354329 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 859
I20260812 08:00:43.354458 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-3/wal/instance
I20260812 08:00:43.366797  1017 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37095
I20260812 08:00:43.367125  1017 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:43.367823  1017 heartbeater.cc:507] Master 127.31.239.190:37095 requested a full tablet report, sending...
I20260812 08:00:43.369019 32750 ts_manager.cc:194] Registered new tserver with Master: 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132:35503)
I20260812 08:00:43.369613 32750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.132:38139
W20260812 08:00:43.408486   659 generic_service.cc:139] {username='slave'} at 127.0.0.1:33844 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:43.408599   659 generic_service.cc:175] {username='slave'} at 127.0.0.1:33844 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
W20260812 08:00:43.409586   807 generic_service.cc:139] {username='slave'} at 127.0.0.1:54764 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:43.409667   807 generic_service.cc:175] {username='slave'} at 127.0.0.1:54764 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
W20260812 08:00:43.410800   505 generic_service.cc:139] {username='slave'} at 127.0.0.1:41334 forcing change of non-runtime-safe flag fail_dns_resolution
I20260812 08:00:43.410879   505 generic_service.cc:175] {username='slave'} at 127.0.0.1:41334 changed flags via RPC: fail_dns_resolution from 'false' to 'true'
I20260812 08:00:43.411803   760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27034a31a6ef476bb3c3b88a2e89c8fc"
dest_uuid: "e5df7d5022e74b4f89fd86ed4c822d85"
mode: GRACEFUL
new_leader_uuid: "c1a687f3fb454a9f9cc428bf19152316"
 from {username='slave'} at 127.0.0.1:54756
I20260812 08:00:43.411984   760 raft_consensus.cc:606] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 1 LEADER]: Received request to transfer leadership to TS c1a687f3fb454a9f9cc428bf19152316
I20260812 08:00:43.453215   852 raft_consensus.cc:993] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85: : Instructing follower c1a687f3fb454a9f9cc428bf19152316 to start an election
I20260812 08:00:43.453361   852 raft_consensus.cc:1081] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 1 LEADER]: Signalling peer c1a687f3fb454a9f9cc428bf19152316 to start an election
I20260812 08:00:43.454108   458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27034a31a6ef476bb3c3b88a2e89c8fc"
dest_uuid: "c1a687f3fb454a9f9cc428bf19152316"
 from {username='slave'} at 127.31.239.131:46967
I20260812 08:00:43.454394   458 raft_consensus.cc:493] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:00:43.454474   458 raft_consensus.cc:3060] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:00:43.455583   458 raft_consensus.cc:515] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:43.456763   458 leader_election.cc:290] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [CANDIDATE]: Term 2 election: Requested vote from peers 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369), e5df7d5022e74b4f89fd86ed4c822d85 (127.31.239.131:45251)
W20260812 08:00:43.457111  1021 leader_election.cc:336] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369
I20260812 08:00:43.461026   760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27034a31a6ef476bb3c3b88a2e89c8fc" candidate_uuid: "c1a687f3fb454a9f9cc428bf19152316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e5df7d5022e74b4f89fd86ed4c822d85"
I20260812 08:00:43.461287   760 raft_consensus.cc:3055] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:00:43.461355   760 raft_consensus.cc:740] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e5df7d5022e74b4f89fd86ed4c822d85, State: Running, Role: LEADER
I20260812 08:00:43.461539   760 consensus_queue.cc:260] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:43.461860   760 raft_consensus.cc:3060] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:00:43.462877   760 raft_consensus.cc:2468] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1a687f3fb454a9f9cc428bf19152316 in term 2.
I20260812 08:00:43.463608   381 leader_election.cc:304] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c1a687f3fb454a9f9cc428bf19152316, e5df7d5022e74b4f89fd86ed4c822d85; no voters: 340a9e5f3e3e4d589e1f549ceec37ba1
I20260812 08:00:43.464094  1024 raft_consensus.cc:2804] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:00:43.464473  1024 raft_consensus.cc:697] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 2 LEADER]: Becoming Leader. State: Replica: c1a687f3fb454a9f9cc428bf19152316, State: Running, Role: LEADER
I20260812 08:00:43.464872  1024 consensus_queue.cc:237] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } }
I20260812 08:00:43.468226 32750 catalog_manager.cc:5719] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 reported cstate change: term changed from 1 to 2, leader changed from e5df7d5022e74b4f89fd86ed4c822d85 (127.31.239.131) to c1a687f3fb454a9f9cc428bf19152316 (127.31.239.129). New cstate: current_term: 2 leader_uuid: "c1a687f3fb454a9f9cc428bf19152316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } health_report { overall_health: UNKNOWN } } }
I20260812 08:00:43.576063   760 raft_consensus.cc:1275] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 2 FOLLOWER]: Refusing update from remote peer c1a687f3fb454a9f9cc428bf19152316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 08:00:43.576771  1024 consensus_queue.cc:1048] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260812 08:00:43.580566  1021 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:00:43.603914   458 consensus_queue.cc:237] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: NON_VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: true } }
W20260812 08:00:43.605558  1021 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:00:43.606130   760 raft_consensus.cc:1275] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 2 FOLLOWER]: Refusing update from remote peer c1a687f3fb454a9f9cc428bf19152316: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 08:00:43.606808  1026 consensus_queue.cc:1048] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:00:43.609077  1038 raft_consensus.cc:2955] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: NON_VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: true } } }
I20260812 08:00:43.609588   760 raft_consensus.cc:2955] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: NON_VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: true } } }
W20260812 08:00:43.610809   380 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 -> Peer 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132:35503): Couldn't send request to peer 8e0fe86d7ba5485c963d0ef9c6de0b4a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27034a31a6ef476bb3c3b88a2e89c8fc. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:00:43.611769 32733 catalog_manager.cc:5232] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 27034a31a6ef476bb3c3b88a2e89c8fc with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 6)
I20260812 08:00:43.613691 32748 catalog_manager.cc:5719] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 reported cstate change: config changed from index -1 to 3, NON_VOTER 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132) added. New cstate: current_term: 2 leader_uuid: "c1a687f3fb454a9f9cc428bf19152316" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: NON_VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260812 08:00:43.698966  1042 ts_tablet_manager.cc:933] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: Initiating tablet copy from peer c1a687f3fb454a9f9cc428bf19152316 (127.31.239.129:40943)
I20260812 08:00:43.699800  1042 tablet_copy_client.cc:323] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: tablet copy: Beginning tablet copy session from remote peer at address 127.31.239.129:40943
I20260812 08:00:43.704084   482 tablet_copy_service.cc:140] P c1a687f3fb454a9f9cc428bf19152316: Received BeginTabletCopySession request for tablet 27034a31a6ef476bb3c3b88a2e89c8fc from peer 8e0fe86d7ba5485c963d0ef9c6de0b4a ({username='slave'} at 127.31.239.132:48703)
I20260812 08:00:43.704303   482 tablet_copy_service.cc:161] P c1a687f3fb454a9f9cc428bf19152316: Beginning new tablet copy session on tablet 27034a31a6ef476bb3c3b88a2e89c8fc from peer 8e0fe86d7ba5485c963d0ef9c6de0b4a at {username='slave'} at 127.31.239.132:48703: session id = 8e0fe86d7ba5485c963d0ef9c6de0b4a-27034a31a6ef476bb3c3b88a2e89c8fc
I20260812 08:00:43.705659   482 tablet_copy_source_session.cc:215] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 08:00:43.709343  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27034a31a6ef476bb3c3b88a2e89c8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:43.714488  1042 tablet_copy_client.cc:806] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: tablet copy: Starting download of 0 data blocks...
I20260812 08:00:43.714735  1042 tablet_copy_client.cc:670] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: tablet copy: Starting download of 1 WAL segments...
I20260812 08:00:43.716969  1042 tablet_copy_client.cc:538] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:00:43.719101  1042 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: Bootstrap starting.
I20260812 08:00:43.724529  1042 log.cc:826] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:43.727967  1042 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:00:43.728322  1042 tablet_bootstrap.cc:492] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: Bootstrap complete.
I20260812 08:00:43.728649  1042 ts_tablet_manager.cc:1403] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260812 08:00:43.731325  1042 raft_consensus.cc:359] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: NON_VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: true } }
I20260812 08:00:43.731580  1042 raft_consensus.cc:740] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8e0fe86d7ba5485c963d0ef9c6de0b4a, State: Initialized, Role: LEARNER
I20260812 08:00:43.731909  1042 consensus_queue.cc:260] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: NON_VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: true } }
I20260812 08:00:43.732822  1042 ts_tablet_manager.cc:1434] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:00:43.732838  1017 heartbeater.cc:499] Master 127.31.239.190:37095 was elected leader, sending a full tablet report...
I20260812 08:00:43.733953   482 tablet_copy_service.cc:342] P c1a687f3fb454a9f9cc428bf19152316: Request end of tablet copy session 8e0fe86d7ba5485c963d0ef9c6de0b4a-27034a31a6ef476bb3c3b88a2e89c8fc received from {username='slave'} at 127.31.239.132:48703
I20260812 08:00:43.734071   482 tablet_copy_service.cc:434] P c1a687f3fb454a9f9cc428bf19152316: ending tablet copy session 8e0fe86d7ba5485c963d0ef9c6de0b4a-27034a31a6ef476bb3c3b88a2e89c8fc on tablet 27034a31a6ef476bb3c3b88a2e89c8fc with peer 8e0fe86d7ba5485c963d0ef9c6de0b4a
I20260812 08:00:43.822099   966 raft_consensus.cc:1217] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260812 08:00:43.932389  1026 raft_consensus.cc:1064] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316: attempting to promote NON_VOTER 8e0fe86d7ba5485c963d0ef9c6de0b4a to VOTER
I20260812 08:00:43.932963  1026 consensus_queue.cc:237] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } }
W20260812 08:00:43.934396  1021 consensus_peers.cc:597] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 -> Peer 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): Couldn't send request to peer 340a9e5f3e3e4d589e1f549ceec37ba1. Status: Network error: failed to refresh physical address: injected DNS resolution failure: 127.31.239.130:40369. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:00:43.934775   760 raft_consensus.cc:1275] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 2 FOLLOWER]: Refusing update from remote peer c1a687f3fb454a9f9cc428bf19152316: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 08:00:43.934835   966 raft_consensus.cc:1275] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a [term 2 LEARNER]: Refusing update from remote peer c1a687f3fb454a9f9cc428bf19152316: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 08:00:43.935277  1040 consensus_queue.cc:1048] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:00:43.935437  1026 consensus_queue.cc:1048] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:00:43.938748  1026 raft_consensus.cc:2955] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } } }
I20260812 08:00:43.939376   966 raft_consensus.cc:2955] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } } }
I20260812 08:00:43.941433   760 raft_consensus.cc:2955] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } } }
I20260812 08:00:43.943015 32750 catalog_manager.cc:5719] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a reported cstate change: config changed from index 3 to 4, 8e0fe86d7ba5485c963d0ef9c6de0b4a (127.31.239.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c1a687f3fb454a9f9cc428bf19152316" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "340a9e5f3e3e4d589e1f549ceec37ba1" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 40369 } } peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } } }
I20260812 08:00:43.947763   458 consensus_queue.cc:237] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } }
I20260812 08:00:43.949611   966 raft_consensus.cc:1275] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a [term 2 FOLLOWER]: Refusing update from remote peer c1a687f3fb454a9f9cc428bf19152316: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 08:00:43.949612   760 raft_consensus.cc:1275] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 2 FOLLOWER]: Refusing update from remote peer c1a687f3fb454a9f9cc428bf19152316: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 08:00:43.950064  1040 consensus_queue.cc:1048] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:00:43.951233  1040 consensus_queue.cc:1048] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:00:43.951992  1026 raft_consensus.cc:2955] T 27034a31a6ef476bb3c3b88a2e89c8fc P c1a687f3fb454a9f9cc428bf19152316 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } } }
I20260812 08:00:43.953792   966 raft_consensus.cc:2955] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } } }
I20260812 08:00:43.954172   760 raft_consensus.cc:2955] T 27034a31a6ef476bb3c3b88a2e89c8fc P e5df7d5022e74b4f89fd86ed4c822d85 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } } }
I20260812 08:00:43.957033 32748 catalog_manager.cc:5719] T 27034a31a6ef476bb3c3b88a2e89c8fc P 8e0fe86d7ba5485c963d0ef9c6de0b4a reported cstate change: config changed from index 4 to 5, VOTER 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130) evicted. New cstate: current_term: 2 leader_uuid: "c1a687f3fb454a9f9cc428bf19152316" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c1a687f3fb454a9f9cc428bf19152316" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 40943 } } peers { permanent_uuid: "e5df7d5022e74b4f89fd86ed4c822d85" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45251 } } peers { permanent_uuid: "8e0fe86d7ba5485c963d0ef9c6de0b4a" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 35503 } attrs { promote: false } } }
I20260812 08:00:43.957736 32733 catalog_manager.cc:5232] ChangeConfig:REMOVE_PEER RPC for tablet 27034a31a6ef476bb3c3b88a2e89c8fc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260812 08:00:43.960835   590 tablet_service.cc:1558] Processing DeleteTablet for tablet 27034a31a6ef476bb3c3b88a2e89c8fc with delete_type TABLET_DATA_TOMBSTONED (TS 340a9e5f3e3e4d589e1f549ceec37ba1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33828
I20260812 08:00:43.961572  1048 tablet_replica.cc:333] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: stopping tablet replica
I20260812 08:00:43.961885  1048 raft_consensus.cc:2243] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 08:00:43.962231  1048 raft_consensus.cc:2272] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:00:43.963495  1048 ts_tablet_manager.cc:1916] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:00:43.965830  1048 ts_tablet_manager.cc:1929] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:00:43.965956  1048 log.cc:1199] T 27034a31a6ef476bb3c3b88a2e89c8fc P 340a9e5f3e3e4d589e1f549ceec37ba1: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TestNewLeaderCantResolvePeers.1786521638881425-32702-0/raft_consensus_election-itest-cluster/ts-1/wal/wals/27034a31a6ef476bb3c3b88a2e89c8fc
I20260812 08:00:43.966763 32733 catalog_manager.cc:5050] TS 340a9e5f3e3e4d589e1f549ceec37ba1 (127.31.239.130:40369): tablet 27034a31a6ef476bb3c3b88a2e89c8fc (table test-workload [id=dabc5e5fad4c47c880a0eab216882510]) successfully deleted
I20260812 08:00:44.046917 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 354
I20260812 08:00:44.061213 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 519
I20260812 08:00:44.070981 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 668
I20260812 08:00:44.081655 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 859
I20260812 08:00:44.094002 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 32716
2026-08-12T08:00:44Z chronyd exiting
[       OK ] RaftConsensusElectionITest.TestNewLeaderCantResolvePeers (5226 ms)
[ RUN      ] RaftConsensusElectionITest.RunLeaderElection
I20260812 08:00:44.122259 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:00:44.122334 32702 ts_itest-base.cc:116] --------------
I20260812 08:00:44.122357 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:00:44.122375 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:00:44.122402 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:00:44Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:00:44Z Disabled control of system clock
I20260812 08:00:44.132010 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:39631
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:36191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:39631 with env {}
W20260812 08:00:44.240434  1059 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:44.240844  1059 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:44.240973  1059 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:44.244611  1059 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:00:44.244725  1059 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:44.244767  1059 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:00:44.244803  1059 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:00:44.248894  1059 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:39631
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:39631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:44.250110  1059 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:44.251334  1059 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:00:44.256999  1069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:44.257025  1066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:44.257077  1065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:44.257534  1059 server_base.cc:1061] running on GCE node
I20260812 08:00:44.258085  1059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:44.259066  1059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:44.260231  1059 hybrid_clock.cc:648] HybridClock initialized: now 1786521644260213 us; error 41 us; skew 500 ppm
I20260812 08:00:44.262399  1059 webserver.cc:533] Webserver started at http://127.31.239.190:36805/ using document root <none> and password file <none>
I20260812 08:00:44.263022  1059 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:44.263098  1059 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:44.263301  1059 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:44.264941  1059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "83fb266700ad4198b4ca832e1fb44ea4"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.265434  1059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "83fb266700ad4198b4ca832e1fb44ea4"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.268924  1059 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:00:44.271341  1079 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.272549  1059 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:00:44.272719  1059 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "83fb266700ad4198b4ca832e1fb44ea4"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.272835  1059 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:44.288260  1059 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:44.288995  1059 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:44.289199  1059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:44.297359  1059 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:39631
I20260812 08:00:44.297385  1143 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:39631 every 8 connection(s)
I20260812 08:00:44.298476  1059 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:00:44.301429  1144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:44.306998  1144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4: Bootstrap starting.
I20260812 08:00:44.308197 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 1059
I20260812 08:00:44.308327 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:00:44.309963  1144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:44.310762  1144 log.cc:826] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:44.312608  1144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4: No bootstrap required, opened a new log
I20260812 08:00:44.315385  1144 raft_consensus.cc:359] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fb266700ad4198b4ca832e1fb44ea4" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 39631 } }
I20260812 08:00:44.315615  1144 raft_consensus.cc:385] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:44.315732  1144 raft_consensus.cc:740] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83fb266700ad4198b4ca832e1fb44ea4, State: Initialized, Role: FOLLOWER
I20260812 08:00:44.316231  1144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fb266700ad4198b4ca832e1fb44ea4" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 39631 } }
I20260812 08:00:44.316381  1144 raft_consensus.cc:399] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:00:44.316463  1144 raft_consensus.cc:493] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:00:44.316583  1144 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:44.317466  1144 raft_consensus.cc:515] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fb266700ad4198b4ca832e1fb44ea4" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 39631 } }
I20260812 08:00:44.317814  1144 leader_election.cc:304] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83fb266700ad4198b4ca832e1fb44ea4; no voters: 
I20260812 08:00:44.318197  1144 leader_election.cc:290] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:00:44.318348  1149 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:00:44.318567  1149 raft_consensus.cc:697] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [term 1 LEADER]: Becoming Leader. State: Replica: 83fb266700ad4198b4ca832e1fb44ea4, State: Running, Role: LEADER
I20260812 08:00:44.318934  1149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fb266700ad4198b4ca832e1fb44ea4" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 39631 } }
I20260812 08:00:44.319346  1144 sys_catalog.cc:565] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:00:44.320469  1151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83fb266700ad4198b4ca832e1fb44ea4. Latest consensus state: current_term: 1 leader_uuid: "83fb266700ad4198b4ca832e1fb44ea4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fb266700ad4198b4ca832e1fb44ea4" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 39631 } } }
I20260812 08:00:44.320601  1151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:00:44.320983  1160 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:00:44.321128  1150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83fb266700ad4198b4ca832e1fb44ea4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83fb266700ad4198b4ca832e1fb44ea4" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 39631 } } }
I20260812 08:00:44.321254  1150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4 [sys.catalog]: This master's current role is: LEADER
I20260812 08:00:44.324236  1160 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:00:44.329898  1160 catalog_manager.cc:1383] Generated new cluster ID: 0e0109c421d54a1cb04a7db44e94f96c
I20260812 08:00:44.330000  1160 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:00:44.354364  1160 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:00:44.355639  1160 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:00:44.362879  1160 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 83fb266700ad4198b4ca832e1fb44ea4: Generated new TSK 0
I20260812 08:00:44.363610  1160 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:00:44.379854 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:39631
--builtin_ntp_servers=127.31.239.148:36191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260812 08:00:44.500986  1175 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:44.501253  1175 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:44.501329  1175 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:44.504751  1175 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:44.504915  1175 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:00:44.508921  1175 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:39631
--never_fsync=true
--heap_profile_path=/tmp/kudu.1175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:44.510093  1175 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:44.511269  1175 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:00:44.517833  1183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:44.517840  1182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:44.517876  1175 server_base.cc:1061] running on GCE node
W20260812 08:00:44.517776  1187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:44.518496  1175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:44.519044  1175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:44.520212  1175 hybrid_clock.cc:648] HybridClock initialized: now 1786521644520192 us; error 33 us; skew 500 ppm
I20260812 08:00:44.522258  1175 webserver.cc:533] Webserver started at http://127.31.239.129:46115/ using document root <none> and password file <none>
I20260812 08:00:44.522891  1175 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:44.522966  1175 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:44.523198  1175 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:44.524750  1175 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "b4402b2dcf5f451b881d159e31223a7c"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.525238  1175 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "b4402b2dcf5f451b881d159e31223a7c"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.528699  1175 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.006s
I20260812 08:00:44.530953  1194 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.531996  1175 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 08:00:44.532186  1175 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "b4402b2dcf5f451b881d159e31223a7c"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.532292  1175 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:44.543527  1175 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:44.544230  1175 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:44.544427  1175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:44.544982  1175 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:44.545943  1175 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:44.546013  1175 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.546077  1175 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:44.546125  1175 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.555739  1175 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:39015
I20260812 08:00:44.555770  1329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:39015 every 8 connection(s)
I20260812 08:00:44.556706  1175 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:00:44.557610 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 1175
I20260812 08:00:44.557732 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:00:44.560237 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:39631
--builtin_ntp_servers=127.31.239.148:36191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
I20260812 08:00:44.566327  1331 heartbeater.cc:344] Connected to a master server at 127.31.239.190:39631
I20260812 08:00:44.566617  1331 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:44.567314  1331 heartbeater.cc:507] Master 127.31.239.190:39631 requested a full tablet report, sending...
I20260812 08:00:44.569103  1103 ts_manager.cc:194] Registered new tserver with Master: b4402b2dcf5f451b881d159e31223a7c (127.31.239.129:39015)
I20260812 08:00:44.570895  1103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:49459
W20260812 08:00:44.674587  1335 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:44.674989  1335 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:44.675082  1335 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:44.679724  1335 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:44.679857  1335 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:00:44.684036  1335 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:39631
--never_fsync=true
--heap_profile_path=/tmp/kudu.1335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:44.685237  1335 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:44.686465  1335 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:00:44.693439  1344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:44.693485  1341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:44.693526  1340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:44.693792  1335 server_base.cc:1061] running on GCE node
I20260812 08:00:44.694288  1335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:44.694936  1335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:44.696123  1335 hybrid_clock.cc:648] HybridClock initialized: now 1786521644696116 us; error 35 us; skew 500 ppm
I20260812 08:00:44.698309  1335 webserver.cc:533] Webserver started at http://127.31.239.130:45249/ using document root <none> and password file <none>
I20260812 08:00:44.698922  1335 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:44.699003  1335 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:44.699210  1335 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:44.700853  1335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "d52f9862c2e24a45a6b48a3dd64e7d18"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.701354  1335 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "d52f9862c2e24a45a6b48a3dd64e7d18"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.704921  1335 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.006s
I20260812 08:00:44.707228  1351 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.708427  1335 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:00:44.708566  1335 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "d52f9862c2e24a45a6b48a3dd64e7d18"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.708676  1335 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:44.724648  1335 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:44.725365  1335 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:44.725559  1335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:44.726179  1335 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:44.727207  1335 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:44.727284  1335 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.727352  1335 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:44.727398  1335 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.737660  1335 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:36331
I20260812 08:00:44.737686  1487 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:36331 every 8 connection(s)
I20260812 08:00:44.738759  1335 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:00:44.747727  1488 heartbeater.cc:344] Connected to a master server at 127.31.239.190:39631
I20260812 08:00:44.748018  1488 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:44.748492 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 1335
I20260812 08:00:44.748615 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:00:44.748575  1488 heartbeater.cc:507] Master 127.31.239.190:39631 requested a full tablet report, sending...
I20260812 08:00:44.749800  1102 ts_manager.cc:194] Registered new tserver with Master: d52f9862c2e24a45a6b48a3dd64e7d18 (127.31.239.130:36331)
I20260812 08:00:44.750458  1102 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:48773
I20260812 08:00:44.750916 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:39631
--builtin_ntp_servers=127.31.239.148:36191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260812 08:00:44.860880  1491 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:44.861114  1491 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:44.861167  1491 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:44.864770  1491 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:44.864928  1491 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:00:44.868961  1491 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:39631
--never_fsync=true
--heap_profile_path=/tmp/kudu.1491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:44.870095  1491 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:44.871322  1491 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:00:44.878119  1500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:44.878213  1497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:44.878458  1498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:44.878558  1491 server_base.cc:1061] running on GCE node
I20260812 08:00:44.878947  1491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:44.879558  1491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:44.880753  1491 hybrid_clock.cc:648] HybridClock initialized: now 1786521644880738 us; error 34 us; skew 500 ppm
I20260812 08:00:44.883002  1491 webserver.cc:533] Webserver started at http://127.31.239.131:33433/ using document root <none> and password file <none>
I20260812 08:00:44.883656  1491 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:44.883739  1491 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:44.883949  1491 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:44.885560  1491 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "376b533a5b8145afa8be08d8cfd878f9"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.886046  1491 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "376b533a5b8145afa8be08d8cfd878f9"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.889494  1491 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:00:44.891788  1506 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.892894  1491 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:00:44.893011  1491 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "376b533a5b8145afa8be08d8cfd878f9"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:44.893115  1491 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:44.914860  1491 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:44.915674  1491 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:44.915895  1491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:44.916544  1491 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:44.917625  1491 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:44.917675  1491 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.917742  1491 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:44.917776  1491 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:44.927536  1491 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:43511
I20260812 08:00:44.927562  1645 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:43511 every 8 connection(s)
I20260812 08:00:44.928552  1491 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:00:44.937857  1646 heartbeater.cc:344] Connected to a master server at 127.31.239.190:39631
I20260812 08:00:44.938038 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 1491
I20260812 08:00:44.938180 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:00:44.938199  1646 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:44.938805  1646 heartbeater.cc:507] Master 127.31.239.190:39631 requested a full tablet report, sending...
I20260812 08:00:44.939993  1103 ts_manager.cc:194] Registered new tserver with Master: 376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131:43511)
I20260812 08:00:44.940657  1103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:41621
I20260812 08:00:44.952539 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:00:44.961259  1103 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58852:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
W20260812 08:00:44.963838  1103 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:00:44.981086  1406 tablet_service.cc:1511] Processing CreateTablet for tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08 (DEFAULT_TABLE table=TestTable [id=f4bbbfc2fae949009f072eda25741965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:44.981074  1563 tablet_service.cc:1511] Processing CreateTablet for tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08 (DEFAULT_TABLE table=TestTable [id=f4bbbfc2fae949009f072eda25741965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:44.981074  1252 tablet_service.cc:1511] Processing CreateTablet for tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08 (DEFAULT_TABLE table=TestTable [id=f4bbbfc2fae949009f072eda25741965]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:44.982028  1406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:44.982043  1252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:44.982043  1563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:44.987267  1671 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18: Bootstrap starting.
I20260812 08:00:44.988983  1673 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c: Bootstrap starting.
I20260812 08:00:44.989823  1671 tablet_bootstrap.cc:654] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:44.990475  1672 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Bootstrap starting.
I20260812 08:00:44.990679  1671 log.cc:826] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:44.991135  1673 tablet_bootstrap.cc:654] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:44.991995  1673 log.cc:826] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:44.992333  1671 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18: No bootstrap required, opened a new log
I20260812 08:00:44.992605  1671 ts_tablet_manager.cc:1403] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:00:44.992692  1672 tablet_bootstrap.cc:654] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:44.993330  1672 log.cc:826] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:44.993746  1673 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c: No bootstrap required, opened a new log
I20260812 08:00:44.993959  1673 ts_tablet_manager.cc:1403] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:00:44.995023  1672 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: No bootstrap required, opened a new log
I20260812 08:00:44.995218  1672 ts_tablet_manager.cc:1403] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:00:44.995896  1671 raft_consensus.cc:359] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:44.996121  1671 raft_consensus.cc:385] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:44.996233  1671 raft_consensus.cc:740] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d52f9862c2e24a45a6b48a3dd64e7d18, State: Initialized, Role: FOLLOWER
I20260812 08:00:44.996699  1671 consensus_queue.cc:260] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:44.997134  1673 raft_consensus.cc:359] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:44.997370  1673 raft_consensus.cc:385] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:44.997429  1488 heartbeater.cc:499] Master 127.31.239.190:39631 was elected leader, sending a full tablet report...
I20260812 08:00:44.997478  1673 raft_consensus.cc:740] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4402b2dcf5f451b881d159e31223a7c, State: Initialized, Role: FOLLOWER
I20260812 08:00:44.997732  1671 ts_tablet_manager.cc:1434] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:00:44.997941  1673 consensus_queue.cc:260] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:44.998663  1331 heartbeater.cc:499] Master 127.31.239.190:39631 was elected leader, sending a full tablet report...
I20260812 08:00:44.998850  1673 ts_tablet_manager.cc:1434] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:00:44.999017  1672 raft_consensus.cc:359] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:44.999233  1672 raft_consensus.cc:385] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:44.999300  1672 raft_consensus.cc:740] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376b533a5b8145afa8be08d8cfd878f9, State: Initialized, Role: FOLLOWER
I20260812 08:00:44.999775  1672 consensus_queue.cc:260] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:45.000428  1646 heartbeater.cc:499] Master 127.31.239.190:39631 was elected leader, sending a full tablet report...
I20260812 08:00:45.000671  1672 ts_tablet_manager.cc:1434] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
W20260812 08:00:45.057852  1332 tablet.cc:2406] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:00:45.089059  1679 raft_consensus.cc:493] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:00:45.089287  1679 raft_consensus.cc:515] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:45.090551  1679 leader_election.cc:290] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d52f9862c2e24a45a6b48a3dd64e7d18 (127.31.239.130:36331), b4402b2dcf5f451b881d159e31223a7c (127.31.239.129:39015)
I20260812 08:00:45.095530  1275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b022e6fb9ac4348bd2d16b6c1b9ec08" candidate_uuid: "376b533a5b8145afa8be08d8cfd878f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4402b2dcf5f451b881d159e31223a7c" is_pre_election: true
I20260812 08:00:45.095929  1275 raft_consensus.cc:2468] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376b533a5b8145afa8be08d8cfd878f9 in term 0.
I20260812 08:00:45.095991  1430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b022e6fb9ac4348bd2d16b6c1b9ec08" candidate_uuid: "376b533a5b8145afa8be08d8cfd878f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" is_pre_election: true
I20260812 08:00:45.096264  1430 raft_consensus.cc:2468] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 376b533a5b8145afa8be08d8cfd878f9 in term 0.
I20260812 08:00:45.096499  1512 leader_election.cc:304] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376b533a5b8145afa8be08d8cfd878f9, b4402b2dcf5f451b881d159e31223a7c; no voters: 
I20260812 08:00:45.096789  1679 raft_consensus.cc:2804] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:00:45.096868  1679 raft_consensus.cc:493] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:00:45.096909  1679 raft_consensus.cc:3060] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:45.097798  1679 raft_consensus.cc:515] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:45.098258  1679 leader_election.cc:290] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [CANDIDATE]: Term 1 election: Requested vote from peers d52f9862c2e24a45a6b48a3dd64e7d18 (127.31.239.130:36331), b4402b2dcf5f451b881d159e31223a7c (127.31.239.129:39015)
I20260812 08:00:45.098578  1430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b022e6fb9ac4348bd2d16b6c1b9ec08" candidate_uuid: "376b533a5b8145afa8be08d8cfd878f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18"
I20260812 08:00:45.098605  1275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b022e6fb9ac4348bd2d16b6c1b9ec08" candidate_uuid: "376b533a5b8145afa8be08d8cfd878f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4402b2dcf5f451b881d159e31223a7c"
I20260812 08:00:45.098708  1430 raft_consensus.cc:3060] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:45.098726  1275 raft_consensus.cc:3060] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:45.099956  1430 raft_consensus.cc:2468] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376b533a5b8145afa8be08d8cfd878f9 in term 1.
I20260812 08:00:45.100354  1511 leader_election.cc:304] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 376b533a5b8145afa8be08d8cfd878f9, d52f9862c2e24a45a6b48a3dd64e7d18; no voters: 
I20260812 08:00:45.100382  1275 raft_consensus.cc:2468] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376b533a5b8145afa8be08d8cfd878f9 in term 1.
I20260812 08:00:45.100584  1679 raft_consensus.cc:2804] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:00:45.100834  1679 raft_consensus.cc:697] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 1 LEADER]: Becoming Leader. State: Replica: 376b533a5b8145afa8be08d8cfd878f9, State: Running, Role: LEADER
I20260812 08:00:45.101190  1679 consensus_queue.cc:237] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:45.104341  1101 catalog_manager.cc:5719] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131). New cstate: current_term: 1 leader_uuid: "376b533a5b8145afa8be08d8cfd878f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } health_report { overall_health: UNKNOWN } } }
I20260812 08:00:45.130412 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:00:45.132687 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver b4402b2dcf5f451b881d159e31223a7c to finish bootstrapping
I20260812 08:00:45.139057 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver d52f9862c2e24a45a6b48a3dd64e7d18 to finish bootstrapping
I20260812 08:00:45.144805 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 376b533a5b8145afa8be08d8cfd878f9 to finish bootstrapping
I20260812 08:00:45.174476  1430 raft_consensus.cc:1275] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 1 FOLLOWER]: Refusing update from remote peer 376b533a5b8145afa8be08d8cfd878f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:00:45.174475  1275 raft_consensus.cc:1275] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 1 FOLLOWER]: Refusing update from remote peer 376b533a5b8145afa8be08d8cfd878f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:00:45.175235  1681 consensus_queue.cc:1048] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:00:45.175434  1679 consensus_queue.cc:1048] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:00:45.179950  1648 tablet.cc:2406] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:00:45.187330  1686 mvcc.cc:204] Tried to move back new op lower bound from 7317592658626899968 to 7317592658337239040. Current Snapshot: MvccSnapshot[applied={T|T < 7317592658626899968 or (T in {7317592658626899968})}]
I20260812 08:00:45.294071  1252 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:00:45.294075  1563 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:00:45.294407  1406 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 83fb266700ad4198b4ca832e1fb44ea4 | 127.31.239.190:39631 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                            Value                                                                                            |      Tags       |         Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                         | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                         | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                        | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                           | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                        | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                        | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                          | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                         | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:36191 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 376b533a5b8145afa8be08d8cfd878f9 | 127.31.239.131:43511 | HEALTHY | <none>   |       1        |       0
 b4402b2dcf5f451b881d159e31223a7c | 127.31.239.129:39015 | HEALTHY | <none>   |       0        |       0
 d52f9862c2e24a45a6b48a3dd64e7d18 | 127.31.239.130:36331 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                          Value                                                                                          |      Tags       |      Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_server_key_size             | 768                                                                                                                                                                                     | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.31.239.129                                                                                                                                                                          | experimental    | 127.31.239.129:39015
 local_ip_for_outbound_sockets    | 127.31.239.130                                                                                                                                                                          | experimental    | 127.31.239.130:36331
 local_ip_for_outbound_sockets    | 127.31.239.131                                                                                                                                                                          | experimental    | 127.31.239.131:43511
 never_fsync                      | true                                                                                                                                                                                    | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                       | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                    | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                      | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:39015
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:36331
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:43511

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:36191 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
   Name    | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
 TestTable | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:00:45.328895 32702 log_verifier.cc:126] Checking tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08
I20260812 08:00:45.360476 32702 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08
I20260812 08:00:45.650115 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 1491
I20260812 08:00:45.665190  1430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b022e6fb9ac4348bd2d16b6c1b9ec08"
dest_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18"
 from {username='slave'} at 127.0.0.1:56374
I20260812 08:00:45.665464  1430 raft_consensus.cc:493] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:00:45.665570  1430 raft_consensus.cc:3060] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:00:45.666586  1430 raft_consensus.cc:515] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:45.667734  1430 leader_election.cc:290] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [CANDIDATE]: Term 2 election: Requested vote from peers 376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131:43511), b4402b2dcf5f451b881d159e31223a7c (127.31.239.129:39015)
W20260812 08:00:45.668542  1357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.239.131:43511: connect: Connection refused (error 111)
W20260812 08:00:45.669605  1357 leader_election.cc:336] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131:43511): Network error: Client connection negotiation failed: client connection to 127.31.239.131:43511: connect: Connection refused (error 111)
I20260812 08:00:45.673316  1275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b022e6fb9ac4348bd2d16b6c1b9ec08" candidate_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: true dest_uuid: "b4402b2dcf5f451b881d159e31223a7c"
I20260812 08:00:45.673483  1275 raft_consensus.cc:3060] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 1 FOLLOWER]: Advancing to term 2
W20260812 08:00:45.674396  1656 meta_cache.cc:302] tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08: replica 376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131:43511) has failed: Network error: Client connection negotiation failed: client connection to 127.31.239.131:43511: connect: Connection refused (error 111)
I20260812 08:00:45.674690  1275 raft_consensus.cc:2468] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d52f9862c2e24a45a6b48a3dd64e7d18 in term 2.
I20260812 08:00:45.675196  1357 leader_election.cc:304] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4402b2dcf5f451b881d159e31223a7c, d52f9862c2e24a45a6b48a3dd64e7d18; no voters: 376b533a5b8145afa8be08d8cfd878f9
I20260812 08:00:45.675494  1677 raft_consensus.cc:2804] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:00:45.675737  1677 raft_consensus.cc:697] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [term 2 LEADER]: Becoming Leader. State: Replica: d52f9862c2e24a45a6b48a3dd64e7d18, State: Running, Role: LEADER
I20260812 08:00:45.676057  1677 consensus_queue.cc:237] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:45.678731  1101 catalog_manager.cc:5719] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 reported cstate change: term changed from 1 to 2, leader changed from 376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131) to d52f9862c2e24a45a6b48a3dd64e7d18 (127.31.239.130). New cstate: current_term: 2 leader_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } health_report { overall_health: UNKNOWN } } }
I20260812 08:00:45.685156  1275 raft_consensus.cc:1275] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P b4402b2dcf5f451b881d159e31223a7c [term 2 FOLLOWER]: Refusing update from remote peer d52f9862c2e24a45a6b48a3dd64e7d18: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260812 08:00:45.685909  1730 consensus_queue.cc:1048] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260812 08:00:45.686157  1357 consensus_peers.cc:597] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P d52f9862c2e24a45a6b48a3dd64e7d18 -> Peer 376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131:43511): Couldn't send request to peer 376b533a5b8145afa8be08d8cfd878f9. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.131:43511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:00:45.731365 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:43511
--local_ip_for_outbound_sockets=127.31.239.131
--tserver_master_addrs=127.31.239.190:39631
--webserver_port=33433
--webserver_interface=127.31.239.131
--builtin_ntp_servers=127.31.239.148:36191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=1000 with env {}
W20260812 08:00:45.841563  1738 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:45.841789  1738 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:45.841835  1738 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:45.845223  1738 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:45.845350  1738 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:00:45.849381  1738 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=1000
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:43511
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=33433
--tserver_master_addrs=127.31.239.190:39631
--never_fsync=true
--heap_profile_path=/tmp/kudu.1738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:45.850591  1738 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:45.851742  1738 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:00:45.858614  1743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:45.858644  1748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:45.858621  1738 server_base.cc:1061] running on GCE node
W20260812 08:00:45.858632  1744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:45.859161  1738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:45.859756  1738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:45.860934  1738 hybrid_clock.cc:648] HybridClock initialized: now 1786521645860825 us; error 128 us; skew 500 ppm
I20260812 08:00:45.862890  1738 webserver.cc:533] Webserver started at http://127.31.239.131:33433/ using document root <none> and password file <none>
I20260812 08:00:45.863478  1738 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:45.863595  1738 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:45.867053  1738 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 08:00:45.869146  1756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:45.870193  1738 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:00:45.870322  1738 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "376b533a5b8145afa8be08d8cfd878f9"
format_stamp: "Formatted at 2026-08-12 08:00:44 on dist-test-slave-9jjr"
I20260812 08:00:45.870747  1738 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:45.884486  1738 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:45.885183  1738 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:45.885388  1738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:45.886001  1738 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:45.887388  1766 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:00:45.890698  1738 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:00:45.890780  1738 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:00:45.890861  1738 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:00:45.892346  1738 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:00:45.892413  1738 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 08:00:45.892701  1766 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Bootstrap starting.
I20260812 08:00:45.904719  1738 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:43511
I20260812 08:00:45.904788  1891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:43511 every 8 connection(s)
I20260812 08:00:45.905754  1738 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:00:45.906098  1766 log.cc:826] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:45.908689 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 1738
I20260812 08:00:45.915808  1892 heartbeater.cc:344] Connected to a master server at 127.31.239.190:39631
I20260812 08:00:45.916082  1892 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:45.916711  1892 heartbeater.cc:507] Master 127.31.239.190:39631 requested a full tablet report, sending...
I20260812 08:00:45.918704  1101 ts_manager.cc:194] Re-registered known tserver with Master: 376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131:43511)
I20260812 08:00:45.919644  1101 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:38243
I20260812 08:00:45.926596  1766 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:00:45.927016  1766 tablet_bootstrap.cc:492] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Bootstrap complete.
I20260812 08:00:45.928237  1766 ts_tablet_manager.cc:1403] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Time spent bootstrapping tablet: real 0.036s	user 0.030s	sys 0.004s
I20260812 08:00:45.930364  1766 raft_consensus.cc:359] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:45.930714  1766 raft_consensus.cc:740] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376b533a5b8145afa8be08d8cfd878f9, State: Initialized, Role: FOLLOWER
I20260812 08:00:45.931141  1766 consensus_queue.cc:260] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "376b533a5b8145afa8be08d8cfd878f9" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 43511 } } peers { permanent_uuid: "d52f9862c2e24a45a6b48a3dd64e7d18" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 36331 } } peers { permanent_uuid: "b4402b2dcf5f451b881d159e31223a7c" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39015 } }
I20260812 08:00:45.931841  1892 heartbeater.cc:499] Master 127.31.239.190:39631 was elected leader, sending a full tablet report...
I20260812 08:00:45.932080  1766 ts_tablet_manager.cc:1434] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:00:45.961592  1406 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:00:45.963165  1252 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:00:45.964331  1817 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 83fb266700ad4198b4ca832e1fb44ea4 | 127.31.239.190:39631 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                            Value                                                                                            |      Tags       |         Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                         | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                         | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                        | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                           | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                        | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                        | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                          | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                         | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:36191 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 376b533a5b8145afa8be08d8cfd878f9 | 127.31.239.131:43511 | HEALTHY | <none>   |       0        |       0
 b4402b2dcf5f451b881d159e31223a7c | 127.31.239.129:39015 | HEALTHY | <none>   |       0        |       0
 d52f9862c2e24a45a6b48a3dd64e7d18 | 127.31.239.130:36331 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                          Value                                                                                          |      Tags       |      Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_server_key_size             | 768                                                                                                                                                                                     | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.31.239.129                                                                                                                                                                          | experimental    | 127.31.239.129:39015
 local_ip_for_outbound_sockets    | 127.31.239.130                                                                                                                                                                          | experimental    | 127.31.239.130:36331
 local_ip_for_outbound_sockets    | 127.31.239.131                                                                                                                                                                          | experimental    | 127.31.239.131:43511
 never_fsync                      | true                                                                                                                                                                                    | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                       | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                    | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                      | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:39015
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:36331
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:43511

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:36191 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08 of table 'TestTable' is conflicted: 1 replicas' active configs disagree with the leader master's
  376b533a5b8145afa8be08d8cfd878f9 (127.31.239.131:43511): RUNNING
  d52f9862c2e24a45a6b48a3dd64e7d18 (127.31.239.130:36331): RUNNING [LEADER]
  b4402b2dcf5f451b881d159e31223a7c (127.31.239.129:39015): RUNNING
All reported replicas are:
  A = 376b533a5b8145afa8be08d8cfd878f9
  B = d52f9862c2e24a45a6b48a3dd64e7d18
  C = b4402b2dcf5f451b881d159e31223a7c
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B*  C    |              |              | Yes
 A             | A   B   C    | 1            | -1           | Yes
 B             | A   B*  C    | 2            | -1           | Yes
 C             | A   B*  C    | 2            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
   Name    | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+--------------------+---------------+---------+------------+------------------+-------------
 TestTable | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 08:00:45.989651 32702 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:00:46.089649  1844 raft_consensus.cc:3060] T 5b022e6fb9ac4348bd2d16b6c1b9ec08 P 376b533a5b8145afa8be08d8cfd878f9 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:00:46.099179  1934 mvcc.cc:204] Tried to move back new op lower bound from 7317592660894261248 to 7317592660692320256. Current Snapshot: MvccSnapshot[applied={T|T < 7317592660817469440}]
I20260812 08:00:46.193022  1406 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:00:46.193122  1817 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:00:46.193404  1252 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 83fb266700ad4198b4ca832e1fb44ea4 | 127.31.239.190:39631 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                            Value                                                                                            |      Tags       |         Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                         | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                         | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                        | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                           | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                        | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                        | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                          | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                         | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:36191 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 376b533a5b8145afa8be08d8cfd878f9 | 127.31.239.131:43511 | HEALTHY | <none>   |       0        |       0
 b4402b2dcf5f451b881d159e31223a7c | 127.31.239.129:39015 | HEALTHY | <none>   |       0        |       0
 d52f9862c2e24a45a6b48a3dd64e7d18 | 127.31.239.130:36331 | HEALTHY | <none>   |       1        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
               Flag               |                                                                                          Value                                                                                          |      Tags       |      Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_server_key_size             | 768                                                                                                                                                                                     | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets    | 127.31.239.129                                                                                                                                                                          | experimental    | 127.31.239.129:39015
 local_ip_for_outbound_sockets    | 127.31.239.130                                                                                                                                                                          | experimental    | 127.31.239.130:36331
 local_ip_for_outbound_sockets    | 127.31.239.131                                                                                                                                                                          | experimental    | 127.31.239.131:43511
 never_fsync                      | true                                                                                                                                                                                    | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                       | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                    | unsafe          | all 3 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                      | hidden          | all 3 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:39015
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:36331
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.RunLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:43511

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:36191 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
   Name    | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
 TestTable | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:00:46.225168 32702 log_verifier.cc:126] Checking tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08
I20260812 08:00:46.253023 32702 log_verifier.cc:177] Verified matching terms for 12 ops in tablet 5b022e6fb9ac4348bd2d16b6c1b9ec08
I20260812 08:00:46.324005 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 1175
I20260812 08:00:46.333847 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 1335
I20260812 08:00:46.342087 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 1738
I20260812 08:00:46.352073 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 1059
2026-08-12T08:00:46Z chronyd exiting
[       OK ] RaftConsensusElectionITest.RunLeaderElection (2260 ms)
[ RUN      ] RaftConsensusElectionITest.ChurnyElections
I20260812 08:00:46.382496 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:00:46.382570 32702 ts_itest-base.cc:116] --------------
I20260812 08:00:46.382587 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:00:46.382603 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:00:46.382630 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:00:46Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:00:46Z Disabled control of system clock
I20260812 08:00:46.392177 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:40585
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:40585 with env {}
W20260812 08:00:46.499855  1991 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:46.500149  1991 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:46.500223  1991 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:46.503844  1991 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:00:46.503957  1991 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:46.504012  1991 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:00:46.504072  1991 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:00:46.508145  1991 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:40585
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:40585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:46.509356  1991 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:46.510574  1991 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:00:46.516033  2001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:46.516127  1999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:46.516048  1998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:46.516584  1991 server_base.cc:1061] running on GCE node
I20260812 08:00:46.517105  1991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:46.518083  1991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:46.519304  1991 hybrid_clock.cc:648] HybridClock initialized: now 1786521646519287 us; error 43 us; skew 500 ppm
I20260812 08:00:46.521134  1991 webserver.cc:533] Webserver started at http://127.31.239.190:38449/ using document root <none> and password file <none>
I20260812 08:00:46.521727  1991 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:46.521819  1991 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:46.522043  1991 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:46.523743  1991 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "dca8bfe66b53465386eabbed7fb0c4bf"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.524253  1991 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "dca8bfe66b53465386eabbed7fb0c4bf"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.527789  1991 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260812 08:00:46.530073  2007 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:46.531213  1991 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:00:46.531352  1991 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "dca8bfe66b53465386eabbed7fb0c4bf"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.531466  1991 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:46.551352  1991 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:46.552101  1991 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:46.552323  1991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:46.560941  1991 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:40585
I20260812 08:00:46.560957  2073 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:40585 every 8 connection(s)
I20260812 08:00:46.562161  1991 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:00:46.565040  2074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:46.568533 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 1991
I20260812 08:00:46.568691 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:00:46.570412  2074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf: Bootstrap starting.
I20260812 08:00:46.573061  2074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:46.573897  2074 log.cc:826] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:46.575970  2074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf: No bootstrap required, opened a new log
I20260812 08:00:46.578698  2074 raft_consensus.cc:359] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8bfe66b53465386eabbed7fb0c4bf" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40585 } }
I20260812 08:00:46.578881  2074 raft_consensus.cc:385] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:46.578917  2074 raft_consensus.cc:740] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dca8bfe66b53465386eabbed7fb0c4bf, State: Initialized, Role: FOLLOWER
I20260812 08:00:46.579265  2074 consensus_queue.cc:260] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8bfe66b53465386eabbed7fb0c4bf" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40585 } }
I20260812 08:00:46.579368  2074 raft_consensus.cc:399] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:00:46.579413  2074 raft_consensus.cc:493] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:00:46.579491  2074 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:46.580283  2074 raft_consensus.cc:515] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8bfe66b53465386eabbed7fb0c4bf" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40585 } }
I20260812 08:00:46.580650  2074 leader_election.cc:304] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dca8bfe66b53465386eabbed7fb0c4bf; no voters: 
I20260812 08:00:46.580976  2074 leader_election.cc:290] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:00:46.581110  2081 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:00:46.581364  2081 raft_consensus.cc:697] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [term 1 LEADER]: Becoming Leader. State: Replica: dca8bfe66b53465386eabbed7fb0c4bf, State: Running, Role: LEADER
I20260812 08:00:46.581709  2081 consensus_queue.cc:237] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8bfe66b53465386eabbed7fb0c4bf" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40585 } }
I20260812 08:00:46.582100  2074 sys_catalog.cc:565] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:00:46.583431  2083 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader dca8bfe66b53465386eabbed7fb0c4bf. Latest consensus state: current_term: 1 leader_uuid: "dca8bfe66b53465386eabbed7fb0c4bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8bfe66b53465386eabbed7fb0c4bf" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40585 } } }
I20260812 08:00:46.583551  2083 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [sys.catalog]: This master's current role is: LEADER
I20260812 08:00:46.584021  2082 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dca8bfe66b53465386eabbed7fb0c4bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8bfe66b53465386eabbed7fb0c4bf" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40585 } } }
I20260812 08:00:46.584141  2082 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf [sys.catalog]: This master's current role is: LEADER
I20260812 08:00:46.584717  2095 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:00:46.587577  2095 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:00:46.592876  2095 catalog_manager.cc:1383] Generated new cluster ID: e98c6c4705e6455898c0aa17226ffabe
I20260812 08:00:46.592973  2095 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:00:46.609279  2095 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:00:46.610275  2095 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:00:46.616303  2095 catalog_manager.cc:6092] T 00000000000000000000000000000000 P dca8bfe66b53465386eabbed7fb0c4bf: Generated new TSK 0
I20260812 08:00:46.616899  2095 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:00:46.625042 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40585
--builtin_ntp_servers=127.31.239.148:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
W20260812 08:00:46.737808  2106 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:46.738020  2106 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:46.738067  2106 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:46.741467  2106 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:46.741672  2106 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:00:46.745756  2106 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:40585
--never_fsync=true
--heap_profile_path=/tmp/kudu.2106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:46.746994  2106 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:46.748201  2106 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:00:46.751032  2106 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:00:46.754967  2111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:46.755026  2112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:46.755043  2114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:46.755390  2106 server_base.cc:1061] running on GCE node
I20260812 08:00:46.755950  2106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:46.756639  2106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:46.757827  2106 hybrid_clock.cc:648] HybridClock initialized: now 1786521646757805 us; error 37 us; skew 500 ppm
I20260812 08:00:46.760061  2106 webserver.cc:533] Webserver started at http://127.31.239.129:43269/ using document root <none> and password file <none>
I20260812 08:00:46.760753  2106 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:46.760821  2106 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:46.761018  2106 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:46.763200  2106 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "5c7ad63e416f4fe090d01f6eb74c9559"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.763782  2106 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "5c7ad63e416f4fe090d01f6eb74c9559"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.768182  2106 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:00:46.770987  2121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:46.772123  2106 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:00:46.772238  2106 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "5c7ad63e416f4fe090d01f6eb74c9559"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.772329  2106 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:46.788739  2106 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:46.789399  2106 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:46.789557  2106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:46.790102  2106 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:46.791231  2106 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:46.791282  2106 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:46.791324  2106 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:46.791339  2106 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:46.801184  2106 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:35469
I20260812 08:00:46.801249  2254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:35469 every 8 connection(s)
I20260812 08:00:46.802259  2106 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:00:46.802815 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 2106
I20260812 08:00:46.802932 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:00:46.805352 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40585
--builtin_ntp_servers=127.31.239.148:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
I20260812 08:00:46.811787  2255 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40585
I20260812 08:00:46.812073  2255 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:46.812608  2255 heartbeater.cc:507] Master 127.31.239.190:40585 requested a full tablet report, sending...
I20260812 08:00:46.814204  2024 ts_manager.cc:194] Registered new tserver with Master: 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:46.815372  2024 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:51329
W20260812 08:00:46.915970  2258 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:46.916239  2258 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:46.916334  2258 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:46.919857  2258 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:46.920038  2258 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:00:46.924479  2258 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:40585
--never_fsync=true
--heap_profile_path=/tmp/kudu.2258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:46.925688  2258 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:46.927253  2258 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:00:46.930070  2258 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:00:46.934077  2265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:46.934079  2267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:46.934077  2264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:46.934433  2258 server_base.cc:1061] running on GCE node
I20260812 08:00:46.934863  2258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:46.935511  2258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:46.936728  2258 hybrid_clock.cc:648] HybridClock initialized: now 1786521646936697 us; error 44 us; skew 500 ppm
I20260812 08:00:46.938756  2258 webserver.cc:533] Webserver started at http://127.31.239.130:33297/ using document root <none> and password file <none>
I20260812 08:00:46.939353  2258 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:46.939435  2258 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:46.939682  2258 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:46.941318  2258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "d372d7abe19c4c3380c7c8210da6a838"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.941826  2258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "d372d7abe19c4c3380c7c8210da6a838"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.945504  2258 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:00:46.947983  2274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:46.949071  2258 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:00:46.949222  2258 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "d372d7abe19c4c3380c7c8210da6a838"
format_stamp: "Formatted at 2026-08-12 08:00:46 on dist-test-slave-9jjr"
I20260812 08:00:46.949337  2258 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:46.959448  2258 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:46.960175  2258 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:46.960379  2258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:46.960961  2258 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:46.962065  2258 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:46.962138  2258 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:46.962218  2258 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:46.962261  2258 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:46.972177  2258 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:34369
I20260812 08:00:46.972203  2409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:34369 every 8 connection(s)
I20260812 08:00:46.973176  2258 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:00:46.982028  2410 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40585
I20260812 08:00:46.982376  2410 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:46.982877 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 2258
I20260812 08:00:46.982997 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:00:46.983153  2410 heartbeater.cc:507] Master 127.31.239.190:40585 requested a full tablet report, sending...
I20260812 08:00:46.984344  2026 ts_manager.cc:194] Registered new tserver with Master: d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369)
I20260812 08:00:46.984984  2026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:48839
I20260812 08:00:46.985550 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40585
--builtin_ntp_servers=127.31.239.148:39885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
W20260812 08:00:47.095992  2415 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:00:47.096235  2415 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:00:47.096306  2415 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:00:47.099848  2415 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:00:47.100004  2415 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:00:47.103991  2415 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:39885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:40585
--never_fsync=true
--heap_profile_path=/tmp/kudu.2415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:00:47.105113  2415 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:00:47.106323  2415 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:00:47.108999  2415 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:00:47.112861  2424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:47.112890  2420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:00:47.112907  2421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:00:47.113118  2415 server_base.cc:1061] running on GCE node
I20260812 08:00:47.113464  2415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:00:47.114051  2415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:00:47.115262  2415 hybrid_clock.cc:648] HybridClock initialized: now 1786521647115243 us; error 30 us; skew 500 ppm
I20260812 08:00:47.117206  2415 webserver.cc:533] Webserver started at http://127.31.239.131:40521/ using document root <none> and password file <none>
I20260812 08:00:47.117789  2415 fs_manager.cc:362] Metadata directory not provided
I20260812 08:00:47.117874  2415 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:00:47.118096  2415 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:00:47.119647  2415 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "ebdebbdd787a429cb0ee706b88474efe"
format_stamp: "Formatted at 2026-08-12 08:00:47 on dist-test-slave-9jjr"
I20260812 08:00:47.120137  2415 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "ebdebbdd787a429cb0ee706b88474efe"
format_stamp: "Formatted at 2026-08-12 08:00:47 on dist-test-slave-9jjr"
I20260812 08:00:47.123577  2415 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260812 08:00:47.126417  2435 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:47.127831  2415 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260812 08:00:47.128002  2415 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "ebdebbdd787a429cb0ee706b88474efe"
format_stamp: "Formatted at 2026-08-12 08:00:47 on dist-test-slave-9jjr"
I20260812 08:00:47.128123  2415 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:00:47.141924  2415 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:00:47.142740  2415 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:00:47.142966  2415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:00:47.143638  2415 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:00:47.144729  2415 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:00:47.144806  2415 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:47.144881  2415 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:00:47.144934  2415 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:00:47.155390  2415 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:36043
I20260812 08:00:47.155411  2565 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:36043 every 8 connection(s)
I20260812 08:00:47.156512  2415 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:00:47.162784 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 2415
I20260812 08:00:47.162923 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:00:47.165756  2566 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40585
I20260812 08:00:47.166055  2566 heartbeater.cc:461] Registering TS with master...
I20260812 08:00:47.166697  2566 heartbeater.cc:507] Master 127.31.239.190:40585 requested a full tablet report, sending...
I20260812 08:00:47.167819  2026 ts_manager.cc:194] Registered new tserver with Master: ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:47.168424  2026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:46435
I20260812 08:00:47.178054 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:00:47.190150  2026 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58412:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:00:47.191335  2026 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:00:47.208285  2487 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab31e16200043d499ea4524521f82b4 (DEFAULT_TABLE table=test-workload [id=b4bba45dbfc34533997e2dcb75926a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:47.208324  2334 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab31e16200043d499ea4524521f82b4 (DEFAULT_TABLE table=test-workload [id=b4bba45dbfc34533997e2dcb75926a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:47.208622  2178 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab31e16200043d499ea4524521f82b4 (DEFAULT_TABLE table=test-workload [id=b4bba45dbfc34533997e2dcb75926a0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:00:47.209252  2487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab31e16200043d499ea4524521f82b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:47.209276  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab31e16200043d499ea4524521f82b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:47.209367  2178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab31e16200043d499ea4524521f82b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:00:47.214323  2586 tablet_bootstrap.cc:492] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe: Bootstrap starting.
I20260812 08:00:47.215556  2590 tablet_bootstrap.cc:492] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559: Bootstrap starting.
I20260812 08:00:47.215556  2588 tablet_bootstrap.cc:492] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838: Bootstrap starting.
I20260812 08:00:47.217101  2586 tablet_bootstrap.cc:654] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:47.217823  2588 tablet_bootstrap.cc:654] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:47.217823  2590 tablet_bootstrap.cc:654] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559: Neither blocks nor log segments found. Creating new log.
I20260812 08:00:47.217835  2586 log.cc:826] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:47.218665  2588 log.cc:826] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:47.218665  2590 log.cc:826] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559: Log is configured to *not* fsync() on all Append() calls
I20260812 08:00:47.219643  2586 tablet_bootstrap.cc:492] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe: No bootstrap required, opened a new log
I20260812 08:00:47.219862  2586 ts_tablet_manager.cc:1403] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe: Time spent bootstrapping tablet: real 0.006s	user 0.002s	sys 0.002s
I20260812 08:00:47.220307  2588 tablet_bootstrap.cc:492] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838: No bootstrap required, opened a new log
I20260812 08:00:47.220306  2590 tablet_bootstrap.cc:492] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559: No bootstrap required, opened a new log
I20260812 08:00:47.220491  2590 ts_tablet_manager.cc:1403] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:00:47.220491  2588 ts_tablet_manager.cc:1403] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.004s
I20260812 08:00:47.223021  2586 raft_consensus.cc:359] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.223251  2586 raft_consensus.cc:385] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:47.223318  2586 raft_consensus.cc:740] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebdebbdd787a429cb0ee706b88474efe, State: Initialized, Role: FOLLOWER
I20260812 08:00:47.223609  2590 raft_consensus.cc:359] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.223605  2588 raft_consensus.cc:359] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.223805  2588 raft_consensus.cc:385] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:47.223805  2590 raft_consensus.cc:385] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:00:47.223866  2590 raft_consensus.cc:740] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c7ad63e416f4fe090d01f6eb74c9559, State: Initialized, Role: FOLLOWER
I20260812 08:00:47.223814  2586 consensus_queue.cc:260] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.223912  2588 raft_consensus.cc:740] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d372d7abe19c4c3380c7c8210da6a838, State: Initialized, Role: FOLLOWER
I20260812 08:00:47.224321  2590 consensus_queue.cc:260] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.224321  2588 consensus_queue.cc:260] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.224879  2586 ts_tablet_manager.cc:1434] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260812 08:00:47.225152  2590 ts_tablet_manager.cc:1434] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:00:47.225152  2588 ts_tablet_manager.cc:1434] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260812 08:00:47.225319  2410 heartbeater.cc:499] Master 127.31.239.190:40585 was elected leader, sending a full tablet report...
I20260812 08:00:47.225515  2255 heartbeater.cc:499] Master 127.31.239.190:40585 was elected leader, sending a full tablet report...
I20260812 08:00:47.225714  2595 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:00:47.225802  2598 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:00:47.225847  2595 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.225925  2598 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.226961  2566 heartbeater.cc:499] Master 127.31.239.190:40585 was elected leader, sending a full tablet report...
I20260812 08:00:47.227027  2597 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:00:47.227147  2597 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.227419  2595 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:47.228372  2598 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:47.228888  2597 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
W20260812 08:00:47.235282  2279 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.31.239.129:35469 for RPC RequestConsensusVote timed out after 0.007s (ON_OUTBOUND_QUEUE)
W20260812 08:00:47.235872  2122 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.130:34369 timed out after 0.008s (ON_OUTBOUND_QUEUE)
I20260812 08:00:47.237149  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "d372d7abe19c4c3380c7c8210da6a838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:47.237382  2510 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d372d7abe19c4c3380c7c8210da6a838 in term 0.
W20260812 08:00:47.237929  2439 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.129:35469 timed out after 0.008s (SENT)
I20260812 08:00:47.237968  2276 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe; no voters: 
I20260812 08:00:47.238287  2595 raft_consensus.cc:2804] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:00:47.238363  2595 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:00:47.238420  2595 raft_consensus.cc:3060] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:47.238401  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:47.238585  2200 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebdebbdd787a429cb0ee706b88474efe in term 0.
I20260812 08:00:47.238572  2358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:47.239648  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:47.239658  2595 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.239770  2200 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ebdebbdd787a429cb0ee706b88474efe in term 0.
I20260812 08:00:47.239944  2358 raft_consensus.cc:2393] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebdebbdd787a429cb0ee706b88474efe in current term 1: Already voted for candidate d372d7abe19c4c3380c7c8210da6a838 in this term.
I20260812 08:00:47.240134  2595 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [CANDIDATE]: Term 1 election: Requested vote from peers 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:47.240541  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "d372d7abe19c4c3380c7c8210da6a838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe"
I20260812 08:00:47.240628  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:47.240694  2509 raft_consensus.cc:3060] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:47.240751  2357 raft_consensus.cc:2393] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c7ad63e416f4fe090d01f6eb74c9559 in current term 1: Already voted for candidate d372d7abe19c4c3380c7c8210da6a838 in this term.
I20260812 08:00:47.240903  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "d372d7abe19c4c3380c7c8210da6a838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:47.241037  2199 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d372d7abe19c4c3380c7c8210da6a838 in term 0.
I20260812 08:00:47.241120  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559, ebdebbdd787a429cb0ee706b88474efe; no voters: 
I20260812 08:00:47.241281  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:47.241848  2509 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d372d7abe19c4c3380c7c8210da6a838 in term 1.
I20260812 08:00:47.241825  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:47.242010  2597 raft_consensus.cc:2764] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 08:00:47.242177  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:47.241844  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "d372d7abe19c4c3380c7c8210da6a838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559"
I20260812 08:00:47.242311  2357 raft_consensus.cc:2393] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebdebbdd787a429cb0ee706b88474efe in current term 1: Already voted for candidate d372d7abe19c4c3380c7c8210da6a838 in this term.
I20260812 08:00:47.242357  2200 raft_consensus.cc:3060] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:00:47.242419  2276 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe; no voters: 
I20260812 08:00:47.242734  2595 raft_consensus.cc:2804] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:00:47.243005  2595 raft_consensus.cc:697] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 LEADER]: Becoming Leader. State: Replica: d372d7abe19c4c3380c7c8210da6a838, State: Running, Role: LEADER
I20260812 08:00:47.243378  2595 consensus_queue.cc:237] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.243505  2200 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d372d7abe19c4c3380c7c8210da6a838 in term 1.
I20260812 08:00:47.243582  2598 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 08:00:47.246598  2026 catalog_manager.cc:5719] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 reported cstate change: term changed from 0 to 1, leader changed from <none> to d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "d372d7abe19c4c3380c7c8210da6a838" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } health_report { overall_health: UNKNOWN } } }
I20260812 08:00:47.246831  2595 consensus_queue.cc:1048] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:00:47.247082  2608 consensus_queue.cc:1048] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:00:47.270931  2612 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:00:47.271023  2612 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260812 08:00:47.416651  2464 tablet_service.cc:3080] error setting up scanner 86442158f190411f9bebbf21ae79ea5c with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.146s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
W20260812 08:00:47.416651  2466 tablet_service.cc:3080] error setting up scanner ef89085b98c64df7bf545fabe0bba935 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.146s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
W20260812 08:00:47.431926  2466 tablet_service.cc:3080] error setting up scanner 6dc770655ada4bd88de9945f9df62a0d with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.161s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
W20260812 08:00:47.432538  2464 tablet_service.cc:3080] error setting up scanner 9f9868c0486648eca4a6d160eb4e1920 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.162s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
W20260812 08:00:47.462455  2464 tablet_service.cc:3080] error setting up scanner 331c3ce6f1c64675a35b0e7588c08b45 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.192s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
W20260812 08:00:47.467952  2464 tablet_service.cc:3080] error setting up scanner 5db460798ff741e3ae8b21697431f4a3 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.197s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
W20260812 08:00:47.532410  2464 tablet_service.cc:3080] error setting up scanner 7d705714997a431c951e1a458c9bbd4d with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.262s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
W20260812 08:00:47.545730  2464 tablet_service.cc:3080] error setting up scanner e1fdb3107d944dacae177b5e3ecf7c98 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.275s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
W20260812 08:00:47.627688  2464 tablet_service.cc:3080] error setting up scanner 0b8d4b789fdc4aa99f9533f978a94d9e with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.357s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
W20260812 08:00:47.663590  2464 tablet_service.cc:3080] error setting up scanner 2105b4aae7fa40579e0e4032144febbf with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.393s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:00:47.806718  2626 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:47.806842  2626 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:47.807236  2626 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:47.807617  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:47.807653  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:47.808055  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:47.808326  2626 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:00:47.857553  2464 tablet_service.cc:3080] error setting up scanner 13d8ba6e12f142818ff5e21b759eb515 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.587s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
W20260812 08:00:47.933530  2464 tablet_service.cc:3080] error setting up scanner 62151d0d66624a61b2d706b12b96df0a with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.663s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
W20260812 08:00:48.137271  2200 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:00:48.137271  2509 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:00:48.137372  2509 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260812 08:00:48.137372  2200 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260812 08:00:48.240724  2627 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:48.240897  2627 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:48.241830  2627 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:48.242308  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:48.242411  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:48.242879  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:48.243270  2627 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:00:48.351621  2466 tablet_service.cc:3080] error setting up scanner 0fa25e09a28b4764bc83e82786b458b1 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.109s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:00:49.119076  2626 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:49.119220  2626 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:49.119939  2626 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:49.120386  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:49.120429  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:49.120890  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
W20260812 08:00:49.307730  2464 tablet_service.cc:3080] error setting up scanner 3d2570be248d47eaaf4d5f0ca1b364ab with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521648307456 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521647270795 usec, L: 0 Physical time difference: 1.037s: new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:00:49.308218  2464 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:59754 (request call id 12) took 1001 ms. Trace:
I20260812 08:00:49.308300  2464 rpcz_store.cc:276] 0812 08:00:48.306946 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:48.307016 (+    70us) service_pool.cc:224] Handling call
0812 08:00:48.307247 (+   231us) tablet_service.cc:2890] Created scanner 3d2570be248d47eaaf4d5f0ca1b364ab for tablet 2ab31e16200043d499ea4524521f82b4, query id is 7957484def364b5ba5aa65f3fe14435d
0812 08:00:48.307469 (+   222us) tablet_service.cc:3030] Creating iterator
0812 08:00:48.307490 (+    21us) tablet_service.cc:3408] Waiting safe time to advance
0812 08:00:49.307704 (+1000214us) tablet_service.cc:3055] Iterator created
0812 08:00:49.307719 (+    15us) tablet_service.cc:3077] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521648307456 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521647270795 usec, L: 0 Physical time difference: 1.037s
0812 08:00:49.308199 (+   480us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260812 08:00:49.569723  2464 tablet_service.cc:3080] error setting up scanner 035f874c2f7b445f8839f726d7e98053 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.327s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:00:49.615823  2626 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:49.617741  2638 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=1, attempt_no=0}) took 2351 ms. Trace:
I20260812 08:00:49.617919  2638 rpcz_store.cc:276] 0812 08:00:47.266643 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:47.266704 (+    61us) service_pool.cc:224] Handling call
0812 08:00:49.617720 (+2351016us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:48.135936 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:48.136068 (+   132us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:48.136073 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:00:48.136074 (+     1us) tablet.cc:662] Decoding operations
0812 08:00:48.136201 (+   127us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:48.136249 (+    48us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:48.136255 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:48.136302 (+    47us) tablet.cc:701] Row locks acquired
0812 08:00:48.136304 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:00:48.136354 (+    50us) write_op.cc:270] Start()
0812 08:00:49.076515 (+940161us) write_op.cc:276] Timestamp: P: 1786521648136320 usec, L: 0
0812 08:00:49.076519 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:00:49.076728 (+   209us) log.cc:844] Serialized 345 byte log entry
0812 08:00:49.617022 (+540294us) op_driver.cc:464] REPLICATION: finished
0812 08:00:49.617254 (+   232us) write_op.cc:301] APPLY: starting
0812 08:00:49.617270 (+    16us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:49.617296 (+    26us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:49.617308 (+    12us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:49.617398 (+    90us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:49.617422 (+    24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:49.617425 (+     3us) write_op.cc:312] APPLY: finished
0812 08:00:49.617485 (+    60us) log.cc:844] Serialized 22 byte log entry
0812 08:00:49.617573 (+    88us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:49.617586 (+    13us) write_op.cc:454] Released schema lock
0812 08:00:49.617591 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":276352,"child_traces":[["op",{"apply.queue_time_us":175,"mutex_wait_us":1114,"num_ops":1,"prepare.queue_time_us":866824,"prepare.run_cpu_time_us":782,"prepare.run_wall_time_us":940855,"replication_time_us":540465,"thread_start_us":83,"threads_started":1}]]}
I20260812 08:00:49.677773  2632 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:49.677958  2632 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:49.678555  2632 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:49.678843  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:49.679272  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:49.680028  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:49.680225  2632 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:00:50.270704  2464 tablet_service.cc:3080] error setting up scanner 8694f949353f422297638fa373ce4850 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.591s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:00:50.424139  2626 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:50.424302  2626 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:50.424887  2626 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:50.425486  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:50.425623  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:50.426054  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:50.426746  2643 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=2, attempt_no=0}) took 2181 ms. Trace:
I20260812 08:00:50.426829  2643 rpcz_store.cc:276] 0812 08:00:48.245591 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:48.245661 (+    70us) service_pool.cc:224] Handling call
0812 08:00:50.426730 (+2181069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:49.076836 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:49.076974 (+   138us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:49.076978 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:49.076980 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:49.077049 (+    69us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:49.077059 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:49.077062 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:49.077106 (+    44us) tablet.cc:701] Row locks acquired
0812 08:00:49.077108 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:00:49.077151 (+    43us) write_op.cc:270] Start()
0812 08:00:49.979273 (+902122us) write_op.cc:276] Timestamp: P: 1786521649077124 usec, L: 0
0812 08:00:49.979277 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:00:49.979445 (+   168us) log.cc:844] Serialized 354 byte log entry
0812 08:00:50.425151 (+445706us) op_driver.cc:464] REPLICATION: finished
0812 08:00:50.425590 (+   439us) write_op.cc:301] APPLY: starting
0812 08:00:50.425612 (+    22us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:50.425645 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:50.425659 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:50.425717 (+    58us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:50.425751 (+    34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:50.425756 (+     5us) write_op.cc:312] APPLY: finished
0812 08:00:50.426535 (+   779us) log.cc:844] Serialized 22 byte log entry
0812 08:00:50.426632 (+    97us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:50.426647 (+    15us) write_op.cc:454] Released schema lock
0812 08:00:50.426653 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":378,"num_ops":1,"prepare.queue_time_us":830743,"prepare.run_cpu_time_us":615,"prepare.run_wall_time_us":902670,"replication_time_us":445840,"thread_start_us":85,"threads_started":1}]]}
I20260812 08:00:50.795279  2632 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:50.795441  2632 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:50.796077  2632 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:50.796700  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:50.796880  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:50.797381  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
W20260812 08:00:51.107865  2464 tablet_service.cc:3080] error setting up scanner d1a6f355b4a14f11970b8001e51f2ae8 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.311s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:00:51.247386  2626 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:51.249094  2651 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=3, attempt_no=0}) took 1629 ms. Trace:
I20260812 08:00:51.249193  2651 rpcz_store.cc:276] 0812 08:00:49.620008 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:49.620058 (+    50us) service_pool.cc:224] Handling call
0812 08:00:51.249077 (+1629019us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:49.979545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:49.979677 (+   132us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:49.979681 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:49.979683 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:49.979760 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:49.979769 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:49.979772 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:49.979814 (+    42us) tablet.cc:701] Row locks acquired
0812 08:00:49.979815 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:49.979856 (+    41us) write_op.cc:270] Start()
0812 08:00:50.056037 (+ 76181us) write_op.cc:276] Timestamp: P: 1786521649979782 usec, L: 0
0812 08:00:50.056040 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:00:50.056268 (+   228us) log.cc:844] Serialized 354 byte log entry
0812 08:00:51.248427 (+1192159us) op_driver.cc:464] REPLICATION: finished
0812 08:00:51.248684 (+   257us) write_op.cc:301] APPLY: starting
0812 08:00:51.248720 (+    36us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:51.248754 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:51.248776 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:51.248832 (+    56us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:51.248863 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:51.248867 (+     4us) write_op.cc:312] APPLY: finished
0812 08:00:51.248940 (+    73us) log.cc:844] Serialized 22 byte log entry
0812 08:00:51.249001 (+    61us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:51.249011 (+    10us) write_op.cc:454] Released schema lock
0812 08:00:51.249016 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":213,"num_ops":1,"prepare.queue_time_us":359050,"prepare.run_cpu_time_us":719,"prepare.run_wall_time_us":76802,"replication_time_us":1192350,"thread_start_us":88,"threads_started":1}]]}
I20260812 08:00:51.345192  2626 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:51.345410  2626 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:51.345983  2626 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:51.346508  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:51.346555  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:51.347090  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:51.347371  2626 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:51.750336  2632 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:00:52.192818  2464 tablet_service.cc:3080] error setting up scanner 017f33ebd70543d6b240c19a8e845289 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.441s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:00:52.223863  2632 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:52.224026  2632 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:52.224588  2632 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:52.225095  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:52.225162  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:52.225658  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:52.225845  2632 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:52.666767  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:52.666922  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:52.667887  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:52.668468  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:52.668684  2659 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=5, attempt_no=0}) took 1417 ms. Trace:
I20260812 08:00:52.668751  2659 rpcz_store.cc:276] 0812 08:00:51.250799 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:51.250883 (+    84us) service_pool.cc:224] Handling call
0812 08:00:52.668665 (+1417782us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:51.251333 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:51.251429 (+    96us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:51.251432 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:00:51.251433 (+     1us) tablet.cc:662] Decoding operations
0812 08:00:51.251486 (+    53us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:51.251492 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:51.251494 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:51.251525 (+    31us) tablet.cc:701] Row locks acquired
0812 08:00:51.251526 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:51.251554 (+    28us) write_op.cc:270] Start()
0812 08:00:51.916712 (+665158us) write_op.cc:276] Timestamp: P: 1786521651251508 usec, L: 0
0812 08:00:51.916714 (+     2us) op_driver.cc:348] REPLICATION: starting
0812 08:00:51.916935 (+   221us) log.cc:844] Serialized 354 byte log entry
0812 08:00:52.668075 (+751140us) op_driver.cc:464] REPLICATION: finished
0812 08:00:52.668264 (+   189us) write_op.cc:301] APPLY: starting
0812 08:00:52.668285 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:52.668316 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:52.668331 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:52.668395 (+    64us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:52.668424 (+    29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:52.668429 (+     5us) write_op.cc:312] APPLY: finished
0812 08:00:52.668500 (+    71us) log.cc:844] Serialized 22 byte log entry
0812 08:00:52.668559 (+    59us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:52.668575 (+    16us) write_op.cc:454] Released schema lock
0812 08:00:52.668580 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":125,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":593,"prepare.run_wall_time_us":665679,"replication_time_us":751321,"thread_start_us":68,"threads_started":1}]]}
I20260812 08:00:52.669692  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:52.670415  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:53.119993  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:53.121677  2659 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=6, attempt_no=0}) took 1773 ms. Trace:
I20260812 08:00:53.121790  2659 rpcz_store.cc:276] 0812 08:00:51.348265 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:51.348329 (+    64us) service_pool.cc:224] Handling call
0812 08:00:53.121652 (+1773323us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:51.917066 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:51.917246 (+   180us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:51.917251 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:00:51.917253 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:51.917336 (+    83us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:51.917347 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:51.917353 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:51.917400 (+    47us) tablet.cc:701] Row locks acquired
0812 08:00:51.917401 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:51.917436 (+    35us) write_op.cc:270] Start()
0812 08:00:51.948617 (+ 31181us) write_op.cc:276] Timestamp: P: 1786521651917379 usec, L: 0
0812 08:00:51.948622 (+     5us) op_driver.cc:348] REPLICATION: starting
0812 08:00:51.948835 (+   213us) log.cc:844] Serialized 354 byte log entry
0812 08:00:53.121072 (+1172237us) op_driver.cc:464] REPLICATION: finished
0812 08:00:53.121185 (+   113us) write_op.cc:301] APPLY: starting
0812 08:00:53.121206 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:53.121251 (+    45us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:53.121266 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:53.121326 (+    60us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:53.121353 (+    27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:53.121357 (+     4us) write_op.cc:312] APPLY: finished
0812 08:00:53.121417 (+    60us) log.cc:844] Serialized 22 byte log entry
0812 08:00:53.121546 (+   129us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:53.121559 (+    13us) write_op.cc:454] Released schema lock
0812 08:00:53.121566 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":59,"num_ops":1,"prepare.queue_time_us":568391,"prepare.run_cpu_time_us":746,"prepare.run_wall_time_us":31829,"replication_time_us":1172410}]]}
I20260812 08:00:53.229646  2632 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:53.229797  2632 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:53.230073  2509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.130:51911 (request call id 1679) took 1004 ms. Trace:
I20260812 08:00:53.230449  2632 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:53.230180  2509 rpcz_store.cc:276] 0812 08:00:52.225702 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:52.225771 (+    69us) service_pool.cc:224] Handling call
0812 08:00:52.225961 (+   190us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:00:52.226066 (+   105us) raft_consensus.cc:1534] Early marking committed up to index 0
0812 08:00:52.226071 (+     5us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:00:52.226230 (+   159us) write_op.cc:270] Start()
0812 08:00:52.696433 (+470203us) write_op.cc:276] Timestamp: P: 1786521651251508 usec, L: 0
0812 08:00:52.696838 (+   405us) write_op.cc:270] Start()
0812 08:00:53.228983 (+532145us) write_op.cc:276] Timestamp: P: 1786521651917379 usec, L: 0
0812 08:00:53.229416 (+   433us) log.cc:844] Serialized 708 byte log entry
0812 08:00:53.229527 (+   111us) raft_consensus.cc:1645] Marking committed up to 6
0812 08:00:53.229535 (+     8us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:00:53.229564 (+    29us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:00:53.230004 (+   440us) raft_consensus.cc:1685] finished
0812 08:00:53.230006 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:00:53.230054 (+    48us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:52.696766 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:52.696993 (+   227us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:52.696999 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:00:52.697000 (+     1us) tablet.cc:662] Decoding operations
0812 08:00:52.697143 (+   143us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:52.697154 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:52.697156 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:52.697198 (+    42us) tablet.cc:701] Row locks acquired
0812 08:00:52.697199 (+     1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:00:53.229301 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:53.229425 (+   124us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:53.229429 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:53.229431 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:53.229510 (+    79us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:53.229544 (+    34us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:53.229547 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:53.229719 (+   172us) tablet.cc:701] Row locks acquired
0812 08:00:53.229722 (+     3us) write_op.cc:260] PREPARE: finished
Metrics: {"spinlock_wait_cycles":17152,"thread_start_us":61,"threads_started":1,"wal-append.queue_time_us":141,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":574,"prepare.run_wall_time_us":574}],["op",{"num_ops":1,"partition_lock_wait_us":28,"prepare.queue_time_us":198,"prepare.run_cpu_time_us":442,"prepare.run_wall_time_us":513,"thread_start_us":105,"threads_started":1}]]}
I20260812 08:00:53.230733  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:53.231237  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:53.231626  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:53.231797  2632 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:53.830600  2632 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:53.830789  2632 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:53.831451  2632 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:53.831861  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:53.832073  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:53.832572  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:53.832917  2632 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:53.833155  2669 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=7, attempt_no=0}) took 1162 ms. Trace:
I20260812 08:00:53.833324  2669 rpcz_store.cc:276] 0812 08:00:52.670735 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:52.670779 (+    44us) service_pool.cc:224] Handling call
0812 08:00:53.833136 (+1162357us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:52.671345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:52.671484 (+   139us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:52.671488 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:52.671489 (+     1us) tablet.cc:662] Decoding operations
0812 08:00:52.671558 (+    69us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:52.671563 (+     5us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:52.671566 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:52.671596 (+    30us) tablet.cc:701] Row locks acquired
0812 08:00:52.671597 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:52.671627 (+    30us) write_op.cc:270] Start()
0812 08:00:53.560768 (+889141us) write_op.cc:276] Timestamp: P: 1786521652671602 usec, L: 0
0812 08:00:53.560774 (+     6us) op_driver.cc:348] REPLICATION: starting
0812 08:00:53.560945 (+   171us) log.cc:844] Serialized 354 byte log entry
0812 08:00:53.832314 (+271369us) op_driver.cc:464] REPLICATION: finished
0812 08:00:53.832628 (+   314us) write_op.cc:301] APPLY: starting
0812 08:00:53.832650 (+    22us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:53.832685 (+    35us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:53.832702 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:53.832773 (+    71us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:53.832803 (+    30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:53.832807 (+     4us) write_op.cc:312] APPLY: finished
0812 08:00:53.832888 (+    81us) log.cc:844] Serialized 22 byte log entry
0812 08:00:53.832958 (+    70us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:53.832975 (+    17us) write_op.cc:454] Released schema lock
0812 08:00:53.832981 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":253,"num_ops":1,"prepare.queue_time_us":189,"prepare.run_cpu_time_us":606,"prepare.run_wall_time_us":889661,"replication_time_us":271498,"thread_start_us":180,"threads_started":2}]]}
I20260812 08:00:54.147480  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:54.147640  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:54.148222  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:54.148623  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:54.148658  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:54.149338  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:54.149536  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:00:54.755160  2464 tablet_service.cc:3080] error setting up scanner 64a9979efd1a4f199a416aedf5ff5927 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.194s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:00:54.898674  2678 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:54.898845  2678 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:54.899483  2678 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:54.899909  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:54.900136  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:54.900585  2681 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=8, attempt_no=0}) took 1777 ms. Trace:
I20260812 08:00:54.900647  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:54.900839  2678 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:54.900655  2681 rpcz_store.cc:276] 0812 08:00:53.123400 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:53.123467 (+    67us) service_pool.cc:224] Handling call
0812 08:00:54.900567 (+1777100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:53.561052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:53.561174 (+   122us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:53.561178 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:53.561179 (+     1us) tablet.cc:662] Decoding operations
0812 08:00:53.561238 (+    59us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:53.561267 (+    29us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:53.561272 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:53.561314 (+    42us) tablet.cc:701] Row locks acquired
0812 08:00:53.561315 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:53.561355 (+    40us) write_op.cc:270] Start()
0812 08:00:54.467477 (+906122us) write_op.cc:276] Timestamp: P: 1786521653561279 usec, L: 0
0812 08:00:54.467480 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:00:54.467640 (+   160us) log.cc:844] Serialized 354 byte log entry
0812 08:00:54.899811 (+432171us) op_driver.cc:464] REPLICATION: finished
0812 08:00:54.900050 (+   239us) write_op.cc:301] APPLY: starting
0812 08:00:54.900068 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:54.900099 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:54.900113 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:54.900174 (+    61us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:54.900204 (+    30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:54.900208 (+     4us) write_op.cc:312] APPLY: finished
0812 08:00:54.900274 (+    66us) log.cc:844] Serialized 22 byte log entry
0812 08:00:54.900329 (+    55us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:54.900344 (+    15us) write_op.cc:454] Released schema lock
0812 08:00:54.900349 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":170,"num_ops":1,"prepare.queue_time_us":437165,"prepare.run_cpu_time_us":660,"prepare.run_wall_time_us":906716,"raft.queue_time_us":112,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":524,"replication_time_us":432292,"spinlock_wait_cycles":96512,"thread_start_us":77,"threads_started":1}]]}
W20260812 08:00:55.206112  2464 tablet_service.cc:3080] error setting up scanner 31de29af3f7e4267b6de74880126f6ad with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.305s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:00:55.223707  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:55.223869  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:55.224371  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:55.224886  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:55.224960  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:55.225440  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:55.231446  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:55.232957  2681 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=9, attempt_no=0}) took 1398 ms. Trace:
I20260812 08:00:55.233071  2681 rpcz_store.cc:276] 0812 08:00:53.834969 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:53.835059 (+    90us) service_pool.cc:224] Handling call
0812 08:00:55.232941 (+1397882us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:54.467804 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:54.467925 (+   121us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:54.467929 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:54.467931 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:54.468005 (+    74us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:54.468016 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:54.468032 (+    16us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:54.468078 (+    46us) tablet.cc:701] Row locks acquired
0812 08:00:54.468084 (+     6us) write_op.cc:260] PREPARE: finished
0812 08:00:54.468126 (+    42us) write_op.cc:270] Start()
0812 08:00:54.900270 (+432144us) write_op.cc:276] Timestamp: P: 1786521654468065 usec, L: 0
0812 08:00:54.900274 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:00:54.900426 (+   152us) log.cc:844] Serialized 354 byte log entry
0812 08:00:55.232402 (+331976us) op_driver.cc:464] REPLICATION: finished
0812 08:00:55.232523 (+   121us) write_op.cc:301] APPLY: starting
0812 08:00:55.232541 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:55.232578 (+    37us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:55.232594 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:55.232645 (+    51us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:55.232669 (+    24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:55.232672 (+     3us) write_op.cc:312] APPLY: finished
0812 08:00:55.232786 (+   114us) log.cc:844] Serialized 22 byte log entry
0812 08:00:55.232849 (+    63us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:55.232862 (+    13us) write_op.cc:454] Released schema lock
0812 08:00:55.232868 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":51,"num_ops":1,"prepare.queue_time_us":632261,"prepare.run_cpu_time_us":574,"prepare.run_wall_time_us":432663,"replication_time_us":332092}]]}
I20260812 08:00:55.587983  2678 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:55.588181  2678 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:55.588776  2678 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:55.589257  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:55.589324  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:55.589757  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:55.625782  2678 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:55.919705  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:55.919857  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:55.920398  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:55.920841  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:55.920885  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:55.921521  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:55.921780  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:56.312062  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:56.312256  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:56.312849  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:56.313365  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:56.313427  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:56.313951  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:56.314189  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:56.314476  2695 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=11, attempt_no=0}) took 1079 ms. Trace:
I20260812 08:00:56.314602  2695 rpcz_store.cc:276] 0812 08:00:55.234550 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:55.234625 (+    75us) service_pool.cc:224] Handling call
0812 08:00:56.314461 (+1079836us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:55.432901 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:55.433023 (+   122us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:55.433027 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:55.433029 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:55.433144 (+   115us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:55.433156 (+    12us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:55.433162 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:55.433210 (+    48us) tablet.cc:701] Row locks acquired
0812 08:00:55.433211 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:55.433277 (+    66us) write_op.cc:270] Start()
0812 08:00:56.243448 (+810171us) write_op.cc:276] Timestamp: P: 1786521655433198 usec, L: 0
0812 08:00:56.243452 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:00:56.243618 (+   166us) log.cc:844] Serialized 354 byte log entry
0812 08:00:56.313779 (+ 70161us) op_driver.cc:464] REPLICATION: finished
0812 08:00:56.313995 (+   216us) write_op.cc:301] APPLY: starting
0812 08:00:56.314010 (+    15us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:56.314061 (+    51us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:56.314077 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:56.314177 (+   100us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:56.314215 (+    38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:56.314221 (+     6us) write_op.cc:312] APPLY: finished
0812 08:00:56.314296 (+    75us) log.cc:844] Serialized 22 byte log entry
0812 08:00:56.314370 (+    74us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:56.314383 (+    13us) write_op.cc:454] Released schema lock
0812 08:00:56.314388 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":161,"num_ops":1,"prepare.queue_time_us":197846,"prepare.run_cpu_time_us":728,"prepare.run_wall_time_us":810805,"replication_time_us":70294,"thread_start_us":91,"threads_started":1}]]}
I20260812 08:00:56.840427  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:56.840652  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:56.841238  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:56.841678  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:56.841704  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:56.842296  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:57.054919  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:57.056849  2702 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=12, attempt_no=0}) took 1428 ms. Trace:
I20260812 08:00:57.056953  2702 rpcz_store.cc:276] 0812 08:00:55.628571 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:55.628658 (+    87us) service_pool.cc:224] Handling call
0812 08:00:57.056820 (+1428162us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:56.243748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:56.243878 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:56.243883 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:00:56.243884 (+     1us) tablet.cc:662] Decoding operations
0812 08:00:56.243958 (+    74us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:56.243967 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:56.243971 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:56.244021 (+    50us) tablet.cc:701] Row locks acquired
0812 08:00:56.244023 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:00:56.244093 (+    70us) write_op.cc:270] Start()
0812 08:00:56.798247 (+554154us) write_op.cc:276] Timestamp: P: 1786521656244050 usec, L: 0
0812 08:00:56.798250 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:00:56.798452 (+   202us) log.cc:844] Serialized 354 byte log entry
0812 08:00:57.056048 (+257596us) op_driver.cc:464] REPLICATION: finished
0812 08:00:57.056418 (+   370us) write_op.cc:301] APPLY: starting
0812 08:00:57.056438 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:57.056474 (+    36us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:57.056488 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:57.056540 (+    52us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:57.056564 (+    24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:57.056567 (+     3us) write_op.cc:312] APPLY: finished
0812 08:00:57.056626 (+    59us) log.cc:844] Serialized 22 byte log entry
0812 08:00:57.056724 (+    98us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:57.056737 (+    13us) write_op.cc:454] Released schema lock
0812 08:00:57.056743 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":252,"num_ops":1,"prepare.queue_time_us":614682,"prepare.run_cpu_time_us":718,"prepare.run_wall_time_us":554771,"replication_time_us":257737,"spinlock_wait_cycles":17792,"thread_start_us":158,"threads_started":1}]]}
I20260812 08:00:57.387409  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:57.387578  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:57.388187  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:57.388535  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:57.388669  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:57.389567  2702 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=13, attempt_no=0}) took 1073 ms. Trace:
I20260812 08:00:57.389645  2702 rpcz_store.cc:276] 0812 08:00:56.316130 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:56.316201 (+    71us) service_pool.cc:224] Handling call
0812 08:00:57.389555 (+1073354us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:56.798548 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:56.798680 (+   132us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:56.798684 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:56.798686 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:56.798762 (+    76us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:56.798774 (+    12us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:56.798777 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:56.798819 (+    42us) tablet.cc:701] Row locks acquired
0812 08:00:56.798821 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:00:56.798862 (+    41us) write_op.cc:270] Start()
0812 08:00:57.303065 (+504203us) write_op.cc:276] Timestamp: P: 1786521656798841 usec, L: 0
0812 08:00:57.303069 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:00:57.303266 (+   197us) log.cc:844] Serialized 354 byte log entry
0812 08:00:57.389039 (+ 85773us) op_driver.cc:464] REPLICATION: finished
0812 08:00:57.389166 (+   127us) write_op.cc:301] APPLY: starting
0812 08:00:57.389183 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:57.389232 (+    49us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:57.389246 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:57.389302 (+    56us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:57.389332 (+    30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:57.389336 (+     4us) write_op.cc:312] APPLY: finished
0812 08:00:57.389405 (+    69us) log.cc:844] Serialized 22 byte log entry
0812 08:00:57.389465 (+    60us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:57.389478 (+    13us) write_op.cc:454] Released schema lock
0812 08:00:57.389484 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":62,"num_ops":1,"prepare.queue_time_us":481982,"prepare.run_cpu_time_us":723,"prepare.run_wall_time_us":504806,"replication_time_us":85936,"spinlock_wait_cycles":2432}]]}
I20260812 08:00:57.390377  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:57.390552  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:57.748989  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:57.749138  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:57.749713  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:57.750253  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:57.750296  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:57.750797  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
W20260812 08:00:58.085462  2464 tablet_service.cc:3080] error setting up scanner ea3163e6de344b718a2173ce8042c517 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.696s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
W20260812 08:00:58.280507  2464 tablet_service.cc:3080] error setting up scanner fa0ef1030b80497fb89d20a2eff76191 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.891s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:00:58.362092  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:58.362347  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:58.362874  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:58.363549  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:58.364460  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:58.365061  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:58.365517  2709 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=14, attempt_no=0}) took 1307 ms. Trace:
I20260812 08:00:58.365715  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:58.365605  2709 rpcz_store.cc:276] 0812 08:00:57.058445 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:57.058511 (+    66us) service_pool.cc:224] Handling call
0812 08:00:58.365497 (+1306986us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:57.303388 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:57.303519 (+   131us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:57.303523 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:57.303525 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:57.303599 (+    74us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:57.303612 (+    13us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:57.303615 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:57.303671 (+    56us) tablet.cc:701] Row locks acquired
0812 08:00:57.303672 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:57.303709 (+    37us) write_op.cc:270] Start()
0812 08:00:57.672878 (+369169us) write_op.cc:276] Timestamp: P: 1786521657303670 usec, L: 0
0812 08:00:57.672882 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:00:57.673103 (+   221us) log.cc:844] Serialized 354 byte log entry
0812 08:00:58.364548 (+691445us) op_driver.cc:464] REPLICATION: finished
0812 08:00:58.364842 (+   294us) write_op.cc:301] APPLY: starting
0812 08:00:58.364902 (+    60us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:58.364940 (+    38us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:58.364984 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:58.365193 (+   209us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:58.365231 (+    38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:58.365239 (+     8us) write_op.cc:312] APPLY: finished
0812 08:00:58.365320 (+    81us) log.cc:844] Serialized 22 byte log entry
0812 08:00:58.365390 (+    70us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:58.365405 (+    15us) write_op.cc:454] Released schema lock
0812 08:00:58.365412 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":195,"num_ops":1,"prepare.queue_time_us":244480,"prepare.run_cpu_time_us":755,"prepare.run_wall_time_us":369809,"raft.queue_time_us":132,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":166,"replication_time_us":691630,"spinlock_wait_cycles":51584,"thread_start_us":93,"threads_started":1}]]}
I20260812 08:00:58.803937  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:58.804644  2199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.130:59215 (request call id 2900) took 1053 ms. Trace:
I20260812 08:00:58.804746  2199 rpcz_store.cc:276] 0812 08:00:57.750745 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:57.750824 (+    79us) service_pool.cc:224] Handling call
0812 08:00:57.750974 (+   150us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:00:57.751074 (+   100us) raft_consensus.cc:1534] Early marking committed up to index 14
0812 08:00:57.751234 (+   160us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:00:57.751372 (+   138us) write_op.cc:270] Start()
0812 08:00:57.847560 (+ 96188us) write_op.cc:276] Timestamp: P: 1786521656798841 usec, L: 0
0812 08:00:57.847972 (+   412us) write_op.cc:270] Start()
0812 08:00:58.803162 (+955190us) write_op.cc:276] Timestamp: P: 1786521657303670 usec, L: 0
0812 08:00:58.803612 (+   450us) log.cc:844] Serialized 708 byte log entry
0812 08:00:58.803738 (+   126us) raft_consensus.cc:1645] Marking committed up to 15
0812 08:00:58.803861 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:00:58.803889 (+    28us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:00:58.804572 (+   683us) raft_consensus.cc:1685] finished
0812 08:00:58.804574 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:00:58.804625 (+    51us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:57.847825 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:57.847955 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:57.847960 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:00:57.847961 (+     1us) tablet.cc:662] Decoding operations
0812 08:00:57.848046 (+    85us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:57.848060 (+    14us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:57.848062 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:57.848158 (+    96us) tablet.cc:701] Row locks acquired
0812 08:00:57.848159 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:58.803775 (+955616us) op_driver.cc:464] REPLICATION: finished
0812 08:00:58.803985 (+   210us) write_op.cc:301] APPLY: starting
0812 08:00:58.804004 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:58.804036 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:58.804038 (+     2us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:58.804091 (+    53us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:58.804126 (+    35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:58.804155 (+    29us) write_op.cc:312] APPLY: finished
0812 08:00:58.804217 (+    62us) log.cc:844] Serialized 22 byte log entry
0812 08:00:58.804282 (+    65us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:58.804302 (+    20us) write_op.cc:454] Released schema lock
0812 08:00:58.804307 (+     5us) write_op.cc:341] FINISH: Updating metrics
0812 08:00:58.804386 (+    79us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:58.804389 (+     3us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 08:00:58.803552 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:58.803664 (+   112us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:58.803668 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:00:58.803670 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:58.803736 (+    66us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:58.803811 (+    75us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:58.803815 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:58.803877 (+    62us) tablet.cc:701] Row locks acquired
0812 08:00:58.803881 (+     4us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":80,"threads_started":1,"wal-append.queue_time_us":404,"child_traces":[["op",{"apply.queue_time_us":163,"apply.run_cpu_time_us":393,"apply.run_wall_time_us":393,"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":93,"prepare.run_cpu_time_us":411,"prepare.run_wall_time_us":411,"replication_time_us":1052385,"thread_start_us":47,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":66,"prepare.queue_time_us":251,"prepare.run_cpu_time_us":415,"prepare.run_wall_time_us":415,"thread_start_us":103,"threads_started":1}]]}
I20260812 08:00:59.396905  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:59.397068  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:59.397670  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:00:59.398118  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:59.398554  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:00:59.398909  2718 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=15, attempt_no=0}) took 2007 ms. Trace:
I20260812 08:00:59.399065  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:00:59.399020  2718 rpcz_store.cc:276] 0812 08:00:57.391432 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:57.391541 (+   109us) service_pool.cc:224] Handling call
0812 08:00:59.398891 (+2007350us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:57.673235 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:57.673353 (+   118us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:57.673380 (+    27us) write_op.cc:435] Acquired schema lock
0812 08:00:57.673383 (+     3us) tablet.cc:662] Decoding operations
0812 08:00:57.673490 (+   107us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:57.673503 (+    13us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:57.673509 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:57.673588 (+    79us) tablet.cc:701] Row locks acquired
0812 08:00:57.673589 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:57.673629 (+    40us) write_op.cc:270] Start()
0812 08:00:58.485812 (+812183us) write_op.cc:276] Timestamp: P: 1786521657673556 usec, L: 0
0812 08:00:58.485816 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:00:58.486001 (+   185us) log.cc:844] Serialized 354 byte log entry
0812 08:00:59.398269 (+912268us) op_driver.cc:464] REPLICATION: finished
0812 08:00:59.398475 (+   206us) write_op.cc:301] APPLY: starting
0812 08:00:59.398492 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:59.398523 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:59.398538 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:59.398619 (+    81us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:59.398653 (+    34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:59.398669 (+    16us) write_op.cc:312] APPLY: finished
0812 08:00:59.398733 (+    64us) log.cc:844] Serialized 22 byte log entry
0812 08:00:59.398792 (+    59us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:59.398808 (+    16us) write_op.cc:454] Released schema lock
0812 08:00:59.398814 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":148,"num_ops":1,"prepare.queue_time_us":281283,"prepare.run_cpu_time_us":752,"prepare.run_wall_time_us":812838,"replication_time_us":912406,"thread_start_us":87,"threads_started":1}]]}
I20260812 08:00:59.617969  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:00:59.618149  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:00:59.618674  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:00:59.619100  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:00:59.619231  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:00:59.619771  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:00:59.660835  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:00:59.662295  2718 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=16, attempt_no=0}) took 1294 ms. Trace:
I20260812 08:00:59.662401  2718 rpcz_store.cc:276] 0812 08:00:58.367401 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:58.367472 (+    71us) service_pool.cc:224] Handling call
0812 08:00:59.662279 (+1294807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:58.486107 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:58.486273 (+   166us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:58.486278 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:00:58.486280 (+     2us) tablet.cc:662] Decoding operations
0812 08:00:58.486361 (+    81us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:58.486372 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:58.486377 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:58.486423 (+    46us) tablet.cc:701] Row locks acquired
0812 08:00:58.486426 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:00:58.486502 (+    76us) write_op.cc:270] Start()
0812 08:00:59.372688 (+886186us) write_op.cc:276] Timestamp: P: 1786521658486444 usec, L: 0
0812 08:00:59.372692 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:00:59.372921 (+   229us) log.cc:844] Serialized 354 byte log entry
0812 08:00:59.661697 (+288776us) op_driver.cc:464] REPLICATION: finished
0812 08:00:59.661814 (+   117us) write_op.cc:301] APPLY: starting
0812 08:00:59.661837 (+    23us) tablet.cc:1367] starting BulkCheckPresence
0812 08:00:59.661875 (+    38us) tablet.cc:1370] finished BulkCheckPresence
0812 08:00:59.661891 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:00:59.661950 (+    59us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:00:59.662018 (+    68us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:00:59.662024 (+     6us) write_op.cc:312] APPLY: finished
0812 08:00:59.662094 (+    70us) log.cc:844] Serialized 22 byte log entry
0812 08:00:59.662185 (+    91us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:00:59.662200 (+    15us) write_op.cc:454] Released schema lock
0812 08:00:59.662206 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":50,"num_ops":1,"prepare.queue_time_us":118206,"prepare.run_cpu_time_us":796,"prepare.run_wall_time_us":886875,"replication_time_us":288970}]]}
I20260812 08:01:00.337554  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:00.337734  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:00.338409  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:00.338841  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:00.338860  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:00.339358  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:00.339545  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:00.903903  2464 tablet_service.cc:3080] error setting up scanner b35b0ea34378422c8d3576871ea9f074 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.564s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:01:00.968482  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:00.968904  2199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.130:59215 (request call id 2902) took 1349 ms. Trace:
I20260812 08:01:00.968971  2199 rpcz_store.cc:276] 0812 08:00:59.619375 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:59.619424 (+    49us) service_pool.cc:224] Handling call
0812 08:00:59.619588 (+   164us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:00:59.619674 (+    86us) raft_consensus.cc:1534] Early marking committed up to index 17
0812 08:00:59.619873 (+   199us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:00:59.619967 (+    94us) write_op.cc:270] Start()
0812 08:01:00.408148 (+788181us) write_op.cc:276] Timestamp: P: 1786521658486444 usec, L: 0
0812 08:01:00.408603 (+   455us) write_op.cc:270] Start()
0812 08:01:00.967770 (+559167us) write_op.cc:276] Timestamp: P: 1786521659401250 usec, L: 0
0812 08:01:00.968233 (+   463us) log.cc:844] Serialized 708 byte log entry
0812 08:01:00.968367 (+   134us) raft_consensus.cc:1645] Marking committed up to 17
0812 08:01:00.968374 (+     7us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:01:00.968406 (+    32us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:01:00.968825 (+   419us) raft_consensus.cc:1685] finished
0812 08:01:00.968827 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:01:00.968881 (+    54us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:00.408576 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:00.408706 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:00.408710 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:00.408711 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:00.408774 (+    63us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:00.408786 (+    12us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:00.408788 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:00.408825 (+    37us) tablet.cc:701] Row locks acquired
0812 08:01:00.408826 (+     1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:01:00.968177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:00.968291 (+   114us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:00.968294 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:00.968296 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:00.968423 (+   127us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:00.968438 (+    15us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:00.968445 (+     7us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:00.968503 (+    58us) tablet.cc:701] Row locks acquired
0812 08:01:00.968506 (+     3us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":77,"threads_started":1,"wal-append.queue_time_us":143,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":263,"prepare.run_cpu_time_us":326,"prepare.run_wall_time_us":326,"thread_start_us":121,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":256,"prepare.run_cpu_time_us":423,"prepare.run_wall_time_us":423,"thread_start_us":108,"threads_started":1}]]}
I20260812 08:01:01.025853  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:01.026036  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:01.026577  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:01.026997  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:01.027119  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:01.027639  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:01.027782  2737 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=18, attempt_no=0}) took 1363 ms. Trace:
I20260812 08:01:01.027851  2737 rpcz_store.cc:276] 0812 08:00:59.663847 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:00:59.663924 (+    77us) service_pool.cc:224] Handling call
0812 08:01:01.027768 (+1363844us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:00:59.664318 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:00:59.664411 (+    93us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:00:59.664413 (+     2us) write_op.cc:435] Acquired schema lock
0812 08:00:59.664414 (+     1us) tablet.cc:662] Decoding operations
0812 08:00:59.664467 (+    53us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:00:59.664473 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:00:59.664475 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:00:59.664502 (+    27us) tablet.cc:701] Row locks acquired
0812 08:00:59.664503 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:00:59.664532 (+    29us) write_op.cc:270] Start()
0812 08:01:00.069722 (+405190us) write_op.cc:276] Timestamp: P: 1786521659664475 usec, L: 0
0812 08:01:00.069726 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:00.069946 (+   220us) log.cc:844] Serialized 354 byte log entry
0812 08:01:01.027037 (+957091us) op_driver.cc:464] REPLICATION: finished
0812 08:01:01.027299 (+   262us) write_op.cc:301] APPLY: starting
0812 08:01:01.027319 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:01.027353 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:01.027369 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:01.027437 (+    68us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:01.027472 (+    35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:01.027476 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:01.027548 (+    72us) log.cc:844] Serialized 22 byte log entry
0812 08:01:01.027664 (+   116us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:01.027679 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:01.027685 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":201,"num_ops":1,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":618,"prepare.run_wall_time_us":405695,"replication_time_us":957275,"thread_start_us":120,"threads_started":1}]]}
I20260812 08:01:01.045828  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:01.267087  2655 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:01.267244  2655 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:01.267709  2655 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:01.268249  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:01.268278  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:01.268780  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:01.268986  2655 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:01.333917  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:01.334056  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:01.334628  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:01.335053  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:01.335137  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:01.335584  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:01.336001  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:02.058642  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:02.058826  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:02.059386  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:02.059942  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:02.059986  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:02.060560  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:02.630501  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:02.632500  2751 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=20, attempt_no=0}) took 1603 ms. Trace:
I20260812 08:01:02.632712  2751 rpcz_store.cc:276] 0812 08:01:01.029324 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:01.029388 (+    64us) service_pool.cc:224] Handling call
0812 08:01:02.632481 (+1603093us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:01.029883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:01.029990 (+   107us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:01.029993 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:01.029994 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:01.030047 (+    53us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:01.030052 (+     5us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:01.030054 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:01.030084 (+    30us) tablet.cc:701] Row locks acquired
0812 08:01:01.030085 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:01.030114 (+    29us) write_op.cc:270] Start()
0812 08:01:02.021334 (+991220us) write_op.cc:276] Timestamp: P: 1786521661030069 usec, L: 0
0812 08:01:02.021337 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:02.021495 (+   158us) log.cc:844] Serialized 354 byte log entry
0812 08:01:02.631831 (+610336us) op_driver.cc:464] REPLICATION: finished
0812 08:01:02.632089 (+   258us) write_op.cc:301] APPLY: starting
0812 08:01:02.632106 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:02.632133 (+    27us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:02.632167 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:02.632231 (+    64us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:02.632259 (+    28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:02.632263 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:02.632328 (+    65us) log.cc:844] Serialized 22 byte log entry
0812 08:01:02.632386 (+    58us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:02.632399 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:02.632405 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":195,"num_ops":1,"prepare.queue_time_us":75,"prepare.run_cpu_time_us":628,"prepare.run_wall_time_us":991711,"raft.queue_time_us":62,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"replication_time_us":610452,"thread_start_us":107,"threads_started":1}]]}
I20260812 08:01:02.643149  2742 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:02.643296  2742 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:02.643982  2742 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:02.644492  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:02.644582  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:02.645023  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
W20260812 08:01:02.890704  2464 tablet_service.cc:3080] error setting up scanner cbf21fb71aaa4748979056e9fa556bb8 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.258s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:01:03.276901  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:03.277076  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:03.277902  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:03.278353  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:03.278494  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:03.279258  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:03.279443  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:03.279810  2761 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=21, attempt_no=0}) took 2231 ms. Trace:
I20260812 08:01:03.279902  2761 rpcz_store.cc:276] 0812 08:01:01.048580 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:01.048647 (+    67us) service_pool.cc:224] Handling call
0812 08:01:03.279792 (+2231145us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:02.021628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:02.021757 (+   129us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:02.021762 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:02.021764 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:02.021844 (+    80us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:02.021857 (+    13us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:02.021862 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:02.021909 (+    47us) tablet.cc:701] Row locks acquired
0812 08:01:02.021911 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:02.021954 (+    43us) write_op.cc:270] Start()
0812 08:01:02.061086 (+ 39132us) write_op.cc:276] Timestamp: P: 1786521662021890 usec, L: 0
0812 08:01:02.061089 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:02.061302 (+   213us) log.cc:844] Serialized 354 byte log entry
0812 08:01:03.278715 (+1217413us) op_driver.cc:464] REPLICATION: finished
0812 08:01:03.279210 (+   495us) write_op.cc:301] APPLY: starting
0812 08:01:03.279227 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:03.279253 (+    26us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:03.279268 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:03.279325 (+    57us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:03.279353 (+    28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:03.279357 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:03.279421 (+    64us) log.cc:844] Serialized 22 byte log entry
0812 08:01:03.279716 (+   295us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:03.279727 (+    11us) write_op.cc:454] Released schema lock
0812 08:01:03.279732 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":423,"num_ops":1,"prepare.queue_time_us":972607,"prepare.run_cpu_time_us":687,"prepare.run_wall_time_us":39754,"replication_time_us":1217092,"thread_start_us":98,"threads_started":1}]]}
I20260812 08:01:03.409204  2742 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:03.599439  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:03.599624  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:03.600241  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:03.600668  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:03.600708  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:03.601229  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:03.877363  2742 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:03.877537  2742 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:03.878172  2742 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:03.878719  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:03.878846  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:03.879339  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:03.879522  2742 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:03.978238  2464 tablet_service.cc:3080] error setting up scanner 97bcae650f83478395d563cc5ff41995 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.377s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:01:04.224543  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:04.307946  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:04.308109  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:04.308753  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:04.309315  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:04.309315  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:04.309792  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:04.310113  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:04.424026  2742 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:04.424196  2742 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:04.424754  2742 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:04.425117  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:04.425195  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:04.425621  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:04.425844  2742 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:05.076134  2742 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:05.076318  2742 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:05.076860  2742 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:05.077419  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:05.077487  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:05.077972  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:05.185148  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:05.185325  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:05.185906  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:05.186347  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:05.186408  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:05.186866  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
W20260812 08:01:05.452898  2464 tablet_service.cc:3080] error setting up scanner 21934a9fbe6142d48edb0c80982a8556 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.266s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:01:05.733129  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:05.735155  2782 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=26, attempt_no=0}) took 1424 ms. Trace:
I20260812 08:01:05.735286  2782 rpcz_store.cc:276] 0812 08:01:04.310768 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:04.310838 (+    70us) service_pool.cc:224] Handling call
0812 08:01:05.735131 (+1424293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:04.735502 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:04.735624 (+   122us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:04.735628 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:04.735630 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:04.735706 (+    76us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:04.735718 (+    12us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:04.735724 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:04.735793 (+    69us) tablet.cc:701] Row locks acquired
0812 08:01:04.735794 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:04.735851 (+    57us) write_op.cc:270] Start()
0812 08:01:04.752015 (+ 16164us) write_op.cc:276] Timestamp: P: 1786521664735775 usec, L: 0
0812 08:01:04.752019 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:04.752262 (+   243us) log.cc:844] Serialized 354 byte log entry
0812 08:01:05.734474 (+982212us) op_driver.cc:464] REPLICATION: finished
0812 08:01:05.734669 (+   195us) write_op.cc:301] APPLY: starting
0812 08:01:05.734687 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:05.734745 (+    58us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:05.734767 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:05.734832 (+    65us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:05.734863 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:05.734868 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:05.734940 (+    72us) log.cc:844] Serialized 22 byte log entry
0812 08:01:05.735028 (+    88us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:05.735042 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:05.735048 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":138,"num_ops":1,"prepare.queue_time_us":424331,"prepare.run_cpu_time_us":767,"prepare.run_wall_time_us":16843,"replication_time_us":982423,"thread_start_us":87,"threads_started":1}]]}
I20260812 08:01:05.823336  2742 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:06.144289  2742 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:06.144431  2742 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:06.145011  2742 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:06.145473  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:06.145561  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:06.146013  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:06.146209  2742 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:06.569787  2742 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:06.569931  2742 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:06.570544  2742 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:06.571213  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:06.571257  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:06.571725  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:06.572635  2742 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:06.595537  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:06.595674  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:06.596189  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:06.596546  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:06.596616  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:06.597033  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:06.597204  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:06.906441  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:06.906577  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:06.907120  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:06.907431  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:06.907464  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:06.907917  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:06.908102  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:07.333587  2790 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:07.333765  2790 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:07.334388  2790 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:07.334882  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:07.334960  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:07.335470  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:07.335616  2790 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:07.335739  2792 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=29, attempt_no=0}) took 1187 ms. Trace:
I20260812 08:01:07.335863  2792 rpcz_store.cc:276] 0812 08:01:06.148029 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:06.148110 (+    81us) service_pool.cc:224] Handling call
0812 08:01:07.335725 (+1187615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:06.309352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:06.309529 (+   177us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:06.309534 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:06.309536 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:06.309617 (+    81us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:06.309638 (+    21us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:06.309643 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:06.309721 (+    78us) tablet.cc:701] Row locks acquired
0812 08:01:06.309722 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:06.309771 (+    49us) write_op.cc:270] Start()
0812 08:01:07.282904 (+973133us) write_op.cc:276] Timestamp: P: 1786521666309701 usec, L: 0
0812 08:01:07.282907 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:07.283140 (+   233us) log.cc:844] Serialized 354 byte log entry
0812 08:01:07.334632 (+ 51492us) op_driver.cc:464] REPLICATION: finished
0812 08:01:07.334969 (+   337us) write_op.cc:301] APPLY: starting
0812 08:01:07.334987 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:07.335017 (+    30us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:07.335041 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:07.335399 (+   358us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:07.335430 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:07.335456 (+    26us) write_op.cc:312] APPLY: finished
0812 08:01:07.335541 (+    85us) log.cc:844] Serialized 22 byte log entry
0812 08:01:07.335630 (+    89us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:07.335645 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:07.335651 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":282,"mutex_wait_us":32,"num_ops":1,"prepare.queue_time_us":160851,"prepare.run_cpu_time_us":847,"prepare.run_wall_time_us":973926,"raft.queue_time_us":173,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":51690,"spinlock_wait_cycles":78720,"thread_start_us":104,"threads_started":1}]]}
I20260812 08:01:07.557235  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:07.557412  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:07.558029  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:07.558461  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:07.559141  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:07.562999  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:07.563699  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:07.809566  2790 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:07.809748  2790 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:07.810110  2790 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:07.810575  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:07.811226  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:07.811741  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:07.811969  2790 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:07.981221  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:07.981370  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:07.981896  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:07.982350  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:07.986505  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:07.987030  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:07.987236  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:08.271376  2464 tablet_service.cc:3080] error setting up scanner 132a8d7a18e049189acd085a80ee7da4 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.712s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:01:08.343875  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:08.344026  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:08.344591  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:08.344966  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:08.345171  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:08.345589  2797 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=30, attempt_no=0}) took 1772 ms. Trace:
I20260812 08:01:08.345747  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:08.345708  2797 rpcz_store.cc:276] 0812 08:01:06.573105 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:06.573169 (+    64us) service_pool.cc:224] Handling call
0812 08:01:08.345562 (+1772393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:07.283308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:07.283451 (+   143us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:07.283455 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:07.283457 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:07.283530 (+    73us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:07.283541 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:07.283547 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:07.283595 (+    48us) tablet.cc:701] Row locks acquired
0812 08:01:07.283596 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:07.283652 (+    56us) write_op.cc:270] Start()
0812 08:01:08.069784 (+786132us) write_op.cc:276] Timestamp: P: 1786521667283589 usec, L: 0
0812 08:01:08.069788 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:08.069976 (+   188us) log.cc:844] Serialized 354 byte log entry
0812 08:01:08.344931 (+274955us) op_driver.cc:464] REPLICATION: finished
0812 08:01:08.345182 (+   251us) write_op.cc:301] APPLY: starting
0812 08:01:08.345199 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:08.345229 (+    30us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:08.345242 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:08.345319 (+    77us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:08.345346 (+    27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:08.345352 (+     6us) write_op.cc:312] APPLY: finished
0812 08:01:08.345419 (+    67us) log.cc:844] Serialized 22 byte log entry
0812 08:01:08.345474 (+    55us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:08.345488 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:08.345493 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":201,"num_ops":1,"prepare.queue_time_us":709787,"prepare.run_cpu_time_us":712,"prepare.run_wall_time_us":786766,"raft.queue_time_us":81,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":272,"replication_time_us":275111,"spinlock_wait_cycles":68352,"thread_start_us":87,"threads_started":1}]]}
I20260812 08:01:08.346045  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:08.802102  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:08.802284  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:08.802860  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:08.803294  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:08.803459  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:08.803584  2797 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=31, attempt_no=0}) took 1466 ms. Trace:
I20260812 08:01:08.803687  2797 rpcz_store.cc:276] 0812 08:01:07.337421 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:07.337493 (+    72us) service_pool.cc:224] Handling call
0812 08:01:08.803572 (+1466079us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:08.070102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:08.070257 (+   155us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:08.070261 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:08.070263 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:08.070335 (+    72us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:08.070345 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:08.070349 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:08.070392 (+    43us) tablet.cc:701] Row locks acquired
0812 08:01:08.070393 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:08.070440 (+    47us) write_op.cc:270] Start()
0812 08:01:08.529616 (+459176us) write_op.cc:276] Timestamp: P: 1786521668070403 usec, L: 0
0812 08:01:08.529619 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:08.529820 (+   201us) log.cc:844] Serialized 354 byte log entry
0812 08:01:08.803068 (+273248us) op_driver.cc:464] REPLICATION: finished
0812 08:01:08.803208 (+   140us) write_op.cc:301] APPLY: starting
0812 08:01:08.803227 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:08.803260 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:08.803272 (+    12us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:08.803334 (+    62us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:08.803363 (+    29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:08.803367 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:08.803432 (+    65us) log.cc:844] Serialized 22 byte log entry
0812 08:01:08.803483 (+    51us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:08.803494 (+    11us) write_op.cc:454] Released schema lock
0812 08:01:08.803499 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":76,"num_ops":1,"prepare.queue_time_us":732233,"prepare.run_cpu_time_us":728,"prepare.run_wall_time_us":459786,"replication_time_us":273394}]]}
I20260812 08:01:08.804337  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:08.805016  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:08.844408  2464 tablet_service.cc:3080] error setting up scanner b2a25cfdbac24c1dbbf2b7b68e110ab9 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.314s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:01:09.065339  2790 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:09.065510  2790 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:09.066105  2790 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:09.066587  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:09.066717  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:09.067451  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:09.103164  2790 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:09.280745  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:09.280912  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:09.281381  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:09.281855  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:09.281852  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:09.282636  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:09.283339  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:09.792659  2790 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:09.792834  2790 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:09.793372  2790 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:09.793781  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:09.793906  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:09.794312  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:10.181253  2693 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:10.181417  2693 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:10.182053  2693 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:10.182451  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:10.182538  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:10.183178  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:10.183971  2807 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=33, attempt_no=0}) took 1378 ms. Trace:
I20260812 08:01:10.184065  2807 rpcz_store.cc:276] 0812 08:01:08.805665 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:08.805732 (+    67us) service_pool.cc:224] Handling call
0812 08:01:10.183953 (+1378221us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:09.253715 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:09.253843 (+   128us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:09.253847 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:09.253849 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:09.253926 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:09.253937 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:09.253940 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:09.253985 (+    45us) tablet.cc:701] Row locks acquired
0812 08:01:09.253986 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:09.254057 (+    71us) write_op.cc:270] Start()
0812 08:01:09.457223 (+203166us) write_op.cc:276] Timestamp: P: 1786521669253993 usec, L: 0
0812 08:01:09.457227 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:09.457435 (+   208us) log.cc:844] Serialized 354 byte log entry
0812 08:01:10.183080 (+725645us) op_driver.cc:464] REPLICATION: finished
0812 08:01:10.183474 (+   394us) write_op.cc:301] APPLY: starting
0812 08:01:10.183490 (+    16us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:10.183569 (+    79us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:10.183583 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:10.183648 (+    65us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:10.183680 (+    32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:10.183683 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:10.183783 (+   100us) log.cc:844] Serialized 22 byte log entry
0812 08:01:10.183843 (+    60us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:10.183856 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:10.183862 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":329,"num_ops":1,"prepare.queue_time_us":447569,"prepare.run_cpu_time_us":720,"prepare.run_wall_time_us":203812,"raft.queue_time_us":270,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":725625,"thread_start_us":99,"threads_started":1}]]}
I20260812 08:01:10.354437  2693 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:10.356098  2807 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=34, attempt_no=0}) took 1072 ms. Trace:
I20260812 08:01:10.356215  2807 rpcz_store.cc:276] 0812 08:01:09.283641 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:09.283706 (+    65us) service_pool.cc:224] Handling call
0812 08:01:10.356066 (+1072360us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:09.457562 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:09.457664 (+   102us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:09.457668 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:09.457669 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:09.457727 (+    58us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:09.457758 (+    31us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:09.457764 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:09.457807 (+    43us) tablet.cc:701] Row locks acquired
0812 08:01:09.457809 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:09.457853 (+    44us) write_op.cc:270] Start()
0812 08:01:10.102043 (+644190us) write_op.cc:276] Timestamp: P: 1786521669457779 usec, L: 0
0812 08:01:10.102047 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:10.102298 (+   251us) log.cc:844] Serialized 354 byte log entry
0812 08:01:10.355468 (+253170us) op_driver.cc:464] REPLICATION: finished
0812 08:01:10.355581 (+   113us) write_op.cc:301] APPLY: starting
0812 08:01:10.355603 (+    22us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:10.355650 (+    47us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:10.355686 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:10.355755 (+    69us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:10.355791 (+    36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:10.355796 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:10.355870 (+    74us) log.cc:844] Serialized 22 byte log entry
0812 08:01:10.355966 (+    96us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:10.355979 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:10.355984 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":47,"num_ops":1,"prepare.queue_time_us":173566,"prepare.run_cpu_time_us":719,"prepare.run_wall_time_us":644800,"replication_time_us":253382}]]}
I20260812 08:01:10.385622  2790 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:11.200716  2790 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:11.200867  2790 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:11.201390  2790 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:11.201390  2815 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:11.201502  2815 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:11.202024  2815 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:11.202176  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:11.202339  2510 raft_consensus.cc:2410] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c7ad63e416f4fe090d01f6eb74c9559 for term 2 because replica has last-logged OpId of term: 1 index: 37, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 36.
I20260812 08:01:11.202709  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:11.202734  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:11.203208  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:11.203619  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:11.204000  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:11.204322  2815 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:11.204388  2820 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=35, attempt_no=0}) took 1018 ms. Trace:
I20260812 08:01:11.204456  2820 rpcz_store.cc:276] 0812 08:01:10.185503 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:10.185600 (+    97us) service_pool.cc:224] Handling call
0812 08:01:11.204373 (+1018773us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:10.186120 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:10.186262 (+   142us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:10.186266 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:10.186267 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:10.186328 (+    61us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:10.186335 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:10.186337 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:10.186369 (+    32us) tablet.cc:701] Row locks acquired
0812 08:01:10.186370 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:10.186411 (+    41us) write_op.cc:270] Start()
0812 08:01:11.024557 (+838146us) write_op.cc:276] Timestamp: P: 1786521670186367 usec, L: 0
0812 08:01:11.024560 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:11.024722 (+   162us) log.cc:844] Serialized 354 byte log entry
0812 08:01:11.203559 (+178837us) op_driver.cc:464] REPLICATION: finished
0812 08:01:11.203888 (+   329us) write_op.cc:301] APPLY: starting
0812 08:01:11.203903 (+    15us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:11.203930 (+    27us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:11.203945 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:11.204000 (+    55us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:11.204028 (+    28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:11.204033 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:11.204091 (+    58us) log.cc:844] Serialized 22 byte log entry
0812 08:01:11.204293 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:11.204305 (+    12us) write_op.cc:454] Released schema lock
0812 08:01:11.204310 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":281,"num_ops":1,"prepare.queue_time_us":71,"prepare.run_cpu_time_us":610,"prepare.run_wall_time_us":838687,"raft.queue_time_us":62,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"replication_time_us":178967,"thread_start_us":104,"threads_started":1}]]}
I20260812 08:01:12.118077  2815 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:12.118304  2815 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:12.118839  2815 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:12.119364  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:12.119479  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:12.119958  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:12.120606  2825 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=36, attempt_no=0}) took 1762 ms. Trace:
I20260812 08:01:12.120689  2825 rpcz_store.cc:276] 0812 08:01:10.357849 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:10.357910 (+    61us) service_pool.cc:224] Handling call
0812 08:01:12.120573 (+1762663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:11.024832 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:11.024943 (+   111us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:11.024947 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:11.024948 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:11.025011 (+    63us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:11.025018 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:11.025048 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:11.025112 (+    64us) tablet.cc:701] Row locks acquired
0812 08:01:11.025113 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:11.025161 (+    48us) write_op.cc:270] Start()
0812 08:01:11.476298 (+451137us) write_op.cc:276] Timestamp: P: 1786521671025112 usec, L: 0
0812 08:01:11.476302 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:11.476452 (+   150us) log.cc:844] Serialized 354 byte log entry
0812 08:01:12.119837 (+643385us) op_driver.cc:464] REPLICATION: finished
0812 08:01:12.120152 (+   315us) write_op.cc:301] APPLY: starting
0812 08:01:12.120172 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:12.120207 (+    35us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:12.120221 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:12.120284 (+    63us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:12.120310 (+    26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:12.120313 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:12.120402 (+    89us) log.cc:844] Serialized 22 byte log entry
0812 08:01:12.120471 (+    69us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:12.120485 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:12.120490 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":257,"num_ops":1,"prepare.queue_time_us":666422,"prepare.run_cpu_time_us":748,"prepare.run_wall_time_us":451812,"raft.queue_time_us":153,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":643242,"spinlock_wait_cycles":62720,"thread_start_us":69,"threads_started":1}]]}
I20260812 08:01:12.147606  2790 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:12.430655  2464 tablet_service.cc:3080] error setting up scanner 598fdb7fec464fc4b92d66ec8495aa23 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.310s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:01:12.800943  2790 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:12.801096  2790 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:12.801746  2790 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:12.802250  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:12.802384  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:12.802826  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:12.803031  2790 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:12.803511  2833 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=37, attempt_no=0}) took 1597 ms. Trace:
I20260812 08:01:12.803589  2833 rpcz_store.cc:276] 0812 08:01:11.205939 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:11.206017 (+    78us) service_pool.cc:224] Handling call
0812 08:01:12.803495 (+1597478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:11.476681 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:11.476831 (+   150us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:11.476836 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:11.476838 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:11.476937 (+    99us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:11.476946 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:11.476950 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:11.476995 (+    45us) tablet.cc:701] Row locks acquired
0812 08:01:11.476996 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:11.477031 (+    35us) write_op.cc:270] Start()
0812 08:01:11.878246 (+401215us) write_op.cc:276] Timestamp: P: 1786521671476948 usec, L: 0
0812 08:01:11.878250 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:11.878457 (+   207us) log.cc:844] Serialized 354 byte log entry
0812 08:01:12.802563 (+924106us) op_driver.cc:464] REPLICATION: finished
0812 08:01:12.802888 (+   325us) write_op.cc:301] APPLY: starting
0812 08:01:12.802929 (+    41us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:12.802958 (+    29us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:12.802972 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:12.803258 (+   286us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:12.803285 (+    27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:12.803289 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:12.803341 (+    52us) log.cc:844] Serialized 22 byte log entry
0812 08:01:12.803388 (+    47us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:12.803398 (+    10us) write_op.cc:454] Released schema lock
0812 08:01:12.803402 (+     4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":272,"num_ops":1,"prepare.queue_time_us":270146,"prepare.run_cpu_time_us":725,"prepare.run_wall_time_us":401843,"replication_time_us":924281,"thread_start_us":93,"threads_started":1}]]}
W20260812 08:01:12.881685  2464 tablet_service.cc:3080] error setting up scanner 2cdf739c2fed49269a6006200daca3f8 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.761s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:01:12.904409  2815 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:13.249366  2790 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:13.249543  2790 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:13.250098  2790 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:13.250649  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:13.250707  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:13.251036  2833 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=38, attempt_no=0}) took 1129 ms. Trace:
I20260812 08:01:13.251151  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:13.251125  2833 rpcz_store.cc:276] 0812 08:01:12.122010 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:12.122198 (+   188us) service_pool.cc:224] Handling call
0812 08:01:13.251023 (+1128825us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:12.122633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:12.122739 (+   106us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:12.122742 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:12.122743 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:12.122799 (+    56us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:12.122805 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:12.122807 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:12.122838 (+    31us) tablet.cc:701] Row locks acquired
0812 08:01:12.122838 (+     0us) write_op.cc:260] PREPARE: finished
0812 08:01:12.122867 (+    29us) write_op.cc:270] Start()
0812 08:01:12.692043 (+569176us) write_op.cc:276] Timestamp: P: 1786521672122831 usec, L: 0
0812 08:01:12.692047 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:12.692272 (+   225us) log.cc:844] Serialized 354 byte log entry
0812 08:01:13.250520 (+558248us) op_driver.cc:464] REPLICATION: finished
0812 08:01:13.250626 (+   106us) write_op.cc:301] APPLY: starting
0812 08:01:13.250646 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:13.250680 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:13.250699 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:13.250761 (+    62us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:13.250793 (+    32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:13.250797 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:13.250880 (+    83us) log.cc:844] Serialized 22 byte log entry
0812 08:01:13.250935 (+    55us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:13.250947 (+    12us) write_op.cc:454] Released schema lock
0812 08:01:13.250953 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":56,"num_ops":1,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":623,"prepare.run_wall_time_us":569702,"replication_time_us":558437}]]}
I20260812 08:01:13.559499  2815 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:13.559713  2815 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:13.560341  2815 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:13.560848  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:13.561096  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:13.561601  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:13.922274  2790 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:13.924093  2842 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=39, attempt_no=0}) took 1119 ms. Trace:
I20260812 08:01:13.924199  2842 rpcz_store.cc:276] 0812 08:01:12.804997 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:12.805037 (+    40us) service_pool.cc:224] Handling call
0812 08:01:13.924077 (+1119040us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:12.805399 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:12.805527 (+   128us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:12.805532 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:12.805536 (+     4us) tablet.cc:662] Decoding operations
0812 08:01:12.805607 (+    71us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:12.805614 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:12.805616 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:12.805645 (+    29us) tablet.cc:701] Row locks acquired
0812 08:01:12.805645 (+     0us) write_op.cc:260] PREPARE: finished
0812 08:01:12.805672 (+    27us) write_op.cc:270] Start()
0812 08:01:13.020871 (+215199us) write_op.cc:276] Timestamp: P: 1786521672805623 usec, L: 0
0812 08:01:13.020876 (+     5us) op_driver.cc:348] REPLICATION: starting
0812 08:01:13.021195 (+   319us) log.cc:844] Serialized 354 byte log entry
0812 08:01:13.923399 (+902204us) op_driver.cc:464] REPLICATION: finished
0812 08:01:13.923642 (+   243us) write_op.cc:301] APPLY: starting
0812 08:01:13.923661 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:13.923701 (+    40us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:13.923716 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:13.923791 (+    75us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:13.923824 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:13.923827 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:13.923927 (+   100us) log.cc:844] Serialized 22 byte log entry
0812 08:01:13.923987 (+    60us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:13.924000 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:13.924005 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":173,"num_ops":1,"prepare.queue_time_us":52,"prepare.run_cpu_time_us":785,"prepare.run_wall_time_us":215871,"replication_time_us":902466,"thread_start_us":77,"threads_started":1}]]}
I20260812 08:01:14.086700  2815 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:14.253058  2790 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:14.253271  2790 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:14.253849  2790 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:14.254793  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:14.254890  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:14.255270  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:14.254809  2842 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=40, attempt_no=0}) took 1002 ms. Trace:
I20260812 08:01:14.255367  2842 rpcz_store.cc:276] 0812 08:01:13.252634 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:13.252730 (+    96us) service_pool.cc:224] Handling call
0812 08:01:14.254793 (+1002063us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:13.253242 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:13.253351 (+   109us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:13.253354 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:13.253355 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:13.253414 (+    59us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:13.253420 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:13.253423 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:13.253457 (+    34us) tablet.cc:701] Row locks acquired
0812 08:01:13.253458 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:13.253489 (+    31us) write_op.cc:270] Start()
0812 08:01:13.823662 (+570173us) write_op.cc:276] Timestamp: P: 1786521673253443 usec, L: 0
0812 08:01:13.823666 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:13.823879 (+   213us) log.cc:844] Serialized 354 byte log entry
0812 08:01:14.254262 (+430383us) op_driver.cc:464] REPLICATION: finished
0812 08:01:14.254370 (+   108us) write_op.cc:301] APPLY: starting
0812 08:01:14.254387 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:14.254418 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:14.254433 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:14.254491 (+    58us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:14.254525 (+    34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:14.254530 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:14.254607 (+    77us) log.cc:844] Serialized 22 byte log entry
0812 08:01:14.254700 (+    93us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:14.254713 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:14.254719 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":64,"num_ops":1,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":661,"prepare.run_wall_time_us":570734,"replication_time_us":430560}]]}
I20260812 08:01:14.255559  2790 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:14.574787  2815 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:14.574935  2815 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:14.575508  2815 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:14.575894  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:14.576442  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:14.576900  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:14.577291  2815 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:14.804227  2815 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:14.804385  2815 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:14.804973  2815 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:14.805644  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:14.805923  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:14.806401  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:14.806576  2815 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:15.300580  2846 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:15.300738  2846 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:15.301357  2846 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:15.301824  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:15.302222  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:15.302577  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:15.302874  2846 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:15.504879  2464 tablet_service.cc:3080] error setting up scanner 2bbe5a23a1684adb8e45dc564e379386 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.699s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "7957484def364b5ba5aa65f3fe14435d"
I20260812 08:01:15.570559  2846 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:15.570739  2846 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:15.571260  2846 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:15.571708  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:15.571741  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:15.572266  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:15.572468  2846 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:16.063619  2846 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:16.063787  2846 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:16.064349  2846 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:16.064682  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:16.064831  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:16.065337  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:16.065510  2846 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:16.065497  2855 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=42, attempt_no=0}) took 1808 ms. Trace:
I20260812 08:01:16.065570  2855 rpcz_store.cc:276] 0812 08:01:14.256864 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:14.256939 (+    75us) service_pool.cc:224] Handling call
0812 08:01:16.065480 (+1808541us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:14.782996 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:14.783132 (+   136us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:14.783138 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:01:14.783142 (+     4us) tablet.cc:662] Decoding operations
0812 08:01:14.783217 (+    75us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:14.783226 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:14.783229 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:14.783274 (+    45us) tablet.cc:701] Row locks acquired
0812 08:01:14.783276 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:14.783317 (+    41us) write_op.cc:270] Start()
0812 08:01:15.637453 (+854136us) write_op.cc:276] Timestamp: P: 1786521674783280 usec, L: 0
0812 08:01:15.637457 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:15.637756 (+   299us) log.cc:844] Serialized 354 byte log entry
0812 08:01:16.064657 (+426901us) op_driver.cc:464] REPLICATION: finished
0812 08:01:16.064878 (+   221us) write_op.cc:301] APPLY: starting
0812 08:01:16.064909 (+    31us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:16.064957 (+    48us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:16.065127 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:16.065202 (+    75us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:16.065237 (+    35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:16.065247 (+    10us) write_op.cc:312] APPLY: finished
0812 08:01:16.065317 (+    70us) log.cc:844] Serialized 22 byte log entry
0812 08:01:16.065379 (+    62us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:16.065393 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:16.065399 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":164,"num_ops":1,"prepare.queue_time_us":525691,"prepare.run_cpu_time_us":798,"prepare.run_wall_time_us":854854,"raft.queue_time_us":85,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"replication_time_us":427162,"spinlock_wait_cycles":289408,"thread_start_us":77,"threads_started":1}]]}
I20260812 08:01:16.502836  2846 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:16.503012  2846 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:16.503643  2846 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:16.504200  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:16.504267  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:16.504475  2855 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=43, attempt_no=0}) took 1696 ms. Trace:
I20260812 08:01:16.504781  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:16.504555  2855 rpcz_store.cc:276] 0812 08:01:14.807943 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:14.808022 (+    79us) service_pool.cc:224] Handling call
0812 08:01:16.504462 (+1696440us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:15.637889 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:15.638019 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:15.638024 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:15.638026 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:15.638107 (+    81us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:15.638117 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:15.638121 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:15.638196 (+    75us) tablet.cc:701] Row locks acquired
0812 08:01:15.638199 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:01:15.638247 (+    48us) write_op.cc:270] Start()
0812 08:01:15.724443 (+ 86196us) write_op.cc:276] Timestamp: P: 1786521675638211 usec, L: 0
0812 08:01:15.724446 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:15.724655 (+   209us) log.cc:844] Serialized 354 byte log entry
0812 08:01:16.503943 (+779288us) op_driver.cc:464] REPLICATION: finished
0812 08:01:16.504036 (+    93us) write_op.cc:301] APPLY: starting
0812 08:01:16.504054 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:16.504086 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:16.504098 (+    12us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:16.504174 (+    76us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:16.504208 (+    34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:16.504211 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:16.504285 (+    74us) log.cc:844] Serialized 22 byte log entry
0812 08:01:16.504372 (+    87us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:16.504386 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:16.504391 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":34,"num_ops":1,"prepare.queue_time_us":829529,"prepare.run_cpu_time_us":751,"prepare.run_wall_time_us":86833,"replication_time_us":779461}]]}
I20260812 08:01:16.575621  2853 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:16.575784  2853 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:16.576350  2853 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:16.576758  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:16.576823  2199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:16.577440  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
W20260812 08:01:16.723920  2464 tablet_service.cc:3080] error setting up scanner 17f5f694c478486495687de314f4ba33 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.146s (maximum allowed 0.100s): new_scan_request { tablet_id: "2ab31e16200043d499ea4524521f82b4" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\333\322\360\323\006\"3\n\005slave\022*\n b4bba45dbfc34533997e2dcb75926a0a\020\001\030\001 \001(\001" signature: "<redacted>""d\3418!\322(\363\225\201\371\\\211\277\274\333]\241\257\022\322\032\355\360\036\030\324J5C\036\020t&\323q\\\016\362\3609\365/7\363\377\344)/H\313\374\016\3300\3371I\nw\306\177!\014\361" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "f0d10fe40826433cabfc9f677eb397fc"
I20260812 08:01:17.299150  2846 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:17.301172  2865 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=44, attempt_no=0}) took 1234 ms. Trace:
I20260812 08:01:17.301292  2865 rpcz_store.cc:276] 0812 08:01:16.067057 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:16.067177 (+   120us) service_pool.cc:224] Handling call
0812 08:01:17.301156 (+1233979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:16.067589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:16.067699 (+   110us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:16.067701 (+     2us) write_op.cc:435] Acquired schema lock
0812 08:01:16.067703 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:16.067756 (+    53us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:16.067762 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:16.067765 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:16.067794 (+    29us) tablet.cc:701] Row locks acquired
0812 08:01:16.067795 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:16.067822 (+    27us) write_op.cc:270] Start()
0812 08:01:16.200008 (+132186us) write_op.cc:276] Timestamp: P: 1786521676067755 usec, L: 0
0812 08:01:16.200012 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:16.200331 (+   319us) log.cc:844] Serialized 354 byte log entry
0812 08:01:17.300464 (+1100133us) op_driver.cc:464] REPLICATION: finished
0812 08:01:17.300803 (+   339us) write_op.cc:301] APPLY: starting
0812 08:01:17.300823 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:17.300855 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:17.300870 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:17.300939 (+    69us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:17.300964 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:17.300967 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:17.301026 (+    59us) log.cc:844] Serialized 22 byte log entry
0812 08:01:17.301075 (+    49us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:17.301093 (+    18us) write_op.cc:454] Released schema lock
0812 08:01:17.301097 (+     4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":269,"num_ops":1,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":726,"prepare.run_wall_time_us":132812,"replication_time_us":1100381,"thread_start_us":106,"threads_started":1}]]}
I20260812 08:01:17.948256  2853 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:17.948731  2510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.130:51911 (request call id 6987) took 1371 ms. Trace:
I20260812 08:01:17.948832  2510 rpcz_store.cc:276] 0812 08:01:16.577344 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:16.577397 (+    53us) service_pool.cc:224] Handling call
0812 08:01:16.577549 (+   152us) raft_consensus.cc:1471] Updating replica for 3 ops
0812 08:01:16.577669 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 44
0812 08:01:16.577808 (+   139us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0812 08:01:16.577921 (+   113us) write_op.cc:270] Start()
0812 08:01:17.133087 (+555166us) write_op.cc:276] Timestamp: P: 1786521675638211 usec, L: 0
0812 08:01:17.133522 (+   435us) write_op.cc:270] Start()
0812 08:01:17.659689 (+526167us) write_op.cc:276] Timestamp: P: 1786521676067755 usec, L: 0
0812 08:01:17.660221 (+   532us) write_op.cc:270] Start()
0812 08:01:17.947465 (+287244us) write_op.cc:276] Timestamp: P: 1786521676506712 usec, L: 0
0812 08:01:17.947842 (+   377us) log.cc:844] Serialized 1062 byte log entry
0812 08:01:17.948025 (+   183us) raft_consensus.cc:1645] Marking committed up to 45
0812 08:01:17.948172 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:01:17.948211 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:01:17.948638 (+   427us) raft_consensus.cc:1685] finished
0812 08:01:17.948640 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:01:17.948711 (+    71us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:17.133468 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:17.133582 (+   114us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:17.133586 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:17.133588 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:17.133653 (+    65us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:17.133664 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:17.133666 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:17.133702 (+    36us) tablet.cc:701] Row locks acquired
0812 08:01:17.133703 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:17.948069 (+814366us) op_driver.cc:464] REPLICATION: finished
0812 08:01:17.948635 (+   566us) write_op.cc:301] APPLY: starting
0812 08:01:17.948651 (+    16us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:17.948681 (+    30us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:17.948683 (+     2us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:17.948738 (+    55us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:17.948770 (+    32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:17.948817 (+    47us) write_op.cc:312] APPLY: finished
0812 08:01:17.948880 (+    63us) log.cc:844] Serialized 22 byte log entry
Related trace 'op':
0812 08:01:17.660140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:17.660285 (+   145us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:17.660290 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:17.660292 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:17.660371 (+    79us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:17.660380 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:17.660382 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:17.660421 (+    39us) tablet.cc:701] Row locks acquired
0812 08:01:17.660422 (+     1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:01:17.947743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:17.947857 (+   114us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:17.947862 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:17.947863 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:17.947926 (+    63us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:17.947936 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:17.947938 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:17.947981 (+    43us) tablet.cc:701] Row locks acquired
0812 08:01:17.947982 (+     1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":123,"threads_started":1,"wal-append.queue_time_us":228,"child_traces":[["op",{"apply.queue_time_us":492,"apply.run_cpu_time_us":402,"apply.run_wall_time_us":425,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":239,"prepare.run_cpu_time_us":349,"prepare.run_wall_time_us":349,"replication_time_us":1370125,"thread_start_us":149,"threads_started":2}],["op",{"num_ops":1,"partition_lock_wait_us":4,"prepare.queue_time_us":278,"prepare.run_cpu_time_us":412,"prepare.run_wall_time_us":412,"thread_start_us":132,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":311,"prepare.run_wall_time_us":312}]]}
I20260812 08:01:17.950963  2872 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46748 (ReqId={client: 3deb76b31e71499fb9a46da9b8027279, seq_no=45, attempt_no=0}) took 1444 ms. Trace:
I20260812 08:01:17.951058  2872 rpcz_store.cc:276] 0812 08:01:16.506074 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:16.506174 (+   100us) service_pool.cc:224] Handling call
0812 08:01:17.950946 (+1444772us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:16.506583 (+     0us) write_op.cc:183] PREPARE: starting on tablet 2ab31e16200043d499ea4524521f82b4
0812 08:01:16.506679 (+    96us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:16.506682 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:16.506683 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:16.506734 (+    51us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:16.506739 (+     5us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:16.506741 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:16.506770 (+    29us) tablet.cc:701] Row locks acquired
0812 08:01:16.506771 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:16.506800 (+    29us) write_op.cc:270] Start()
0812 08:01:16.564974 (+ 58174us) write_op.cc:276] Timestamp: P: 1786521676506712 usec, L: 0
0812 08:01:16.564978 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:16.565194 (+   216us) log.cc:844] Serialized 354 byte log entry
0812 08:01:17.950348 (+1385154us) op_driver.cc:464] REPLICATION: finished
0812 08:01:17.950547 (+   199us) write_op.cc:301] APPLY: starting
0812 08:01:17.950561 (+    14us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:17.950584 (+    23us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:17.950598 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:17.950669 (+    71us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:17.950691 (+    22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:17.950718 (+    27us) write_op.cc:312] APPLY: finished
0812 08:01:17.950782 (+    64us) log.cc:844] Serialized 22 byte log entry
0812 08:01:17.950840 (+    58us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:17.950870 (+    30us) write_op.cc:454] Released schema lock
0812 08:01:17.950875 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":137,"num_ops":1,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":612,"prepare.run_wall_time_us":58699,"replication_time_us":1385317,"thread_start_us":69,"threads_started":1}]]}
I20260812 08:01:18.141391  2846 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:18.141542  2846 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:18.142334  2846 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:18.142776  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:18.142778  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:18.143307  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559; no voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:18.143568  2846 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:18.277123  2853 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:18.277331  2853 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:18.278028  2853 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:18.279452  2846 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:18.279618  2846 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:18.280186  2846 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:18.280789  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:18.280941  2510 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c7ad63e416f4fe090d01f6eb74c9559 in term 1.
I20260812 08:01:18.281028  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:18.281327  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559, ebdebbdd787a429cb0ee706b88474efe; no voters: 
I20260812 08:01:18.281553  2846 raft_consensus.cc:2804] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:18.281625  2846 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d372d7abe19c4c3380c7c8210da6a838)
I20260812 08:01:18.281677  2846 raft_consensus.cc:3060] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:18.281950  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:18.282964  2846 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:18.283363  2200 raft_consensus.cc:2393] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ebdebbdd787a429cb0ee706b88474efe in current term 2: Already voted for candidate 5c7ad63e416f4fe090d01f6eb74c9559 in this term.
I20260812 08:01:18.283561  2846 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 election: Requested vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:18.284034  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838"
I20260812 08:01:18.284436  2510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe"
I20260812 08:01:18.284578  2510 raft_consensus.cc:3060] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:18.285941  2510 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c7ad63e416f4fe090d01f6eb74c9559 in term 2.
W20260812 08:01:18.286372  2436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.130:34369 timed out after 0.008s (SENT) [suppressed 1 similar messages]
W20260812 08:01:18.286372  2439 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.129:35469 timed out after 0.008s (SENT)
I20260812 08:01:18.286412  2122 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c7ad63e416f4fe090d01f6eb74c9559, ebdebbdd787a429cb0ee706b88474efe; no voters: d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:18.286696  2846 raft_consensus.cc:2804] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:01:18.286898  2846 raft_consensus.cc:697] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [term 2 LEADER]: Becoming Leader. State: Replica: 5c7ad63e416f4fe090d01f6eb74c9559, State: Running, Role: LEADER
I20260812 08:01:18.287285  2846 consensus_queue.cc:237] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 1.47, Last appended by leader: 47, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:18.290359  2025 catalog_manager.cc:5719] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 reported cstate change: term changed from 1 to 2, leader changed from d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130) to 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129). New cstate: current_term: 2 leader_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } health_report { overall_health: UNKNOWN } } }
I20260812 08:01:18.290715  2358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:18.290807  2356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:18.291069  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:18.291569  2357 raft_consensus.cc:3055] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:01:18.291656  2357 raft_consensus.cc:740] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d372d7abe19c4c3380c7c8210da6a838, State: Running, Role: LEADER
I20260812 08:01:18.291854  2357 consensus_queue.cc:260] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 1.47, Last appended by leader: 47, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:18.292174  2357 raft_consensus.cc:3060] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 1 FOLLOWER]: Advancing to term 2
W20260812 08:01:18.292303  2277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:01:18.293558  2277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:01:18.293766  2357 raft_consensus.cc:1275] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Refusing update from remote peer 5c7ad63e416f4fe090d01f6eb74c9559: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 2 index: 48. (index mismatch)
I20260812 08:01:18.294435  2510 raft_consensus.cc:1240] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Rejecting Update request from peer d372d7abe19c4c3380c7c8210da6a838 for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:18.294550  2846 consensus_queue.cc:1048] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
W20260812 08:01:18.296236  2439 leader_election.cc:336] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469): Timed out: RequestConsensusVote RPC to 127.31.239.129:35469 timed out after 0.008s (SENT)
I20260812 08:01:18.296352  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:18.296523  2853 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:18.298728  2510 raft_consensus.cc:1275] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Refusing update from remote peer 5c7ad63e416f4fe090d01f6eb74c9559: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 2 index: 48. (index mismatch)
I20260812 08:01:18.299603  2878 consensus_queue.cc:1048] T 2ab31e16200043d499ea4524521f82b4 P 5c7ad63e416f4fe090d01f6eb74c9559 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
W20260812 08:01:19.098083  2618 scanner-internal.cc:458] Time spent opening tablet: real 31.689s	user 0.004s	sys 0.004s
I20260812 08:01:19.170374  2888 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c7ad63e416f4fe090d01f6eb74c9559)
I20260812 08:01:19.171144  2888 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:19.172653  2888 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:19.172710  2356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 3 candidate_status { last_received { term: 2 index: 48 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:19.172910  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 3 candidate_status { last_received { term: 2 index: 48 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:19.173271  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:19.173473  2888 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 08:01:21.080894  2622 scanner-internal.cc:458] Time spent opening tablet: real 33.672s	user 0.009s	sys 0.000s
I20260812 08:01:21.150455  2178 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:01:21.150933  2487 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:21.151129  2334 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:21.174928  2921 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c7ad63e416f4fe090d01f6eb74c9559)
I20260812 08:01:21.175063  2921 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:21.175495  2921 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:21.175906  2357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 3 candidate_status { last_received { term: 2 index: 48 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:21.175968  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 3 candidate_status { last_received { term: 2 index: 48 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:21.176412  2436 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:21.176569  2921 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:01:21.168871  2920 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c7ad63e416f4fe090d01f6eb74c9559)
I20260812 08:01:21.178517  2920 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:21.179605  2920 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
I20260812 08:01:21.179646  2200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "d372d7abe19c4c3380c7c8210da6a838" candidate_term: 3 candidate_status { last_received { term: 2 index: 48 } } ignore_live_leader: false dest_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" is_pre_election: true
I20260812 08:01:21.179672  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "d372d7abe19c4c3380c7c8210da6a838" candidate_term: 3 candidate_status { last_received { term: 2 index: 48 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:21.180136  2276 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d372d7abe19c4c3380c7c8210da6a838; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, ebdebbdd787a429cb0ee706b88474efe
I20260812 08:01:21.180344  2920 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 dca8bfe66b53465386eabbed7fb0c4bf | 127.31.239.190:40585 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                           Value                                                                                           |      Tags       |         Master
----------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                       | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                       | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                      | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                         | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                      | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                      | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                        | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                       | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:39885 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 5c7ad63e416f4fe090d01f6eb74c9559 | 127.31.239.129:35469 | HEALTHY | <none>   |       1        |       0
 d372d7abe19c4c3380c7c8210da6a838 | 127.31.239.130:34369 | HEALTHY | <none>   |       0        |       0
 ebdebbdd787a429cb0ee706b88474efe | 127.31.239.131:36043 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                 Flag                 |                                                                                         Value                                                                                         |      Tags       |      Tablet Server
--------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 inject_latency_ms_before_starting_op | 1000                                                                                                                                                                                  | hidden,advanced | all 3 server(s) checked
 ipki_server_key_size                 | 768                                                                                                                                                                                   | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets        | 127.31.239.129                                                                                                                                                                        | experimental    | 127.31.239.129:35469
 local_ip_for_outbound_sockets        | 127.31.239.130                                                                                                                                                                        | experimental    | 127.31.239.130:34369
 local_ip_for_outbound_sockets        | 127.31.239.131                                                                                                                                                                        | experimental    | 127.31.239.131:36043
 never_fsync                          | true                                                                                                                                                                                  | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override      | 0                                                                                                                                                                                     | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports     | true                                                                                                                                                                                  | unsafe          | all 3 server(s) checked
 server_dump_info_format              | pb                                                                                                                                                                                    | hidden          | all 3 server(s) checked
 server_dump_info_path                | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:35469
 server_dump_info_path                | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:34369
 server_dump_info_path                | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElections.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:36043

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:39885 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:01:21.191748 32702 log_verifier.cc:126] Checking tablet 2ab31e16200043d499ea4524521f82b4
I20260812 08:01:21.238920 32702 log_verifier.cc:177] Verified matching terms for 48 ops in tablet 2ab31e16200043d499ea4524521f82b4
I20260812 08:01:21.260529 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 2106
I20260812 08:01:21.265798  2921 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c7ad63e416f4fe090d01f6eb74c9559)
I20260812 08:01:21.265969  2921 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:21.266572  2921 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
I20260812 08:01:21.267019  2356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "ebdebbdd787a429cb0ee706b88474efe" candidate_term: 3 candidate_status { last_received { term: 2 index: 48 } } ignore_live_leader: false dest_uuid: "d372d7abe19c4c3380c7c8210da6a838" is_pre_election: true
I20260812 08:01:21.270458  2920 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c7ad63e416f4fe090d01f6eb74c9559)
I20260812 08:01:21.270603  2920 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:21.271085  2920 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469), ebdebbdd787a429cb0ee706b88474efe (127.31.239.131:36043)
W20260812 08:01:21.271613  2439 connection.cc:573] client connection to 127.31.239.129:35469 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:01:21.271736  2509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab31e16200043d499ea4524521f82b4" candidate_uuid: "d372d7abe19c4c3380c7c8210da6a838" candidate_term: 3 candidate_status { last_received { term: 2 index: 48 } } ignore_live_leader: false dest_uuid: "ebdebbdd787a429cb0ee706b88474efe" is_pre_election: true
I20260812 08:01:21.271880  2509 raft_consensus.cc:2468] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d372d7abe19c4c3380c7c8210da6a838 in term 2.
W20260812 08:01:21.272130  2277 connection.cc:573] server connection from 127.31.239.129:41765 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:01:21.272197  2276 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d372d7abe19c4c3380c7c8210da6a838, ebdebbdd787a429cb0ee706b88474efe; no voters: 
I20260812 08:01:21.272383  2920 raft_consensus.cc:2804] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:01:21.272449  2920 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5c7ad63e416f4fe090d01f6eb74c9559)
I20260812 08:01:21.272500  2920 raft_consensus.cc:3060] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:21.273515 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 2258
I20260812 08:01:21.273597  2920 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P d372d7abe19c4c3380c7c8210da6a838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
W20260812 08:01:21.276463  2931 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:01:21.272781 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.31.239.129:35469 (local address 127.31.239.131:40695)
0812 08:01:21.273522 (+   741us) negotiation.cc:107] Waiting for socket to connect
0812 08:01:21.273594 (+    72us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.31.239.129:35469: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":102,"threads_started":1}
W20260812 08:01:21.276660  2439 leader_election.cc:336] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469): Network error: Client connection negotiation failed: client connection to 127.31.239.129:35469: connect: Connection reset by peer (error 104)
I20260812 08:01:21.276750  2439 leader_election.cc:304] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ebdebbdd787a429cb0ee706b88474efe; no voters: 5c7ad63e416f4fe090d01f6eb74c9559, d372d7abe19c4c3380c7c8210da6a838
I20260812 08:01:21.277184  2921 raft_consensus.cc:2749] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:01:21.284811  2921 raft_consensus.cc:493] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c7ad63e416f4fe090d01f6eb74c9559)
I20260812 08:01:21.284960  2921 raft_consensus.cc:515] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d372d7abe19c4c3380c7c8210da6a838" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34369 } } peers { permanent_uuid: "5c7ad63e416f4fe090d01f6eb74c9559" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 35469 } } peers { permanent_uuid: "ebdebbdd787a429cb0ee706b88474efe" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 36043 } }
I20260812 08:01:21.285439  2921 leader_election.cc:290] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d372d7abe19c4c3380c7c8210da6a838 (127.31.239.130:34369), 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469)
W20260812 08:01:21.286733  2436 connection.cc:573] client connection to 127.31.239.130:34369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:01:21.286947  2439 leader_election.cc:336] T 2ab31e16200043d499ea4524521f82b4 P ebdebbdd787a429cb0ee706b88474efe [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5c7ad63e416f4fe090d01f6eb74c9559 (127.31.239.129:35469): Network error: Client connection negotiation failed: client connection to 127.31.239.129:35469: connect: Connection refused (error 111)
I20260812 08:01:21.287346 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 2415
I20260812 08:01:21.297351 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 1991
2026-08-12T08:01:21Z chronyd exiting
[       OK ] RaftConsensusElectionITest.ChurnyElections (34944 ms)
[ RUN      ] RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency
I20260812 08:01:21.326898 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:01:21.326972 32702 ts_itest-base.cc:116] --------------
I20260812 08:01:21.326989 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:01:21.327006 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:01:21.327032 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:01:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:21Z Disabled control of system clock
I20260812 08:01:21.336263 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:45371
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:45371 with env {}
W20260812 08:01:21.441707  2941 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:21.442009  2941 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:21.442108  2941 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:21.445645  2941 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:21.445757  2941 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:21.445796  2941 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:21.445837  2941 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:21.449841  2941 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:45371
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:45371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:21.451061  2941 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:21.452232  2941 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:21.458276  2946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:21.458415  2941 server_base.cc:1061] running on GCE node
W20260812 08:01:21.459056  2949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:21.459231  2947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:21.459784  2941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:21.460840  2941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:21.462031  2941 hybrid_clock.cc:648] HybridClock initialized: now 1786521681462006 us; error 39 us; skew 500 ppm
I20260812 08:01:21.463902  2941 webserver.cc:533] Webserver started at http://127.31.239.190:44585/ using document root <none> and password file <none>
I20260812 08:01:21.464529  2941 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:21.464612  2941 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:21.464823  2941 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:21.466485  2941 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "9704f775727d46be806233cb485aacf7"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.467010  2941 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "9704f775727d46be806233cb485aacf7"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.470530  2941 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:01:21.472914  2957 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:21.474248  2941 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:01:21.474401  2941 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "9704f775727d46be806233cb485aacf7"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.474519  2941 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:21.492437  2941 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:21.493242  2941 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:21.493466  2941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:21.501694  2941 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:45371
I20260812 08:01:21.501704  3019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:45371 every 8 connection(s)
I20260812 08:01:21.502905  2941 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:01:21.505884  3020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:21.511446  3020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7: Bootstrap starting.
I20260812 08:01:21.512360 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 2941
I20260812 08:01:21.512477 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:01:21.514369  3020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:21.515156  3020 log.cc:826] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:21.517223  3020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7: No bootstrap required, opened a new log
I20260812 08:01:21.520562  3020 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9704f775727d46be806233cb485aacf7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 45371 } }
I20260812 08:01:21.520823  3020 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:21.520892  3020 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9704f775727d46be806233cb485aacf7, State: Initialized, Role: FOLLOWER
I20260812 08:01:21.521350  3020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9704f775727d46be806233cb485aacf7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 45371 } }
I20260812 08:01:21.521504  3020 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:21.521587  3020 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:21.521720  3020 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:21.522689  3020 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9704f775727d46be806233cb485aacf7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 45371 } }
I20260812 08:01:21.523084  3020 leader_election.cc:304] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9704f775727d46be806233cb485aacf7; no voters: 
I20260812 08:01:21.523434  3020 leader_election.cc:290] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:21.523634  3025 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:21.523921  3025 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [term 1 LEADER]: Becoming Leader. State: Replica: 9704f775727d46be806233cb485aacf7, State: Running, Role: LEADER
I20260812 08:01:21.524290  3025 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9704f775727d46be806233cb485aacf7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 45371 } }
I20260812 08:01:21.524682  3020 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:21.526117  3026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9704f775727d46be806233cb485aacf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9704f775727d46be806233cb485aacf7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 45371 } } }
I20260812 08:01:21.526293  3027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9704f775727d46be806233cb485aacf7. Latest consensus state: current_term: 1 leader_uuid: "9704f775727d46be806233cb485aacf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9704f775727d46be806233cb485aacf7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 45371 } } }
I20260812 08:01:21.526399  3027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:21.526341  3026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:21.527245  3036 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:21.529881  3036 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:21.535552  3036 catalog_manager.cc:1383] Generated new cluster ID: e2c8a4e229e342c781bee66798bae906
I20260812 08:01:21.535634  3036 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:21.556236  3036 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:21.557477  3036 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:21.568351  3036 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 9704f775727d46be806233cb485aacf7: Generated new TSK 0
I20260812 08:01:21.569082  3036 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:21.581533 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:45371
--builtin_ntp_servers=127.31.239.148:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000
--consensus_inject_latency_ms_in_notifications=50 with env {}
W20260812 08:01:21.695729  3049 flags.cc:432] Enabled unsafe flag: --consensus_inject_latency_ms_in_notifications=50
W20260812 08:01:21.695986  3049 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:21.696009  3049 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:21.696097  3049 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:21.699828  3049 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:21.699959  3049 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:01:21.704265  3049 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_inject_latency_ms_in_notifications=50
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:45371
--never_fsync=true
--heap_profile_path=/tmp/kudu.3049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:21.705485  3049 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:21.706763  3049 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:21.709635  3049 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:01:21.713814  3059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:21.713807  3057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:21.713809  3056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:21.714057  3049 server_base.cc:1061] running on GCE node
I20260812 08:01:21.714664  3049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:21.715284  3049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:21.716480  3049 hybrid_clock.cc:648] HybridClock initialized: now 1786521681716496 us; error 56 us; skew 500 ppm
I20260812 08:01:21.718571  3049 webserver.cc:533] Webserver started at http://127.31.239.129:38511/ using document root <none> and password file <none>
I20260812 08:01:21.719202  3049 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:21.719288  3049 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:21.719499  3049 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:21.721117  3049 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "c965722d7f0e4bd8948e3560c43cc14e"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.721628  3049 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "c965722d7f0e4bd8948e3560c43cc14e"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.725281  3049 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:01:21.727737  3066 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:21.728804  3049 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:21.728941  3049 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "c965722d7f0e4bd8948e3560c43cc14e"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.729050  3049 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:21.755954  3049 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:21.756685  3049 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:21.756924  3049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:21.757544  3049 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:21.758608  3049 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:21.758683  3049 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:21.758756  3049 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:21.758816  3049 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:21.768780  3049 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:37227
I20260812 08:01:21.768812  3195 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:37227 every 8 connection(s)
I20260812 08:01:21.769776  3049 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:01:21.778744  3197 heartbeater.cc:344] Connected to a master server at 127.31.239.190:45371
I20260812 08:01:21.779042  3197 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:21.779459 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 3049
I20260812 08:01:21.779618 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:01:21.779814  3197 heartbeater.cc:507] Master 127.31.239.190:45371 requested a full tablet report, sending...
I20260812 08:01:21.781392  2977 ts_manager.cc:194] Registered new tserver with Master: c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:21.781996 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:45371
--builtin_ntp_servers=127.31.239.148:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000
--consensus_inject_latency_ms_in_notifications=50 with env {}
I20260812 08:01:21.782722  2977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:52723
W20260812 08:01:21.889700  3200 flags.cc:432] Enabled unsafe flag: --consensus_inject_latency_ms_in_notifications=50
W20260812 08:01:21.889957  3200 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:21.889981  3200 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:21.890023  3200 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:21.893349  3200 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:21.893469  3200 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:01:21.897261  3200 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_inject_latency_ms_in_notifications=50
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:45371
--never_fsync=true
--heap_profile_path=/tmp/kudu.3200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:21.898473  3200 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:21.899595  3200 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:21.902371  3200 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:01:21.906220  3206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:21.906222  3209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:21.906222  3207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:21.907261  3200 server_base.cc:1061] running on GCE node
I20260812 08:01:21.907673  3200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:21.908288  3200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:21.909466  3200 hybrid_clock.cc:648] HybridClock initialized: now 1786521681909447 us; error 34 us; skew 500 ppm
I20260812 08:01:21.911552  3200 webserver.cc:533] Webserver started at http://127.31.239.130:37809/ using document root <none> and password file <none>
I20260812 08:01:21.912132  3200 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:21.912189  3200 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:21.912408  3200 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:21.914034  3200 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "e0a62d8151ca45cc8dc5074bcd719148"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.914614  3200 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "e0a62d8151ca45cc8dc5074bcd719148"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.918099  3200 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:21.920529  3215 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:21.921772  3200 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:21.921921  3200 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "e0a62d8151ca45cc8dc5074bcd719148"
format_stamp: "Formatted at 2026-08-12 08:01:21 on dist-test-slave-9jjr"
I20260812 08:01:21.922040  3200 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:21.933334  3200 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:21.934074  3200 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:21.934355  3200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:21.934991  3200 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:21.936292  3200 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:21.936398  3200 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:21.936480  3200 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:21.936540  3200 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:21.948500  3200 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:38519
I20260812 08:01:21.948531  3355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:38519 every 8 connection(s)
I20260812 08:01:21.949792  3200 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:01:21.959208 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 3200
I20260812 08:01:21.959295  3356 heartbeater.cc:344] Connected to a master server at 127.31.239.190:45371
I20260812 08:01:21.959363 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:01:21.959568  3356 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:21.960340  3356 heartbeater.cc:507] Master 127.31.239.190:45371 requested a full tablet report, sending...
I20260812 08:01:21.961483  2977 ts_manager.cc:194] Registered new tserver with Master: e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519)
I20260812 08:01:21.961993 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:45371
--builtin_ntp_servers=127.31.239.148:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000
--consensus_inject_latency_ms_in_notifications=50 with env {}
I20260812 08:01:21.962090  2977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:36429
W20260812 08:01:22.071048  3359 flags.cc:432] Enabled unsafe flag: --consensus_inject_latency_ms_in_notifications=50
W20260812 08:01:22.071311  3359 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:22.071336  3359 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:22.071439  3359 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:22.075611  3359 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:22.075755  3359 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:01:22.080075  3359 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_inject_latency_ms_in_notifications=50
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:45371
--never_fsync=true
--heap_profile_path=/tmp/kudu.3359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:22.081275  3359 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:22.082566  3359 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:22.085415  3359 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:01:22.089571  3367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:22.089568  3364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:22.089675  3365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:22.089910  3359 server_base.cc:1061] running on GCE node
I20260812 08:01:22.090435  3359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:22.091061  3359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:22.092258  3359 hybrid_clock.cc:648] HybridClock initialized: now 1786521682092247 us; error 40 us; skew 500 ppm
I20260812 08:01:22.094215  3359 webserver.cc:533] Webserver started at http://127.31.239.131:40879/ using document root <none> and password file <none>
I20260812 08:01:22.094811  3359 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:22.094914  3359 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:22.095147  3359 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:22.096763  3359 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "43174691357048359daa1eca5a316a75"
format_stamp: "Formatted at 2026-08-12 08:01:22 on dist-test-slave-9jjr"
I20260812 08:01:22.097292  3359 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "43174691357048359daa1eca5a316a75"
format_stamp: "Formatted at 2026-08-12 08:01:22 on dist-test-slave-9jjr"
I20260812 08:01:22.100917  3359 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 08:01:22.103304  3373 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:22.104343  3359 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:01:22.104491  3359 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "43174691357048359daa1eca5a316a75"
format_stamp: "Formatted at 2026-08-12 08:01:22 on dist-test-slave-9jjr"
I20260812 08:01:22.104609  3359 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:22.116276  3359 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:22.117007  3359 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:22.117223  3359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:22.117842  3359 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:22.119035  3359 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:22.119109  3359 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:22.119190  3359 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:22.119233  3359 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:22.129558  3359 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:33841
I20260812 08:01:22.129601  3506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:33841 every 8 connection(s)
I20260812 08:01:22.130645  3359 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:01:22.139209 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 3359
I20260812 08:01:22.139245  3507 heartbeater.cc:344] Connected to a master server at 127.31.239.190:45371
I20260812 08:01:22.139345 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:01:22.139529  3507 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:22.140203  3507 heartbeater.cc:507] Master 127.31.239.190:45371 requested a full tablet report, sending...
I20260812 08:01:22.141403  2977 ts_manager.cc:194] Registered new tserver with Master: 43174691357048359daa1eca5a316a75 (127.31.239.131:33841)
I20260812 08:01:22.142050  2977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:47681
I20260812 08:01:22.154474 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:22.167209  2977 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39550:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:22.168366  2977 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:22.186530  3117 tablet_service.cc:1511] Processing CreateTablet for tablet 4536d08ec31b4a218bbeee99964809e2 (DEFAULT_TABLE table=test-workload [id=e3ca0873806e43eba74992833197f7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:22.186808  3427 tablet_service.cc:1511] Processing CreateTablet for tablet 4536d08ec31b4a218bbeee99964809e2 (DEFAULT_TABLE table=test-workload [id=e3ca0873806e43eba74992833197f7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:22.186808  3272 tablet_service.cc:1511] Processing CreateTablet for tablet 4536d08ec31b4a218bbeee99964809e2 (DEFAULT_TABLE table=test-workload [id=e3ca0873806e43eba74992833197f7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:22.187553  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4536d08ec31b4a218bbeee99964809e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:22.187764  3427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4536d08ec31b4a218bbeee99964809e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:22.187764  3272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4536d08ec31b4a218bbeee99964809e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:22.192798  3526 tablet_bootstrap.cc:492] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e: Bootstrap starting.
I20260812 08:01:22.193396  3527 tablet_bootstrap.cc:492] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75: Bootstrap starting.
I20260812 08:01:22.194284  3528 tablet_bootstrap.cc:492] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148: Bootstrap starting.
I20260812 08:01:22.195784  3527 tablet_bootstrap.cc:654] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:22.195940  3526 tablet_bootstrap.cc:654] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:22.196131  3528 tablet_bootstrap.cc:654] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:22.196731  3527 log.cc:826] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:22.196731  3526 log.cc:826] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:22.196805  3528 log.cc:826] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:22.198500  3527 tablet_bootstrap.cc:492] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75: No bootstrap required, opened a new log
I20260812 08:01:22.198541  3526 tablet_bootstrap.cc:492] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e: No bootstrap required, opened a new log
I20260812 08:01:22.198735  3527 ts_tablet_manager.cc:1403] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:01:22.198740  3526 ts_tablet_manager.cc:1403] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:01:22.199208  3528 tablet_bootstrap.cc:492] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148: No bootstrap required, opened a new log
I20260812 08:01:22.199390  3528 ts_tablet_manager.cc:1403] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:01:22.201721  3527 raft_consensus.cc:359] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.201941  3527 raft_consensus.cc:385] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:22.202013  3527 raft_consensus.cc:740] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43174691357048359daa1eca5a316a75, State: Initialized, Role: FOLLOWER
I20260812 08:01:22.201946  3526 raft_consensus.cc:359] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.202225  3526 raft_consensus.cc:385] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:22.202306  3526 raft_consensus.cc:740] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c965722d7f0e4bd8948e3560c43cc14e, State: Initialized, Role: FOLLOWER
I20260812 08:01:22.202512  3528 raft_consensus.cc:359] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.202698  3528 raft_consensus.cc:385] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:22.202688  3527 consensus_queue.cc:260] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.202790  3528 raft_consensus.cc:740] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a62d8151ca45cc8dc5074bcd719148, State: Initialized, Role: FOLLOWER
I20260812 08:01:22.202754  3526 consensus_queue.cc:260] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.203311  3528 consensus_queue.cc:260] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.203505  3507 heartbeater.cc:499] Master 127.31.239.190:45371 was elected leader, sending a full tablet report...
I20260812 08:01:22.203770  3526 ts_tablet_manager.cc:1434] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.005s
I20260812 08:01:22.204031  3536 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:22.204093  3197 heartbeater.cc:499] Master 127.31.239.190:45371 was elected leader, sending a full tablet report...
I20260812 08:01:22.204210  3536 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.204255  3528 ts_tablet_manager.cc:1434] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:01:22.204563  3356 heartbeater.cc:499] Master 127.31.239.190:45371 was elected leader, sending a full tablet report...
I20260812 08:01:22.205111  3534 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:22.205302  3527 ts_tablet_manager.cc:1434] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:01:22.205406  3533 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:22.205591  3534 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.205808  3533 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.209290  3536 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:22.210057  3533 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:22.210366  3534 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), 43174691357048359daa1eca5a316a75 (127.31.239.131:33841)
I20260812 08:01:22.215019  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:22.215265  3299 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c965722d7f0e4bd8948e3560c43cc14e in term 0.
I20260812 08:01:22.215662  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:22.215848  3453 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a62d8151ca45cc8dc5074bcd719148 in term 0.
W20260812 08:01:22.216039  3069 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.130:38519 timed out after 0.007s (SENT)
W20260812 08:01:22.216372  3220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.131:33841 timed out after 0.006s (SENT)
I20260812 08:01:22.216799  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:22.216943  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:22.216982  3142 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a62d8151ca45cc8dc5074bcd719148 in term 0.
I20260812 08:01:22.217056  3299 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c965722d7f0e4bd8948e3560c43cc14e in term 0.
I20260812 08:01:22.217512  3069 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148; no voters: 
I20260812 08:01:22.217783  3534 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:22.217872  3534 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:22.217921  3534 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:22.218694  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:22.219215  3534 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.219471  3142 raft_consensus.cc:2393] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43174691357048359daa1eca5a316a75 in current term 1: Already voted for candidate c965722d7f0e4bd8948e3560c43cc14e in this term.
I20260812 08:01:22.219689  3534 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 1 election: Requested vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), 43174691357048359daa1eca5a316a75 (127.31.239.131:33841)
W20260812 08:01:22.219847  3375 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.129:37227 timed out after 0.008s (SENT)
I20260812 08:01:22.220064  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148"
I20260812 08:01:22.220186  3299 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:22.220906  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:22.221040  3453 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a62d8151ca45cc8dc5074bcd719148 in term 0.
I20260812 08:01:22.221051  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:22.221166  3142 raft_consensus.cc:2393] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0a62d8151ca45cc8dc5074bcd719148 in current term 1: Already voted for candidate c965722d7f0e4bd8948e3560c43cc14e in this term.
I20260812 08:01:22.221431  3299 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c965722d7f0e4bd8948e3560c43cc14e in term 1.
I20260812 08:01:22.221560  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:22.221728  3298 raft_consensus.cc:2393] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43174691357048359daa1eca5a316a75 in current term 1: Already voted for candidate c965722d7f0e4bd8948e3560c43cc14e in this term.
I20260812 08:01:22.221714  3069 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148; no voters: 
I20260812 08:01:22.221824  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43174691357048359daa1eca5a316a75, e0a62d8151ca45cc8dc5074bcd719148; no voters: c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:22.221891  3534 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:22.221971  3534 raft_consensus.cc:697] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 1 LEADER]: Becoming Leader. State: Replica: c965722d7f0e4bd8948e3560c43cc14e, State: Running, Role: LEADER
I20260812 08:01:22.222168  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:22.222287  3452 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c965722d7f0e4bd8948e3560c43cc14e in term 0.
I20260812 08:01:22.222296  3536 raft_consensus.cc:2764] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 08:01:22.222301  3534 consensus_queue.cc:237] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.222599  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:22.222908  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:22.223067  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75"
I20260812 08:01:22.223192  3453 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:22.224319  3453 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c965722d7f0e4bd8948e3560c43cc14e in term 1.
I20260812 08:01:22.224562  3533 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 08:01:22.226204  3537 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:01:22.226253  3537 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260812 08:01:22.226486  2978 catalog_manager.cc:5719] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e reported cstate change: term changed from 0 to 1, leader changed from <none> to c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "c965722d7f0e4bd8948e3560c43cc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } health_report { overall_health: HEALTHY } } }
I20260812 08:01:22.227332  3534 consensus_queue.cc:1048] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:01:22.271029  3198 tablet.cc:2406] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:01:22.395890  3095 tablet_service.cc:3018] Rejecting scan request for tablet 4536d08ec31b4a218bbeee99964809e2: Uninitialized: clean time has not yet been initialized
W20260812 08:01:22.396610  3096 tablet_service.cc:3018] Rejecting scan request for tablet 4536d08ec31b4a218bbeee99964809e2: Uninitialized: clean time has not yet been initialized
W20260812 08:01:22.403636  3405 tablet_service.cc:3080] error setting up scanner b7a0bcd503e843eaba3c50d7308cf43b with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.150s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
W20260812 08:01:22.405001  3404 tablet_service.cc:3080] error setting up scanner 0a7135810a184a05bca033a633382b68 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.151s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
W20260812 08:01:22.436883  3404 tablet_service.cc:3080] error setting up scanner 6efb5ae8032c474689fd98ad8cdef802 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.183s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
W20260812 08:01:22.437817  3404 tablet_service.cc:3080] error setting up scanner b799c972e743418ba278cc0f269dc1e5 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.184s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
W20260812 08:01:22.498817  3404 tablet_service.cc:3080] error setting up scanner 2fb877652fc247ee9dfe6cd580b490db with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.245s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:22.507203  3533 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:22.507339  3533 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.507783  3533 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
W20260812 08:01:22.507704  3404 tablet_service.cc:3080] error setting up scanner 95fd04cc0ea34b4ca27ae5414a660a05 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.254s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
I20260812 08:01:22.508363  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:22.510552  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:22.510912  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:22.511140  3533 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:22.629757  3404 tablet_service.cc:3080] error setting up scanner aeb62eb6fde3441daa55285575aeecd6 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.376s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
W20260812 08:01:22.652709  3404 tablet_service.cc:3080] error setting up scanner 64296965a986405f84d3e600e86e2818 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.399s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:22.661815  3533 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:22.661957  3533 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:22.662475  3533 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:22.663017  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:22.664234  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:22.664662  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:22.665205  3533 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:22.778427  3453 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:01:22.778488  3298 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:01:22.778530  3453 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260812 08:01:22.778550  3298 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260812 08:01:22.823931  3404 tablet_service.cc:3080] error setting up scanner 885302c19ba04b73870bbbd7f15fb137 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.570s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
W20260812 08:01:22.943089  3404 tablet_service.cc:3080] error setting up scanner dea35516ef074fd4b9eb569c66d118e4 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.689s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:23.023207  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:23.023388  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:23.024308  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:23.024526  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:23.024649  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:23.025099  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:23.025840  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:23.092772  3533 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:23.092902  3533 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:23.093575  3533 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:23.093901  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:23.094301  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:23.094678  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:23.094926  3533 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:23.192549  3560 mvcc.cc:204] Tried to move back new op lower bound from 7317592810511814656 to 7317592810386030592. Current Snapshot: MvccSnapshot[applied={T|T < 7317592810511814656 or (T in {7317592810511814656})}]
W20260812 08:01:23.338153  3404 tablet_service.cc:3080] error setting up scanner 92626e68d28142a188de66e786e35be6 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.244s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
W20260812 08:01:23.457415  3404 tablet_service.cc:3080] error setting up scanner 27613452ee764f60ae7441ec7ff4d021 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.363s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:23.708292  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:23.708456  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:23.709080  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:23.709604  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:23.710035  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:23.710580  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:23.710839  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:23.728829  3578 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=1, attempt_no=0}) took 1478 ms. Trace:
I20260812 08:01:23.728988  3578 rpcz_store.cc:276] 0812 08:01:22.249879 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:22.249922 (+    43us) service_pool.cc:224] Handling call
0812 08:01:23.728808 (+1478886us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:22.776732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:22.776855 (+   123us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:22.776860 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:22.776862 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:22.776941 (+    79us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:22.776970 (+    29us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:22.776975 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:22.777021 (+    46us) tablet.cc:701] Row locks acquired
0812 08:01:22.777022 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:22.777064 (+    42us) write_op.cc:270] Start()
0812 08:01:23.192218 (+415154us) write_op.cc:276] Timestamp: P: 1786521682777038 usec, L: 0
0812 08:01:23.192222 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:23.192385 (+   163us) log.cc:844] Serialized 345 byte log entry
0812 08:01:23.728030 (+535645us) op_driver.cc:464] REPLICATION: finished
0812 08:01:23.728362 (+   332us) write_op.cc:301] APPLY: starting
0812 08:01:23.728384 (+    22us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:23.728418 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:23.728466 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:23.728536 (+    70us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:23.728562 (+    26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:23.728565 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:23.728629 (+    64us) log.cc:844] Serialized 22 byte log entry
0812 08:01:23.728709 (+    80us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:23.728723 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:23.728728 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":1152256,"child_traces":[["op",{"apply.queue_time_us":241,"mutex_wait_us":48,"num_ops":1,"prepare.queue_time_us":524612,"prepare.run_cpu_time_us":691,"prepare.run_wall_time_us":415765,"raft.queue_time_us":283,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":193,"replication_time_us":535747,"thread_start_us":109,"threads_started":1}]]}
I20260812 08:01:23.912153  3533 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:23.912336  3533 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:23.912957  3533 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:23.913394  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:23.913419  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:23.913987  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
W20260812 08:01:24.492426  3404 tablet_service.cc:3080] error setting up scanner f0c8f3de6b704a269657e3a38071dd7c with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.578s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
W20260812 08:01:24.547837  3404 tablet_service.cc:3080] error setting up scanner e49dbb9ccb0444a082f1df5961613715 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.633s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:24.592765  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:24.592929  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:24.593560  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:24.594030  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:24.594077  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:24.594570  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:24.594959  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:24.600935  3592 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=2, attempt_no=0}) took 1543 ms. Trace:
I20260812 08:01:24.601040  3592 rpcz_store.cc:276] 0812 08:01:23.057709 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:23.057783 (+    74us) service_pool.cc:224] Handling call
0812 08:01:24.600915 (+1543132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:23.192784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:23.192932 (+   148us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:23.192938 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:01:23.192941 (+     3us) tablet.cc:662] Decoding operations
0812 08:01:23.193018 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:23.193029 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:23.193032 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:23.193081 (+    49us) tablet.cc:701] Row locks acquired
0812 08:01:23.193082 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:23.193127 (+    45us) write_op.cc:270] Start()
0812 08:01:23.846277 (+653150us) write_op.cc:276] Timestamp: P: 1786521683193064 usec, L: 0
0812 08:01:23.846281 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:23.846440 (+   159us) log.cc:844] Serialized 354 byte log entry
0812 08:01:24.600275 (+753835us) op_driver.cc:464] REPLICATION: finished
0812 08:01:24.600531 (+   256us) write_op.cc:301] APPLY: starting
0812 08:01:24.600549 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:24.600577 (+    28us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:24.600593 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:24.600650 (+    57us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:24.600683 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:24.600686 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:24.600756 (+    70us) log.cc:844] Serialized 22 byte log entry
0812 08:01:24.600826 (+    70us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:24.600838 (+    12us) write_op.cc:454] Released schema lock
0812 08:01:24.600842 (+     4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":194,"num_ops":1,"prepare.queue_time_us":134541,"prepare.run_cpu_time_us":916,"prepare.run_wall_time_us":653989,"raft.queue_time_us":117,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":193,"replication_time_us":753942,"thread_start_us":96,"threads_started":1}]]}
I20260812 08:01:24.779476  3533 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:25.436482  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:25.436659  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:25.437345  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:25.437820  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:25.437841  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:25.438391  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:25.454435  3533 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:25.454598  3533 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:25.455209  3533 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:25.455713  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:25.455693  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:25.456266  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:25.479825  3601 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=3, attempt_no=0}) took 1748 ms. Trace:
I20260812 08:01:25.479934  3601 rpcz_store.cc:276] 0812 08:01:23.730912 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:23.731005 (+    93us) service_pool.cc:224] Handling call
0812 08:01:25.479785 (+1748780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:23.846818 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:23.846954 (+   136us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:23.846959 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:23.846961 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:23.847047 (+    86us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:23.847056 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:23.847058 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:23.847097 (+    39us) tablet.cc:701] Row locks acquired
0812 08:01:23.847098 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:23.847135 (+    37us) write_op.cc:270] Start()
0812 08:01:24.172336 (+325201us) write_op.cc:276] Timestamp: P: 1786521683847103 usec, L: 0
0812 08:01:24.172341 (+     5us) op_driver.cc:348] REPLICATION: starting
0812 08:01:24.172566 (+   225us) log.cc:844] Serialized 354 byte log entry
0812 08:01:25.478846 (+1306280us) op_driver.cc:464] REPLICATION: finished
0812 08:01:25.479229 (+   383us) write_op.cc:301] APPLY: starting
0812 08:01:25.479249 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:25.479280 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:25.479298 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:25.479358 (+    60us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:25.479383 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:25.479386 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:25.479460 (+    74us) log.cc:844] Serialized 22 byte log entry
0812 08:01:25.479659 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:25.479674 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:25.479679 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":303,"num_ops":1,"prepare.queue_time_us":115352,"prepare.run_cpu_time_us":924,"prepare.run_wall_time_us":326010,"replication_time_us":1306445,"thread_start_us":181,"threads_started":1}]]}
I20260812 08:01:25.559255  3533 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:25.902899  3404 tablet_service.cc:3080] error setting up scanner db3fcb8b01004f31bc706ae451a3436e with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.342s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
I20260812 08:01:26.031668  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:26.076370  3533 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:26.076540  3533 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:26.077121  3533 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:26.077584  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:26.077621  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:26.078177  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
W20260812 08:01:26.214362  3404 tablet_service.cc:3080] error setting up scanner b2f568e125b8450aafeeb455f457de4c with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.136s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:26.228231  3533 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:27.142306  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:27.142460  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:27.142776  3298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:33079 (request call id 420) took 1109 ms. Trace:
I20260812 08:01:27.143090  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:27.143566  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:27.143568  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:27.142858  3298 rpcz_store.cc:276] 0812 08:01:26.033164 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:26.033245 (+    81us) service_pool.cc:224] Handling call
0812 08:01:26.033413 (+   168us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:01:26.033497 (+    84us) raft_consensus.cc:1534] Early marking committed up to index 6
0812 08:01:26.033658 (+   161us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:01:26.033785 (+   127us) write_op.cc:270] Start()
0812 08:01:26.396954 (+363169us) write_op.cc:276] Timestamp: P: 1786521685482321 usec, L: 0
0812 08:01:26.397373 (+   419us) write_op.cc:270] Start()
0812 08:01:27.141570 (+744197us) write_op.cc:276] Timestamp: P: 1786521685830144 usec, L: 0
0812 08:01:27.142050 (+   480us) log.cc:844] Serialized 708 byte log entry
0812 08:01:27.142215 (+   165us) raft_consensus.cc:1645] Marking committed up to 6
0812 08:01:27.142222 (+     7us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:01:27.142254 (+    32us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:01:27.142698 (+   444us) raft_consensus.cc:1685] finished
0812 08:01:27.142701 (+     3us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:01:27.142757 (+    56us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:26.397205 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:26.397316 (+   111us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:26.397320 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:26.397321 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:26.397412 (+    91us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:26.397424 (+    12us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:26.397430 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:26.397480 (+    50us) tablet.cc:701] Row locks acquired
0812 08:01:26.397483 (+     3us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:01:27.141937 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:27.142049 (+   112us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:27.142052 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:27.142054 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:27.142238 (+   184us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:27.142288 (+    50us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:27.142292 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:27.142342 (+    50us) tablet.cc:701] Row locks acquired
0812 08:01:27.142345 (+     3us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":102,"threads_started":1,"wal-append.queue_time_us":138,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":7,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":372,"prepare.run_wall_time_us":372}],["op",{"num_ops":1,"partition_lock_wait_us":44,"prepare.queue_time_us":230,"prepare.run_cpu_time_us":492,"prepare.run_wall_time_us":492,"thread_start_us":88,"threads_started":1}]]}
I20260812 08:01:27.144104  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:27.144290  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:27.246755  3533 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:27.246945  3533 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:27.247668  3533 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:27.248136  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:27.248243  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:27.248875  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:27.257455  3616 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=7, attempt_no=0}) took 1173 ms. Trace:
I20260812 08:01:27.257586  3616 rpcz_store.cc:276] 0812 08:01:26.084427 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:26.084504 (+    77us) service_pool.cc:224] Handling call
0812 08:01:27.257436 (+1172932us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:26.084970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:26.085067 (+    97us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:26.085070 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:26.085071 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:26.085125 (+    54us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:26.085130 (+     5us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:26.085132 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:26.085163 (+    31us) tablet.cc:701] Row locks acquired
0812 08:01:26.085164 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:26.085194 (+    30us) write_op.cc:270] Start()
0812 08:01:26.500350 (+415156us) write_op.cc:276] Timestamp: P: 1786521686085133 usec, L: 0
0812 08:01:26.500362 (+    12us) op_driver.cc:348] REPLICATION: starting
0812 08:01:26.500597 (+   235us) log.cc:844] Serialized 354 byte log entry
0812 08:01:27.256414 (+755817us) op_driver.cc:464] REPLICATION: finished
0812 08:01:27.256730 (+   316us) write_op.cc:301] APPLY: starting
0812 08:01:27.256748 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:27.256775 (+    27us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:27.256792 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:27.256851 (+    59us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:27.256876 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:27.256879 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:27.257084 (+   205us) log.cc:844] Serialized 22 byte log entry
0812 08:01:27.257344 (+   260us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:27.257358 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:27.257363 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":250,"num_ops":1,"prepare.queue_time_us":76,"prepare.run_cpu_time_us":609,"prepare.run_wall_time_us":415692,"replication_time_us":755962,"thread_start_us":106,"threads_started":1}]]}
I20260812 08:01:27.299023  3533 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:27.325157  3616 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=8, attempt_no=0}) took 1090 ms. Trace:
I20260812 08:01:27.325318  3616 rpcz_store.cc:276] 0812 08:01:26.234339 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:26.234410 (+    71us) service_pool.cc:224] Handling call
0812 08:01:27.325136 (+1090726us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:26.500704 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:26.500832 (+   128us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:26.500837 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:26.500838 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:26.500932 (+    94us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:26.500943 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:26.500948 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:26.500991 (+    43us) tablet.cc:701] Row locks acquired
0812 08:01:26.500992 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:26.501029 (+    37us) write_op.cc:270] Start()
0812 08:01:26.775201 (+274172us) write_op.cc:276] Timestamp: P: 1786521686500992 usec, L: 0
0812 08:01:26.775205 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:26.775419 (+   214us) log.cc:844] Serialized 354 byte log entry
0812 08:01:27.324447 (+549028us) op_driver.cc:464] REPLICATION: finished
0812 08:01:27.324584 (+   137us) write_op.cc:301] APPLY: starting
0812 08:01:27.324625 (+    41us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:27.324664 (+    39us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:27.324679 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:27.324745 (+    66us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:27.324778 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:27.324783 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:27.324866 (+    83us) log.cc:844] Serialized 22 byte log entry
0812 08:01:27.324974 (+   108us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:27.324990 (+    16us) write_op.cc:454] Released schema lock
0812 08:01:27.324997 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":63,"num_ops":1,"prepare.queue_time_us":265874,"prepare.run_cpu_time_us":723,"prepare.run_wall_time_us":274777,"replication_time_us":549199}]]}
I20260812 08:01:27.728960  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:27.729121  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:27.729676  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:27.730062  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:27.730094  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:27.730613  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:27.730893  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:28.394770  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:28.394936  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:28.395586  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:28.396036  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:28.396034  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:28.396571  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:28.399415  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:28.437795  3628 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=9, attempt_no=0}) took 1178 ms. Trace:
I20260812 08:01:28.437891  3628 rpcz_store.cc:276] 0812 08:01:27.259267 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:27.259355 (+    88us) service_pool.cc:224] Handling call
0812 08:01:28.437777 (+1178422us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:27.259794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:27.259890 (+    96us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:27.259893 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:27.259894 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:27.259948 (+    54us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:27.259953 (+     5us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:27.259955 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:27.259994 (+    39us) tablet.cc:701] Row locks acquired
0812 08:01:27.259995 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:27.260024 (+    29us) write_op.cc:270] Start()
0812 08:01:28.031147 (+771123us) write_op.cc:276] Timestamp: P: 1786521687259974 usec, L: 0
0812 08:01:28.031151 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:28.031320 (+   169us) log.cc:844] Serialized 354 byte log entry
0812 08:01:28.437054 (+405734us) op_driver.cc:464] REPLICATION: finished
0812 08:01:28.437346 (+   292us) write_op.cc:301] APPLY: starting
0812 08:01:28.437367 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:28.437411 (+    44us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:28.437425 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:28.437477 (+    52us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:28.437527 (+    50us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:28.437531 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:28.437608 (+    77us) log.cc:844] Serialized 22 byte log entry
0812 08:01:28.437674 (+    66us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:28.437688 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:28.437695 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":220,"num_ops":1,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":554,"prepare.run_wall_time_us":771613,"raft.queue_time_us":39,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":170,"replication_time_us":405856,"spinlock_wait_cycles":19840,"thread_start_us":114,"threads_started":1}]]}
I20260812 08:01:28.461097  3628 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=10, attempt_no=0}) took 1134 ms. Trace:
I20260812 08:01:28.461239  3628 rpcz_store.cc:276] 0812 08:01:27.326895 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:27.326970 (+    75us) service_pool.cc:224] Handling call
0812 08:01:28.461077 (+1134107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:28.031455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:28.031602 (+   147us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:28.031608 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:01:28.031611 (+     3us) tablet.cc:662] Decoding operations
0812 08:01:28.031689 (+    78us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:28.031698 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:28.031701 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:28.031747 (+    46us) tablet.cc:701] Row locks acquired
0812 08:01:28.031748 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:28.031788 (+    40us) write_op.cc:270] Start()
0812 08:01:28.291962 (+260174us) write_op.cc:276] Timestamp: P: 1786521688031745 usec, L: 0
0812 08:01:28.291967 (+     5us) op_driver.cc:348] REPLICATION: starting
0812 08:01:28.292183 (+   216us) log.cc:844] Serialized 354 byte log entry
0812 08:01:28.460490 (+168307us) op_driver.cc:464] REPLICATION: finished
0812 08:01:28.460663 (+   173us) write_op.cc:301] APPLY: starting
0812 08:01:28.460684 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:28.460720 (+    36us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:28.460742 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:28.460824 (+    82us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:28.460857 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:28.460867 (+    10us) write_op.cc:312] APPLY: finished
0812 08:01:28.460945 (+    78us) log.cc:844] Serialized 22 byte log entry
0812 08:01:28.460997 (+    52us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:28.461009 (+    12us) write_op.cc:454] Released schema lock
0812 08:01:28.461013 (+     4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":99,"num_ops":1,"prepare.queue_time_us":704066,"prepare.run_cpu_time_us":716,"prepare.run_wall_time_us":260790,"replication_time_us":168480}]]}
I20260812 08:01:28.647295  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:28.647467  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:28.648033  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:28.648422  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:28.648586  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:28.649026  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
W20260812 08:01:29.290006  3404 tablet_service.cc:3080] error setting up scanner 71b395b8cbb04296ad87d2aa1935c14f with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.851s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:29.524912  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:29.525077  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:29.525605  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:29.526185  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:29.526158  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:29.526782  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:29.527107  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:29.537248  3636 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=11, attempt_no=0}) took 1097 ms. Trace:
I20260812 08:01:29.537365  3636 rpcz_store.cc:276] 0812 08:01:28.439338 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:28.439416 (+    78us) service_pool.cc:224] Handling call
0812 08:01:29.537224 (+1097808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:28.439846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:28.439955 (+   109us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:28.439958 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:28.439959 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:28.440011 (+    52us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:28.440018 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:28.440020 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:28.440049 (+    29us) tablet.cc:701] Row locks acquired
0812 08:01:28.440051 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:28.440076 (+    25us) write_op.cc:270] Start()
0812 08:01:28.588213 (+148137us) write_op.cc:276] Timestamp: P: 1786521688440050 usec, L: 0
0812 08:01:28.588217 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:28.588419 (+   202us) log.cc:844] Serialized 354 byte log entry
0812 08:01:29.536454 (+948035us) op_driver.cc:464] REPLICATION: finished
0812 08:01:29.536760 (+   306us) write_op.cc:301] APPLY: starting
0812 08:01:29.536785 (+    25us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:29.536810 (+    25us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:29.536823 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:29.536901 (+    78us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:29.536933 (+    32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:29.536938 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:29.537013 (+    75us) log.cc:844] Serialized 22 byte log entry
0812 08:01:29.537118 (+   105us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:29.537130 (+    12us) write_op.cc:454] Released schema lock
0812 08:01:29.537135 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":245,"num_ops":1,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":567,"prepare.run_wall_time_us":148637,"replication_time_us":948181,"thread_start_us":146,"threads_started":1}]]}
I20260812 08:01:29.847185  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:29.847530  3298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:33079 (request call id 568) took 1198 ms. Trace:
I20260812 08:01:29.847620  3298 rpcz_store.cc:276] 0812 08:01:28.648776 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:28.648830 (+    54us) service_pool.cc:224] Handling call
0812 08:01:28.648976 (+   146us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:01:28.649057 (+    81us) raft_consensus.cc:1534] Early marking committed up to index 11
0812 08:01:28.649263 (+   206us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:01:28.649410 (+   147us) write_op.cc:270] Start()
0812 08:01:29.021599 (+372189us) write_op.cc:276] Timestamp: P: 1786521688031745 usec, L: 0
0812 08:01:29.021975 (+   376us) write_op.cc:270] Start()
0812 08:01:29.846255 (+824280us) write_op.cc:276] Timestamp: P: 1786521688440050 usec, L: 0
0812 08:01:29.846760 (+   505us) log.cc:844] Serialized 708 byte log entry
0812 08:01:29.846903 (+   143us) raft_consensus.cc:1645] Marking committed up to 12
0812 08:01:29.847080 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:01:29.847115 (+    35us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:01:29.847450 (+   335us) raft_consensus.cc:1685] finished
0812 08:01:29.847454 (+     4us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:01:29.847508 (+    54us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:29.021847 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:29.022023 (+   176us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:29.022027 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:29.022028 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:29.022175 (+   147us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:29.022185 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:29.022194 (+     9us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:29.022235 (+    41us) tablet.cc:701] Row locks acquired
0812 08:01:29.022236 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:29.846954 (+824718us) op_driver.cc:464] REPLICATION: finished
0812 08:01:29.847197 (+   243us) write_op.cc:301] APPLY: starting
0812 08:01:29.847214 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:29.847250 (+    36us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:29.847252 (+     2us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:29.847314 (+    62us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:29.847346 (+    32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:29.847373 (+    27us) write_op.cc:312] APPLY: finished
0812 08:01:29.847449 (+    76us) log.cc:844] Serialized 22 byte log entry
0812 08:01:29.847510 (+    61us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:29.847523 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:29.847527 (+     4us) write_op.cc:341] FINISH: Updating metrics
0812 08:01:29.847605 (+    78us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:29.847607 (+     2us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 08:01:29.846679 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:29.846796 (+   117us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:29.846800 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:29.846801 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:29.846887 (+    86us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:29.846897 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:29.846900 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:29.846940 (+    40us) tablet.cc:701] Row locks acquired
0812 08:01:29.846941 (+     1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":86,"threads_started":1,"wal-append.queue_time_us":202,"child_traces":[["op",{"apply.queue_time_us":188,"apply.run_cpu_time_us":399,"apply.run_wall_time_us":400,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":474,"prepare.run_wall_time_us":475,"replication_time_us":1197519,"thread_start_us":73,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":259,"prepare.run_cpu_time_us":338,"prepare.run_wall_time_us":338,"thread_start_us":112,"threads_started":1}]]}
I20260812 08:01:30.199753  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:30.199918  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:30.200534  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:30.200994  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:30.201005  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:30.201467  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:30.207854  3644 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=12, attempt_no=0}) took 1745 ms. Trace:
I20260812 08:01:30.207957  3644 rpcz_store.cc:276] 0812 08:01:28.462788 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:28.462865 (+    77us) service_pool.cc:224] Handling call
0812 08:01:30.207820 (+1744955us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:28.588537 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:28.588656 (+   119us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:28.588660 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:28.588661 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:28.588730 (+    69us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:28.588737 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:28.588739 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:28.588775 (+    36us) tablet.cc:701] Row locks acquired
0812 08:01:28.588776 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:28.588810 (+    34us) write_op.cc:270] Start()
0812 08:01:29.543941 (+955131us) write_op.cc:276] Timestamp: P: 1786521688588769 usec, L: 0
0812 08:01:29.543944 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:29.544135 (+   191us) log.cc:844] Serialized 354 byte log entry
0812 08:01:30.207055 (+662920us) op_driver.cc:464] REPLICATION: finished
0812 08:01:30.207323 (+   268us) write_op.cc:301] APPLY: starting
0812 08:01:30.207344 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:30.207382 (+    38us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:30.207397 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:30.207457 (+    60us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:30.207482 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:30.207485 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:30.207568 (+    83us) log.cc:844] Serialized 22 byte log entry
0812 08:01:30.207658 (+    90us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:30.207671 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:30.207676 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":201,"num_ops":1,"prepare.queue_time_us":125285,"prepare.run_cpu_time_us":591,"prepare.run_wall_time_us":955664,"replication_time_us":663051,"thread_start_us":98,"threads_started":1}]]}
I20260812 08:01:30.440917  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:30.441099  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:30.441671  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:30.442167  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:30.442377  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:30.442818  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:30.443235  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:30.513305  3404 tablet_service.cc:3080] error setting up scanner dc359c22c89b44cf9752c08b8b54d4d3 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.312s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
I20260812 08:01:30.573418  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:30.661444  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:30.661614  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:30.662161  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:30.662477  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:30.663417  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:30.663868  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:30.664126  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:30.981360  3562 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:30.981529  3562 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:30.982149  3562 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:30.982622  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:30.982678  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:30.983227  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:30.983469  3562 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:31.803700  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:31.803884  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:31.804450  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:31.804950  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:31.805233  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:31.805644  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:32.329468  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:32.362555  3664 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=15, attempt_no=0}) took 1911 ms. Trace:
I20260812 08:01:32.362656  3664 rpcz_store.cc:276] 0812 08:01:30.451104 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:30.451337 (+   233us) service_pool.cc:224] Handling call
0812 08:01:32.362534 (+1911197us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:30.837081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:30.837215 (+   134us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:30.837219 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:30.837221 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:30.837301 (+    80us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:30.837311 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:30.837314 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:30.837361 (+    47us) tablet.cc:701] Row locks acquired
0812 08:01:30.837362 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:30.837411 (+    49us) write_op.cc:270] Start()
0812 08:01:31.705571 (+868160us) write_op.cc:276] Timestamp: P: 1786521690837325 usec, L: 0
0812 08:01:31.705575 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:31.705734 (+   159us) log.cc:844] Serialized 354 byte log entry
0812 08:01:32.361714 (+655980us) op_driver.cc:464] REPLICATION: finished
0812 08:01:32.362024 (+   310us) write_op.cc:301] APPLY: starting
0812 08:01:32.362044 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:32.362118 (+    74us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:32.362182 (+    64us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:32.362271 (+    89us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:32.362300 (+    29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:32.362304 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:32.362379 (+    75us) log.cc:844] Serialized 22 byte log entry
0812 08:01:32.362439 (+    60us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:32.362451 (+    12us) write_op.cc:454] Released schema lock
0812 08:01:32.362456 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":238,"num_ops":1,"prepare.queue_time_us":385281,"prepare.run_cpu_time_us":682,"prepare.run_wall_time_us":868766,"raft.queue_time_us":50,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":191,"replication_time_us":656079,"thread_start_us":110,"threads_started":1}]]}
I20260812 08:01:32.590579  3652 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:32.590791  3652 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:32.591434  3652 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:32.591857  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:32.591859  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:32.592653  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:32.685434  3652 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:32.693177  3664 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=16, attempt_no=0}) took 1677 ms. Trace:
I20260812 08:01:32.693315  3664 rpcz_store.cc:276] 0812 08:01:31.016209 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:31.016273 (+    64us) service_pool.cc:224] Handling call
0812 08:01:32.693162 (+1676889us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:31.705881 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:31.706027 (+   146us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:31.706032 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:31.706034 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:31.706209 (+   175us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:31.706223 (+    14us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:31.706229 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:31.706281 (+    52us) tablet.cc:701] Row locks acquired
0812 08:01:31.706282 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:31.706327 (+    45us) write_op.cc:270] Start()
0812 08:01:31.968481 (+262154us) write_op.cc:276] Timestamp: P: 1786521691706267 usec, L: 0
0812 08:01:31.968485 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:31.968694 (+   209us) log.cc:844] Serialized 354 byte log entry
0812 08:01:32.692665 (+723971us) op_driver.cc:464] REPLICATION: finished
0812 08:01:32.692787 (+   122us) write_op.cc:301] APPLY: starting
0812 08:01:32.692805 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:32.692840 (+    35us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:32.692858 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:32.692933 (+    75us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:32.692958 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:32.692962 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:32.693034 (+    72us) log.cc:844] Serialized 22 byte log entry
0812 08:01:32.693084 (+    50us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:32.693096 (+    12us) write_op.cc:454] Released schema lock
0812 08:01:32.693101 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":65,"num_ops":1,"prepare.queue_time_us":689250,"prepare.run_cpu_time_us":831,"prepare.run_wall_time_us":262896,"replication_time_us":724139}]]}
I20260812 08:01:32.720108  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:32.720259  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:32.720788  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:32.721271  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:32.721320  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:32.722096  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:32.722361  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:33.139487  3404 tablet_service.cc:3080] error setting up scanner 11eff197af284910a40ea9b04c0ec259 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.418s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:33.556460  3652 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:33.556632  3652 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:33.557245  3652 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:33.557703  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:33.557684  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:33.558671  3673 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=17, attempt_no=0}) took 1194 ms. Trace:
I20260812 08:01:33.558672  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:33.558925  3652 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:33.558764  3673 rpcz_store.cc:276] 0812 08:01:32.364383 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:32.364466 (+    83us) service_pool.cc:224] Handling call
0812 08:01:33.558633 (+1194167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:32.364984 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:32.365102 (+   118us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:32.365105 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:32.365106 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:32.365164 (+    58us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:32.365171 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:32.365173 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:32.365206 (+    33us) tablet.cc:701] Row locks acquired
0812 08:01:32.365207 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:32.365237 (+    30us) write_op.cc:270] Start()
0812 08:01:33.159375 (+794138us) write_op.cc:276] Timestamp: P: 1786521692365169 usec, L: 0
0812 08:01:33.159377 (+     2us) op_driver.cc:348] REPLICATION: starting
0812 08:01:33.159526 (+   149us) log.cc:844] Serialized 354 byte log entry
0812 08:01:33.557675 (+398149us) op_driver.cc:464] REPLICATION: finished
0812 08:01:33.558091 (+   416us) write_op.cc:301] APPLY: starting
0812 08:01:33.558113 (+    22us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:33.558188 (+    75us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:33.558204 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:33.558269 (+    65us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:33.558305 (+    36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:33.558311 (+     6us) write_op.cc:312] APPLY: finished
0812 08:01:33.558384 (+    73us) log.cc:844] Serialized 22 byte log entry
0812 08:01:33.558443 (+    59us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:33.558458 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:33.558463 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":205,"num_ops":1,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":633,"prepare.run_wall_time_us":794706,"raft.queue_time_us":136,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":383,"replication_time_us":398259,"spinlock_wait_cycles":19456,"thread_start_us":88,"threads_started":1}]]}
I20260812 08:01:33.731523  3652 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:33.731678  3652 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:33.732348  3652 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:33.732753  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:33.732811  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:33.733273  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:33.733762  3652 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:33.744123  3673 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=18, attempt_no=0}) took 1049 ms. Trace:
I20260812 08:01:33.744220  3673 rpcz_store.cc:276] 0812 08:01:32.694828 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:32.694897 (+    69us) service_pool.cc:224] Handling call
0812 08:01:33.744098 (+1049201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:33.159710 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:33.159856 (+   146us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:33.159861 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:33.159864 (+     3us) tablet.cc:662] Decoding operations
0812 08:01:33.159941 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:33.159948 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:33.159951 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:33.159986 (+    35us) tablet.cc:701] Row locks acquired
0812 08:01:33.159987 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:33.160046 (+    59us) write_op.cc:270] Start()
0812 08:01:33.656236 (+496190us) write_op.cc:276] Timestamp: P: 1786521693160013 usec, L: 0
0812 08:01:33.656240 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:33.656438 (+   198us) log.cc:844] Serialized 354 byte log entry
0812 08:01:33.743574 (+ 87136us) op_driver.cc:464] REPLICATION: finished
0812 08:01:33.743703 (+   129us) write_op.cc:301] APPLY: starting
0812 08:01:33.743724 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:33.743766 (+    42us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:33.743779 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:33.743834 (+    55us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:33.743860 (+    26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:33.743863 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:33.743931 (+    68us) log.cc:844] Serialized 22 byte log entry
0812 08:01:33.744017 (+    86us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:33.744030 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:33.744035 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":54,"num_ops":1,"prepare.queue_time_us":464462,"prepare.run_cpu_time_us":710,"prepare.run_wall_time_us":496789,"replication_time_us":87289}]]}
I20260812 08:01:34.089475  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:34.089622  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:34.090201  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:34.090580  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:34.090634  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:34.091099  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:34.091295  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:34.611681  3404 tablet_service.cc:3080] error setting up scanner 581b1ca3fa814b99bc830c8973d06b39 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.520s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
I20260812 08:01:34.791896  3680 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:34.792073  3680 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:34.792814  3680 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:34.793447  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:34.793653  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:34.794097  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:34.794358  3680 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:34.830108  3685 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=19, attempt_no=0}) took 1269 ms. Trace:
I20260812 08:01:34.830258  3685 rpcz_store.cc:276] 0812 08:01:33.560391 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:33.560456 (+    65us) service_pool.cc:224] Handling call
0812 08:01:34.830064 (+1269608us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:33.656539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:33.656662 (+   123us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:33.656667 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:33.656671 (+     4us) tablet.cc:662] Decoding operations
0812 08:01:33.656744 (+    73us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:33.656754 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:33.656757 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:33.656801 (+    44us) tablet.cc:701] Row locks acquired
0812 08:01:33.656802 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:33.656849 (+    47us) write_op.cc:270] Start()
0812 08:01:34.548981 (+892132us) write_op.cc:276] Timestamp: P: 1786521693656789 usec, L: 0
0812 08:01:34.548984 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:34.549130 (+   146us) log.cc:844] Serialized 354 byte log entry
0812 08:01:34.829312 (+280182us) op_driver.cc:464] REPLICATION: finished
0812 08:01:34.829623 (+   311us) write_op.cc:301] APPLY: starting
0812 08:01:34.829644 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:34.829676 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:34.829694 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:34.829763 (+    69us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:34.829802 (+    39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:34.829806 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:34.829903 (+    97us) log.cc:844] Serialized 22 byte log entry
0812 08:01:34.829964 (+    61us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:34.829981 (+    17us) write_op.cc:454] Released schema lock
0812 08:01:34.829986 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":230,"num_ops":1,"prepare.queue_time_us":95679,"prepare.run_cpu_time_us":647,"prepare.run_wall_time_us":892717,"raft.queue_time_us":39,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":147,"replication_time_us":280281,"thread_start_us":135,"threads_started":1}]]}
I20260812 08:01:34.976722  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:34.976887  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:34.977514  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:34.977869  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:34.978423  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:34.978835  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:35.107246  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:35.584928  3690 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:35.585098  3690 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:35.585772  3690 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:35.586299  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:35.586879  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:35.587379  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:35.597942  3693 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=20, attempt_no=0}) took 1852 ms. Trace:
I20260812 08:01:35.598038  3693 rpcz_store.cc:276] 0812 08:01:33.745637 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:33.745703 (+    66us) service_pool.cc:224] Handling call
0812 08:01:35.597920 (+1852217us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:34.549297 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:34.549422 (+   125us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:34.549426 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:34.549428 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:34.549501 (+    73us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:34.549511 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:34.549514 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:34.549561 (+    47us) tablet.cc:701] Row locks acquired
0812 08:01:34.549562 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:34.549596 (+    34us) write_op.cc:270] Start()
0812 08:01:35.303757 (+754161us) write_op.cc:276] Timestamp: P: 1786521694549556 usec, L: 0
0812 08:01:35.303761 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:35.303937 (+   176us) log.cc:844] Serialized 354 byte log entry
0812 08:01:35.597230 (+293293us) op_driver.cc:464] REPLICATION: finished
0812 08:01:35.597539 (+   309us) write_op.cc:301] APPLY: starting
0812 08:01:35.597558 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:35.597589 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:35.597606 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:35.597669 (+    63us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:35.597696 (+    27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:35.597699 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:35.597774 (+    75us) log.cc:844] Serialized 22 byte log entry
0812 08:01:35.597826 (+    52us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:35.597839 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:35.597843 (+     4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":238,"num_ops":1,"prepare.queue_time_us":803242,"prepare.run_cpu_time_us":665,"prepare.run_wall_time_us":754734,"raft.queue_time_us":26,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"replication_time_us":293413,"spinlock_wait_cycles":20352,"thread_start_us":113,"threads_started":1}]]}
I20260812 08:01:36.183187  3690 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:36.189363  3699 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=21, attempt_no=0}) took 1357 ms. Trace:
I20260812 08:01:36.189502  3699 rpcz_store.cc:276] 0812 08:01:34.831651 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:34.831714 (+    63us) service_pool.cc:224] Handling call
0812 08:01:36.189331 (+1357617us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:35.304074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:35.304199 (+   125us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:35.304204 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:35.304207 (+     3us) tablet.cc:662] Decoding operations
0812 08:01:35.304282 (+    75us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:35.304291 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:35.304294 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:35.304336 (+    42us) tablet.cc:701] Row locks acquired
0812 08:01:35.304337 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:35.304379 (+    42us) write_op.cc:270] Start()
0812 08:01:35.479635 (+175256us) write_op.cc:276] Timestamp: P: 1786521695304343 usec, L: 0
0812 08:01:35.479642 (+     7us) op_driver.cc:348] REPLICATION: starting
0812 08:01:35.479881 (+   239us) log.cc:844] Serialized 354 byte log entry
0812 08:01:36.188471 (+708590us) op_driver.cc:464] REPLICATION: finished
0812 08:01:36.188789 (+   318us) write_op.cc:301] APPLY: starting
0812 08:01:36.188806 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:36.188873 (+    67us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:36.188892 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:36.188983 (+    91us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:36.189011 (+    28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:36.189014 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:36.189084 (+    70us) log.cc:844] Serialized 22 byte log entry
0812 08:01:36.189167 (+    83us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:36.189181 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:36.189188 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":253,"num_ops":1,"prepare.queue_time_us":471925,"prepare.run_cpu_time_us":743,"prepare.run_wall_time_us":175872,"replication_time_us":708779,"thread_start_us":140,"threads_started":1}]]}
I20260812 08:01:36.276978  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:36.277132  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:36.277771  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:36.278162  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:36.278164  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:36.278697  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:36.390882  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:36.981930  3404 tablet_service.cc:3080] error setting up scanner dc48714b34e3448fa1770f48ac402d31 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.591s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:37.151458  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:37.151618  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:37.152271  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:37.152719  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:37.152726  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:37.153256  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:37.199051  3708 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=22, attempt_no=0}) took 1599 ms. Trace:
I20260812 08:01:37.199204  3708 rpcz_store.cc:276] 0812 08:01:35.599482 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:35.599549 (+    67us) service_pool.cc:224] Handling call
0812 08:01:37.199014 (+1599465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:35.600056 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:35.600152 (+    96us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:35.600156 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:35.600156 (+     0us) tablet.cc:662] Decoding operations
0812 08:01:35.600219 (+    63us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:35.600225 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:35.600228 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:35.600259 (+    31us) tablet.cc:701] Row locks acquired
0812 08:01:35.600260 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:35.600292 (+    32us) write_op.cc:270] Start()
0812 08:01:36.591439 (+991147us) write_op.cc:276] Timestamp: P: 1786521695600265 usec, L: 0
0812 08:01:36.591442 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:36.591664 (+   222us) log.cc:844] Serialized 354 byte log entry
0812 08:01:37.198095 (+606431us) op_driver.cc:464] REPLICATION: finished
0812 08:01:37.198542 (+   447us) write_op.cc:301] APPLY: starting
0812 08:01:37.198562 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:37.198603 (+    41us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:37.198622 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:37.198704 (+    82us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:37.198729 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:37.198733 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:37.198806 (+    73us) log.cc:844] Serialized 22 byte log entry
0812 08:01:37.198895 (+    89us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:37.198910 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:37.198916 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":253,"num_ops":1,"prepare.queue_time_us":63,"prepare.run_cpu_time_us":622,"prepare.run_wall_time_us":991678,"replication_time_us":606590,"thread_start_us":137,"threads_started":1}]]}
I20260812 08:01:37.434643  3690 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:37.434804  3690 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:37.435539  3690 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:37.436012  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:37.436075  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:37.436553  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:37.715494  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:37.758721  3717 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=23, attempt_no=0}) took 1567 ms. Trace:
I20260812 08:01:37.758829  3717 rpcz_store.cc:276] 0812 08:01:36.191249 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:36.191324 (+    75us) service_pool.cc:224] Handling call
0812 08:01:37.758697 (+1567373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:36.591777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:36.591893 (+   116us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:36.591897 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:36.591898 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:36.591969 (+    71us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:36.591977 (+     8us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:36.591979 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:36.592039 (+    60us) tablet.cc:701] Row locks acquired
0812 08:01:36.592041 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:36.592085 (+    44us) write_op.cc:270] Start()
0812 08:01:36.757256 (+165171us) write_op.cc:276] Timestamp: P: 1786521696592062 usec, L: 0
0812 08:01:36.757259 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:36.757482 (+   223us) log.cc:844] Serialized 354 byte log entry
0812 08:01:37.757755 (+1000273us) op_driver.cc:464] REPLICATION: finished
0812 08:01:37.758114 (+   359us) write_op.cc:301] APPLY: starting
0812 08:01:37.758184 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:37.758222 (+    38us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:37.758247 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:37.758347 (+   100us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:37.758394 (+    47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:37.758405 (+    11us) write_op.cc:312] APPLY: finished
0812 08:01:37.758499 (+    94us) log.cc:844] Serialized 22 byte log entry
0812 08:01:37.758579 (+    80us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:37.758595 (+    16us) write_op.cc:454] Released schema lock
0812 08:01:37.758602 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":274,"num_ops":1,"prepare.queue_time_us":399970,"prepare.run_cpu_time_us":712,"prepare.run_wall_time_us":165780,"replication_time_us":1000416,"thread_start_us":138,"threads_started":1}]]}
I20260812 08:01:37.805824  3690 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:37.842485  3690 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:37.842656  3690 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:37.843282  3690 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:37.843791  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:37.843906  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:37.844375  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:37.844556  3690 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:37.875145  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:37.875299  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:37.876014  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:37.876446  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:37.876551  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:37.877051  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:37.877331  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:38.453939  3404 tablet_service.cc:3080] error setting up scanner 16aa43b92ae84fa7a71f6b676e7a7743 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.577s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
I20260812 08:01:38.754503  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:38.754668  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:38.755283  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:38.755709  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:38.755942  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:38.756421  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:38.756618  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:38.774572  3723 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=25, attempt_no=0}) took 1014 ms. Trace:
I20260812 08:01:38.774711  3723 rpcz_store.cc:276] 0812 08:01:37.760488 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:37.760558 (+    70us) service_pool.cc:224] Handling call
0812 08:01:38.774552 (+1013994us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:37.761102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:37.761251 (+   149us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:37.761255 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:37.761257 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:37.761333 (+    76us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:37.761342 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:37.761345 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:37.761389 (+    44us) tablet.cc:701] Row locks acquired
0812 08:01:37.761391 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:37.761430 (+    39us) write_op.cc:270] Start()
0812 08:01:38.358573 (+597143us) write_op.cc:276] Timestamp: P: 1786521697761391 usec, L: 0
0812 08:01:38.358577 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:38.358771 (+   194us) log.cc:844] Serialized 354 byte log entry
0812 08:01:38.773730 (+414959us) op_driver.cc:464] REPLICATION: finished
0812 08:01:38.773991 (+   261us) write_op.cc:301] APPLY: starting
0812 08:01:38.774008 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:38.774040 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:38.774054 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:38.774119 (+    65us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:38.774197 (+    78us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:38.774202 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:38.774263 (+    61us) log.cc:844] Serialized 22 byte log entry
0812 08:01:38.774447 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:38.774474 (+    27us) write_op.cc:454] Released schema lock
0812 08:01:38.774481 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":208,"num_ops":1,"prepare.queue_time_us":55,"prepare.run_cpu_time_us":658,"prepare.run_wall_time_us":597736,"replication_time_us":415103,"thread_start_us":79,"threads_started":1}]]}
I20260812 08:01:39.045781  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:39.045948  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:39.046649  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:39.047127  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:39.047531  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 27 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:39.047988  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:39.174302  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:39.174463  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:39.174969  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:39.175558  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:39.175634  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:39.176290  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:39.208765  3723 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=26, attempt_no=0}) took 1337 ms. Trace:
I20260812 08:01:39.208877  3723 rpcz_store.cc:276] 0812 08:01:37.870842 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:37.870907 (+    65us) service_pool.cc:224] Handling call
0812 08:01:39.208740 (+1337833us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:38.358876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:38.358998 (+   122us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:38.359003 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:38.359005 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:38.359077 (+    72us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:38.359085 (+     8us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:38.359087 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:38.359163 (+    76us) tablet.cc:701] Row locks acquired
0812 08:01:38.359164 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:38.359200 (+    36us) write_op.cc:270] Start()
0812 08:01:38.773331 (+414131us) write_op.cc:276] Timestamp: P: 1786521698359160 usec, L: 0
0812 08:01:38.773335 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:38.773536 (+   201us) log.cc:844] Serialized 354 byte log entry
0812 08:01:39.208065 (+434529us) op_driver.cc:464] REPLICATION: finished
0812 08:01:39.208229 (+   164us) write_op.cc:301] APPLY: starting
0812 08:01:39.208257 (+    28us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:39.208290 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:39.208310 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:39.208383 (+    73us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:39.208408 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:39.208412 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:39.208508 (+    96us) log.cc:844] Serialized 22 byte log entry
0812 08:01:39.208598 (+    90us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:39.208614 (+    16us) write_op.cc:454] Released schema lock
0812 08:01:39.208620 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":99,"num_ops":1,"prepare.queue_time_us":487609,"prepare.run_cpu_time_us":663,"prepare.run_wall_time_us":414719,"replication_time_us":434671}]]}
I20260812 08:01:39.538506  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:39.610078  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:39.870286  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:39.870448  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:39.871030  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:39.871428  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:39.871472  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:39.871924  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:40.144101  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:40.144273  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:40.144836  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:40.145336  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:40.145349  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:40.146337  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:40.388849  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:40.544130  3404 tablet_service.cc:3080] error setting up scanner b7bc2b36918e445ba06ba3acc80d0a96 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521699543897 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521699542833 usec, L: 0 Physical time difference: 0.001s: new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:40.544469  3404 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:58006 (request call id 22) took 1001 ms. Trace:
I20260812 08:01:40.544562  3404 rpcz_store.cc:276] 0812 08:01:39.543395 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:39.543460 (+    65us) service_pool.cc:224] Handling call
0812 08:01:39.543635 (+   175us) tablet_service.cc:2890] Created scanner b7bc2b36918e445ba06ba3acc80d0a96 for tablet 4536d08ec31b4a218bbeee99964809e2, query id is c64e6f3ff0bc4cfebe422ea00b757086
0812 08:01:39.543908 (+   273us) tablet_service.cc:3030] Creating iterator
0812 08:01:39.543929 (+    21us) tablet_service.cc:3408] Waiting safe time to advance
0812 08:01:40.544104 (+1000175us) tablet_service.cc:3055] Iterator created
0812 08:01:40.544118 (+    14us) tablet_service.cc:3077] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521699543897 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521699542833 usec, L: 0 Physical time difference: 0.001s
0812 08:01:40.544455 (+   337us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260812 08:01:40.816092  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:41.229067  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:41.229249  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:41.229840  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:41.230396  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:41.230613  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:41.231127  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:41.231676  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:41.265446  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:41.265602  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:41.266212  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:41.266482  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:41.266781  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 32 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:41.267482  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:41.275202  3742 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=30, attempt_no=0}) took 1393 ms. Trace:
I20260812 08:01:41.275445  3742 rpcz_store.cc:276] 0812 08:01:39.881668 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:39.881749 (+    81us) service_pool.cc:224] Handling call
0812 08:01:41.275182 (+1393433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:39.882311 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:39.882418 (+   107us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:39.882422 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:39.882423 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:39.882478 (+    55us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:39.882485 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:39.882488 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:39.882519 (+    31us) tablet.cc:701] Row locks acquired
0812 08:01:39.882520 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:39.882559 (+    39us) write_op.cc:270] Start()
0812 08:01:40.569713 (+687154us) write_op.cc:276] Timestamp: P: 1786521699882516 usec, L: 0
0812 08:01:40.569717 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:40.569875 (+   158us) log.cc:844] Serialized 354 byte log entry
0812 08:01:41.274448 (+704573us) op_driver.cc:464] REPLICATION: finished
0812 08:01:41.274729 (+   281us) write_op.cc:301] APPLY: starting
0812 08:01:41.274750 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:41.274784 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:41.274800 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:41.274861 (+    61us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:41.274895 (+    34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:41.274900 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:41.274996 (+    96us) log.cc:844] Serialized 22 byte log entry
0812 08:01:41.275080 (+    84us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:41.275104 (+    24us) write_op.cc:454] Released schema lock
0812 08:01:41.275107 (+     3us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":208,"num_ops":1,"prepare.queue_time_us":48,"prepare.run_cpu_time_us":601,"prepare.run_wall_time_us":687660,"raft.queue_time_us":38,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":165,"replication_time_us":704683,"spinlock_wait_cycles":54656,"thread_start_us":106,"threads_started":1}]]}
I20260812 08:01:41.434904  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:41.435112  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:41.435807  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:41.436194  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:41.436201  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:41.436800  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:41.437022  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:41.528395  3404 tablet_service.cc:3080] error setting up scanner 686d041ef28d44449b96568a53bbce5b with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.261s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
I20260812 08:01:41.613070  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:41.720342  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:41.720517  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:41.721208  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:41.721554  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:41.722230  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:41.722621  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:42.367401  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:42.919356  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:42.919515  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:42.920070  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:42.920550  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:42.920858  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:42.921710  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:42.945411  3756 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=35, attempt_no=0}) took 1195 ms. Trace:
I20260812 08:01:42.945526  3756 rpcz_store.cc:276] 0812 08:01:41.749495 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:41.749568 (+    73us) service_pool.cc:224] Handling call
0812 08:01:42.945390 (+1195822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:41.750047 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:41.750207 (+   160us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:41.750210 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:01:41.750212 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:41.750270 (+    58us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:41.750283 (+    13us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:41.750286 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:41.750323 (+    37us) tablet.cc:701] Row locks acquired
0812 08:01:41.750324 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:41.750356 (+    32us) write_op.cc:270] Start()
0812 08:01:42.578472 (+828116us) write_op.cc:276] Timestamp: P: 1786521701750324 usec, L: 0
0812 08:01:42.578475 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:42.578666 (+   191us) log.cc:844] Serialized 354 byte log entry
0812 08:01:42.944671 (+366005us) op_driver.cc:464] REPLICATION: finished
0812 08:01:42.945001 (+   330us) write_op.cc:301] APPLY: starting
0812 08:01:42.945022 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:42.945051 (+    29us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:42.945071 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:42.945136 (+    65us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:42.945160 (+    24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:42.945163 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:42.945238 (+    75us) log.cc:844] Serialized 22 byte log entry
0812 08:01:42.945293 (+    55us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:42.945305 (+    12us) write_op.cc:454] Released schema lock
0812 08:01:42.945311 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":248,"num_ops":1,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":666,"prepare.run_wall_time_us":828721,"raft.queue_time_us":50,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"replication_time_us":366132,"spinlock_wait_cycles":29184,"thread_start_us":108,"threads_started":1}]]}
I20260812 08:01:43.221347  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:43.538259  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:43.538411  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:43.538604  3452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:44993 (request call id 3040) took 1924 ms. Trace:
I20260812 08:01:43.539024  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:43.538679  3452 rpcz_store.cc:276] 0812 08:01:41.614438 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:41.614529 (+    91us) service_pool.cc:224] Handling call
0812 08:01:41.614690 (+   161us) raft_consensus.cc:1471] Updating replica for 3 ops
0812 08:01:41.614776 (+    86us) raft_consensus.cc:1534] Early marking committed up to index 0
0812 08:01:41.614778 (+     2us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0812 08:01:41.614893 (+   115us) write_op.cc:270] Start()
0812 08:01:42.243069 (+628176us) write_op.cc:276] Timestamp: P: 1786521701277417 usec, L: 0
0812 08:01:42.243548 (+   479us) write_op.cc:270] Start()
0812 08:01:42.552729 (+309181us) write_op.cc:276] Timestamp: P: 1786521701354360 usec, L: 0
0812 08:01:42.552965 (+   236us) write_op.cc:270] Start()
0812 08:01:43.537199 (+984234us) write_op.cc:276] Timestamp: P: 1786521701476160 usec, L: 0
0812 08:01:43.537749 (+   550us) log.cc:844] Serialized 1062 byte log entry
0812 08:01:43.537888 (+   139us) raft_consensus.cc:1645] Marking committed up to 34
0812 08:01:43.538038 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:01:43.538094 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:01:43.538530 (+   436us) raft_consensus.cc:1685] finished
0812 08:01:43.538532 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:01:43.538585 (+    53us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:42.243517 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:42.243644 (+   127us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:42.243648 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:42.243649 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:42.243716 (+    67us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:42.243725 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:42.243727 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:42.243800 (+    73us) tablet.cc:701] Row locks acquired
0812 08:01:42.243801 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:43.537932 (+1294131us) op_driver.cc:464] REPLICATION: finished
0812 08:01:43.538206 (+   274us) write_op.cc:301] APPLY: starting
0812 08:01:43.538223 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:43.538258 (+    35us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:43.538260 (+     2us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:43.538320 (+    60us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:43.538344 (+    24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:43.538364 (+    20us) write_op.cc:312] APPLY: finished
0812 08:01:43.538449 (+    85us) log.cc:844] Serialized 22 byte log entry
0812 08:01:43.538522 (+    73us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:43.538537 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:43.538543 (+     6us) write_op.cc:341] FINISH: Updating metrics
0812 08:01:43.538641 (+    98us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:43.538671 (+    30us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 08:01:42.552945 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:42.553058 (+   113us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:42.553063 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:42.553065 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:42.553176 (+   111us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:42.553216 (+    40us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:42.553220 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:42.553268 (+    48us) tablet.cc:701] Row locks acquired
0812 08:01:42.553270 (+     2us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:01:43.537590 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:43.537721 (+   131us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:43.537725 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:43.537727 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:43.537805 (+    78us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:43.537821 (+    16us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:43.537827 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:43.537881 (+    54us) tablet.cc:701] Row locks acquired
0812 08:01:43.537883 (+     2us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":82,"threads_started":1,"wal-append.queue_time_us":178,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":422,"apply.run_wall_time_us":421,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":254,"prepare.run_cpu_time_us":394,"prepare.run_wall_time_us":394,"replication_time_us":1923018,"thread_start_us":162,"threads_started":2}],["op",{"num_ops":1,"partition_lock_wait_us":31,"prepare.queue_time_us":76,"prepare.run_cpu_time_us":394,"prepare.run_wall_time_us":393}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":255,"prepare.run_cpu_time_us":355,"prepare.run_wall_time_us":355,"thread_start_us":143,"threads_started":1}]]}
I20260812 08:01:43.539602  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:43.539790  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:43.540432  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:43.540619  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:43.950431  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:43.950616  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:43.951164  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:43.951644  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:43.952432  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:43.952843  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:43.990594  3764 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=37, attempt_no=0}) took 1043 ms. Trace:
I20260812 08:01:43.990746  3764 rpcz_store.cc:276] 0812 08:01:42.947243 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:42.947307 (+    64us) service_pool.cc:224] Handling call
0812 08:01:43.990569 (+1043262us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:42.947759 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:42.947890 (+   131us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:42.947894 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:42.947895 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:42.947960 (+    65us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:42.947975 (+    15us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:42.947977 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:42.948012 (+    35us) tablet.cc:701] Row locks acquired
0812 08:01:42.948013 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:42.948043 (+    30us) write_op.cc:270] Start()
0812 08:01:43.502291 (+554248us) write_op.cc:276] Timestamp: P: 1786521702948017 usec, L: 0
0812 08:01:43.502295 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:43.502514 (+   219us) log.cc:844] Serialized 354 byte log entry
0812 08:01:43.989693 (+487179us) op_driver.cc:464] REPLICATION: finished
0812 08:01:43.990043 (+   350us) write_op.cc:301] APPLY: starting
0812 08:01:43.990071 (+    28us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:43.990167 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:43.990187 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:43.990253 (+    66us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:43.990284 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:43.990287 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:43.990363 (+    76us) log.cc:844] Serialized 22 byte log entry
0812 08:01:43.990448 (+    85us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:43.990464 (+    16us) write_op.cc:454] Released schema lock
0812 08:01:43.990470 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":248,"mutex_wait_us":62,"num_ops":1,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":770,"prepare.run_wall_time_us":554951,"raft.queue_time_us":130,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"replication_time_us":487330,"spinlock_wait_cycles":131072,"thread_start_us":114,"threads_started":1}]]}
I20260812 08:01:44.202479  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:44.619298  3404 tablet_service.cc:3080] error setting up scanner e214b6c0eb0648629f97be285589c85a with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521703619037 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521701476160 usec, L: 0 Physical time difference: 2.143s: new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:44.619642  3404 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:58006 (request call id 24) took 1001 ms. Trace:
I20260812 08:01:44.619743  3404 rpcz_store.cc:276] 0812 08:01:43.618410 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:43.618504 (+    94us) service_pool.cc:224] Handling call
0812 08:01:43.618723 (+   219us) tablet_service.cc:2890] Created scanner e214b6c0eb0648629f97be285589c85a for tablet 4536d08ec31b4a218bbeee99964809e2, query id is c64e6f3ff0bc4cfebe422ea00b757086
0812 08:01:43.619048 (+   325us) tablet_service.cc:3030] Creating iterator
0812 08:01:43.619076 (+    28us) tablet_service.cc:3408] Waiting safe time to advance
0812 08:01:44.619270 (+1000194us) tablet_service.cc:3055] Iterator created
0812 08:01:44.619286 (+    16us) tablet_service.cc:3077] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521703619037 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521701476160 usec, L: 0 Physical time difference: 2.143s
0812 08:01:44.619632 (+   346us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260812 08:01:44.863449  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:44.863597  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:44.863670  3452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:44993 (request call id 3041) took 1322 ms. Trace:
I20260812 08:01:44.863749  3452 rpcz_store.cc:276] 0812 08:01:43.540766 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:43.540808 (+    42us) service_pool.cc:224] Handling call
0812 08:01:43.540934 (+   126us) raft_consensus.cc:1471] Updating replica for 3 ops
0812 08:01:43.541000 (+    66us) raft_consensus.cc:1534] Early marking committed up to index 36
0812 08:01:43.541193 (+   193us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0812 08:01:43.541323 (+   130us) write_op.cc:270] Start()
0812 08:01:43.869517 (+328194us) write_op.cc:276] Timestamp: P: 1786521701750324 usec, L: 0
0812 08:01:43.869823 (+   306us) write_op.cc:270] Start()
0812 08:01:44.287965 (+418142us) write_op.cc:276] Timestamp: P: 1786521702579138 usec, L: 0
0812 08:01:44.288244 (+   279us) write_op.cc:270] Start()
0812 08:01:44.862429 (+574185us) write_op.cc:276] Timestamp: P: 1786521702948017 usec, L: 0
0812 08:01:44.862908 (+   479us) log.cc:844] Serialized 1062 byte log entry
0812 08:01:44.863047 (+   139us) raft_consensus.cc:1645] Marking committed up to 38
0812 08:01:44.863339 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:01:44.863395 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:01:44.863574 (+   179us) raft_consensus.cc:1685] finished
0812 08:01:44.863576 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:01:44.863647 (+    71us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:43.869804 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:43.869922 (+   118us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:43.869926 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:43.869927 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:43.869990 (+    63us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:43.870007 (+    17us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:43.870009 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:43.870049 (+    40us) tablet.cc:701] Row locks acquired
0812 08:01:43.870050 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:44.863108 (+993058us) op_driver.cc:464] REPLICATION: finished
0812 08:01:44.863321 (+   213us) write_op.cc:301] APPLY: starting
0812 08:01:44.863334 (+    13us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:44.863360 (+    26us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:44.863361 (+     1us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:44.863436 (+    75us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:44.863464 (+    28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:44.863489 (+    25us) write_op.cc:312] APPLY: finished
0812 08:01:44.863582 (+    93us) log.cc:844] Serialized 22 byte log entry
0812 08:01:44.863651 (+    69us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:44.863661 (+    10us) write_op.cc:454] Released schema lock
0812 08:01:44.863666 (+     5us) write_op.cc:341] FINISH: Updating metrics
0812 08:01:44.863744 (+    78us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:44.863746 (+     2us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 08:01:44.288186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:44.288304 (+   118us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:44.288308 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:44.288310 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:44.288378 (+    68us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:44.288386 (+     8us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:44.288388 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:44.288422 (+    34us) tablet.cc:701] Row locks acquired
0812 08:01:44.288423 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:44.863252 (+574829us) op_driver.cc:464] REPLICATION: finished
0812 08:01:44.863478 (+   226us) write_op.cc:301] APPLY: starting
0812 08:01:44.863492 (+    14us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:44.863514 (+    22us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:44.863515 (+     1us) tablet.cc:1372] starting ApplyRowOperation cycle
Related trace 'op':
0812 08:01:44.862856 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:44.862996 (+   140us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:44.863001 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:44.863003 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:44.863107 (+   104us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:44.863117 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:44.863119 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:44.863167 (+    48us) tablet.cc:701] Row locks acquired
0812 08:01:44.863168 (+     1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":87,"threads_started":1,"wal-append.queue_time_us":174,"child_traces":[["op",{"apply.queue_time_us":175,"apply.run_cpu_time_us":410,"apply.run_wall_time_us":409,"num_ops":1,"partition_lock_wait_us":11,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":340,"prepare.run_wall_time_us":341,"replication_time_us":1321760,"thread_start_us":75,"threads_started":1}],["op",{"apply.queue_time_us":191,"num_ops":1,"partition_lock_wait_us":4,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":354,"prepare.run_wall_time_us":353,"replication_time_us":993411,"thread_start_us":49,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":270,"prepare.run_cpu_time_us":373,"prepare.run_wall_time_us":373,"thread_start_us":107,"threads_started":1}]]}
I20260812 08:01:44.864197  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:44.864720  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:44.864884  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:44.865324  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:45.518508  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:45.518682  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:45.519328  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:45.519732  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:45.519798  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:45.520355  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:45.559914  3777 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=39, attempt_no=0}) took 1567 ms. Trace:
I20260812 08:01:45.560016  3777 rpcz_store.cc:276] 0812 08:01:43.992312 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:43.992396 (+    84us) service_pool.cc:224] Handling call
0812 08:01:45.559892 (+1567496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:43.992882 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:43.993005 (+   123us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:43.993009 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:43.993010 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:43.993067 (+    57us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:43.993075 (+     8us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:43.993077 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:43.993109 (+    32us) tablet.cc:701] Row locks acquired
0812 08:01:43.993110 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:43.993142 (+    32us) write_op.cc:270] Start()
0812 08:01:44.586288 (+593146us) write_op.cc:276] Timestamp: P: 1786521703993093 usec, L: 0
0812 08:01:44.586292 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:44.586450 (+   158us) log.cc:844] Serialized 354 byte log entry
0812 08:01:45.559006 (+972556us) op_driver.cc:464] REPLICATION: finished
0812 08:01:45.559330 (+   324us) write_op.cc:301] APPLY: starting
0812 08:01:45.559350 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:45.559378 (+    28us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:45.559395 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:45.559464 (+    69us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:45.559489 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:45.559492 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:45.559584 (+    92us) log.cc:844] Serialized 22 byte log entry
0812 08:01:45.559640 (+    56us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:45.559653 (+    13us) write_op.cc:454] Released schema lock
0812 08:01:45.559780 (+   127us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":245,"mutex_wait_us":69,"num_ops":1,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":665,"prepare.run_wall_time_us":593777,"raft.queue_time_us":116,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":161,"replication_time_us":972655,"spinlock_wait_cycles":350336,"thread_start_us":108,"threads_started":1}]]}
I20260812 08:01:46.085827  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:46.101833  3783 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=40, attempt_no=0}) took 1882 ms. Trace:
I20260812 08:01:46.101935  3783 rpcz_store.cc:276] 0812 08:01:44.219464 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:44.219570 (+   106us) service_pool.cc:224] Handling call
0812 08:01:46.101811 (+1882241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:44.586689 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:44.586812 (+   123us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:44.586816 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:44.586818 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:44.586892 (+    74us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:44.586902 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:44.586908 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:44.586958 (+    50us) tablet.cc:701] Row locks acquired
0812 08:01:44.586959 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:44.586996 (+    37us) write_op.cc:270] Start()
0812 08:01:45.153171 (+566175us) write_op.cc:276] Timestamp: P: 1786521704586944 usec, L: 0
0812 08:01:45.153175 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:45.153393 (+   218us) log.cc:844] Serialized 354 byte log entry
0812 08:01:46.101114 (+947721us) op_driver.cc:464] REPLICATION: finished
0812 08:01:46.101416 (+   302us) write_op.cc:301] APPLY: starting
0812 08:01:46.101434 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:46.101462 (+    28us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:46.101475 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:46.101532 (+    57us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:46.101557 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:46.101560 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:46.101624 (+    64us) log.cc:844] Serialized 22 byte log entry
0812 08:01:46.101708 (+    84us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:46.101723 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:46.101728 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":240,"num_ops":1,"prepare.queue_time_us":366764,"prepare.run_cpu_time_us":727,"prepare.run_wall_time_us":566807,"replication_time_us":947890,"thread_start_us":96,"threads_started":1}]]}
W20260812 08:01:46.138441  3404 tablet_service.cc:3080] error setting up scanner bf635e877e3e4c298b1f6bb774fc1ce8 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.273s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
I20260812 08:01:46.334401  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:46.334707  3452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:44993 (request call id 3042) took 1469 ms. Trace:
I20260812 08:01:46.334774  3452 rpcz_store.cc:276] 0812 08:01:44.865192 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:44.865269 (+    77us) service_pool.cc:224] Handling call
0812 08:01:44.865407 (+   138us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:01:44.865508 (+   101us) raft_consensus.cc:1534] Early marking committed up to index 39
0812 08:01:44.865604 (+    96us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:01:44.865737 (+   133us) write_op.cc:270] Start()
0812 08:01:45.696903 (+831166us) write_op.cc:276] Timestamp: P: 1786521703503065 usec, L: 0
0812 08:01:45.697287 (+   384us) write_op.cc:270] Start()
0812 08:01:46.333461 (+636174us) write_op.cc:276] Timestamp: P: 1786521703993093 usec, L: 0
0812 08:01:46.333963 (+   502us) log.cc:844] Serialized 708 byte log entry
0812 08:01:46.334112 (+   149us) raft_consensus.cc:1645] Marking committed up to 40
0812 08:01:46.334308 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:01:46.334356 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:01:46.334635 (+   279us) raft_consensus.cc:1685] finished
0812 08:01:46.334638 (+     3us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:01:46.334689 (+    51us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:45.697297 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:45.697406 (+   109us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:45.697410 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:45.697411 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:45.697469 (+    58us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:45.697479 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:45.697481 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:45.697519 (+    38us) tablet.cc:701] Row locks acquired
0812 08:01:45.697520 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:46.334196 (+636676us) op_driver.cc:464] REPLICATION: finished
0812 08:01:46.334447 (+   251us) write_op.cc:301] APPLY: starting
0812 08:01:46.334464 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:46.334497 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:46.334499 (+     2us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:46.334557 (+    58us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:46.334593 (+    36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
Related trace 'op':
0812 08:01:46.333833 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:46.333959 (+   126us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:46.333963 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:46.333965 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:46.334046 (+    81us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:46.334063 (+    17us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:46.334069 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:46.334119 (+    50us) tablet.cc:701] Row locks acquired
0812 08:01:46.334121 (+     2us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":93,"threads_started":1,"wal-append.queue_time_us":268,"child_traces":[["op",{"apply.queue_time_us":203,"num_ops":1,"partition_lock_wait_us":4,"prepare.queue_time_us":249,"prepare.run_cpu_time_us":305,"prepare.run_wall_time_us":306,"replication_time_us":1468435,"spinlock_wait_cycles":768,"thread_start_us":157,"threads_started":2}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":248,"prepare.run_cpu_time_us":397,"prepare.run_wall_time_us":398,"thread_start_us":133,"threads_started":1}]]}
I20260812 08:01:46.737013  3622 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:46.737210  3622 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:46.737816  3622 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:46.738306  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:46.738358  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:46.738849  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:46.739056  3622 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:46.767254  3788 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=41, attempt_no=0}) took 1205 ms. Trace:
I20260812 08:01:46.767385  3788 rpcz_store.cc:276] 0812 08:01:45.561620 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:45.561686 (+    66us) service_pool.cc:224] Handling call
0812 08:01:46.767216 (+1205530us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:45.562114 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:45.562268 (+   154us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:45.562272 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:45.562273 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:45.562328 (+    55us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:45.562334 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:45.562336 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:45.562367 (+    31us) tablet.cc:701] Row locks acquired
0812 08:01:45.562368 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:45.562400 (+    32us) write_op.cc:270] Start()
0812 08:01:46.213544 (+651144us) write_op.cc:276] Timestamp: P: 1786521705562337 usec, L: 0
0812 08:01:46.213546 (+     2us) op_driver.cc:348] REPLICATION: starting
0812 08:01:46.213700 (+   154us) log.cc:844] Serialized 354 byte log entry
0812 08:01:46.766497 (+552797us) op_driver.cc:464] REPLICATION: finished
0812 08:01:46.766804 (+   307us) write_op.cc:301] APPLY: starting
0812 08:01:46.766827 (+    23us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:46.766860 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:46.766875 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:46.766959 (+    84us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:46.766995 (+    36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:46.767000 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:46.767069 (+    69us) log.cc:844] Serialized 22 byte log entry
0812 08:01:46.767137 (+    68us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:46.767148 (+    11us) write_op.cc:454] Released schema lock
0812 08:01:46.767153 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":243,"num_ops":1,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":580,"prepare.run_wall_time_us":651643,"replication_time_us":552906,"thread_start_us":125,"threads_started":1}]]}
I20260812 08:01:46.904083  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:46.904229  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:46.904759  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:46.905352  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:46.906003  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:46.906538  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
W20260812 08:01:47.181933  3404 tablet_service.cc:3080] error setting up scanner 1c8c7394ea5b415a9b2140b187ced81c with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.347s (maximum allowed 0.100s): new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:47.510941  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:47.511108  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:47.511737  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:47.512172  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:47.512190  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:47.512737  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:47.512895  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:47.808753  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:48.247807  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:48.247972  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:48.248543  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:48.249068  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:48.249176  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:48.249639  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:48.249836  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:48.256930  3801 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=44, attempt_no=0}) took 1401 ms. Trace:
I20260812 08:01:48.257053  3801 rpcz_store.cc:276] 0812 08:01:46.855768 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:46.855819 (+    51us) service_pool.cc:224] Handling call
0812 08:01:48.256899 (+1401080us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:47.319440 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:47.319569 (+   129us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:47.319574 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:47.319576 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:47.319656 (+    80us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:47.319666 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:47.319669 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:47.319744 (+    75us) tablet.cc:701] Row locks acquired
0812 08:01:47.319745 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:47.319792 (+    47us) write_op.cc:270] Start()
0812 08:01:47.719971 (+400179us) write_op.cc:276] Timestamp: P: 1786521707319705 usec, L: 0
0812 08:01:47.719975 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:47.720204 (+   229us) log.cc:844] Serialized 354 byte log entry
0812 08:01:48.256178 (+535974us) op_driver.cc:464] REPLICATION: finished
0812 08:01:48.256416 (+   238us) write_op.cc:301] APPLY: starting
0812 08:01:48.256433 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:48.256489 (+    56us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:48.256505 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:48.256566 (+    61us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:48.256597 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:48.256601 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:48.256698 (+    97us) log.cc:844] Serialized 22 byte log entry
0812 08:01:48.256798 (+   100us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:48.256814 (+    16us) write_op.cc:454] Released schema lock
0812 08:01:48.256820 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":180,"num_ops":1,"prepare.queue_time_us":463281,"prepare.run_cpu_time_us":734,"prepare.run_wall_time_us":400829,"replication_time_us":536144,"thread_start_us":85,"threads_started":1}]]}
I20260812 08:01:48.774085  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:48.774266  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:48.774753  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:48.775415  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:48.775466  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 46 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:48.776043  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:48.896477  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:48.896643  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:48.897269  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:48.897682  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:48.898036  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 47 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:48.898506  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:48.898671  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:48.935786  3807 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=45, attempt_no=0}) took 1409 ms. Trace:
I20260812 08:01:48.935886  3807 rpcz_store.cc:276] 0812 08:01:47.525918 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:47.525996 (+    78us) service_pool.cc:224] Handling call
0812 08:01:48.935764 (+1409768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:47.720308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:47.720451 (+   143us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:47.720455 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:47.720457 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:47.720561 (+   104us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:47.720571 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:47.720574 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:47.720626 (+    52us) tablet.cc:701] Row locks acquired
0812 08:01:47.720627 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:47.720675 (+    48us) write_op.cc:270] Start()
0812 08:01:48.348826 (+628151us) write_op.cc:276] Timestamp: P: 1786521707720612 usec, L: 0
0812 08:01:48.348829 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:48.349011 (+   182us) log.cc:844] Serialized 354 byte log entry
0812 08:01:48.934993 (+585982us) op_driver.cc:464] REPLICATION: finished
0812 08:01:48.935314 (+   321us) write_op.cc:301] APPLY: starting
0812 08:01:48.935335 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:48.935369 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:48.935384 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:48.935449 (+    65us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:48.935486 (+    37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:48.935491 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:48.935565 (+    74us) log.cc:844] Serialized 22 byte log entry
0812 08:01:48.935644 (+    79us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:48.935682 (+    38us) write_op.cc:454] Released schema lock
0812 08:01:48.935688 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":228,"num_ops":1,"prepare.queue_time_us":193813,"prepare.run_cpu_time_us":708,"prepare.run_wall_time_us":628780,"replication_time_us":586126,"spinlock_wait_cycles":14080,"thread_start_us":119,"threads_started":1}]]}
I20260812 08:01:49.704409  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:49.880923  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:49.881152  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:49.881799  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:49.882303  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 48 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:49.882332  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 48 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:49.883018  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:49.883399  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:49.924403  3816 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=46, attempt_no=0}) took 1665 ms. Trace:
I20260812 08:01:49.924496  3816 rpcz_store.cc:276] 0812 08:01:48.258495 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:48.258538 (+    43us) service_pool.cc:224] Handling call
0812 08:01:49.924384 (+1665846us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:48.349130 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:48.349256 (+   126us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:48.349261 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:48.349263 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:48.349339 (+    76us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:48.349349 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:48.349352 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:48.349398 (+    46us) tablet.cc:701] Row locks acquired
0812 08:01:48.349405 (+     7us) write_op.cc:260] PREPARE: finished
0812 08:01:48.349438 (+    33us) write_op.cc:270] Start()
0812 08:01:49.133579 (+784141us) write_op.cc:276] Timestamp: P: 1786521708349388 usec, L: 0
0812 08:01:49.133583 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:49.133757 (+   174us) log.cc:844] Serialized 354 byte log entry
0812 08:01:49.923689 (+789932us) op_driver.cc:464] REPLICATION: finished
0812 08:01:49.923977 (+   288us) write_op.cc:301] APPLY: starting
0812 08:01:49.923994 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:49.924021 (+    27us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:49.924034 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:49.924089 (+    55us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:49.924114 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:49.924117 (+     3us) write_op.cc:312] APPLY: finished
0812 08:01:49.924179 (+    62us) log.cc:844] Serialized 22 byte log entry
0812 08:01:49.924280 (+   101us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:49.924295 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:49.924301 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":223,"num_ops":1,"prepare.queue_time_us":90253,"prepare.run_cpu_time_us":656,"prepare.run_wall_time_us":784710,"replication_time_us":790044,"thread_start_us":146,"threads_started":1}]]}
I20260812 08:01:50.423512  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:50.423689  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:50.424293  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:50.424700  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 48 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:50.424716  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 48 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:50.425181  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:50.500406  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:50.500577  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:50.501271  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:50.501786  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:50.501855  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 49 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:50.502386  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:50.502614  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:50.548585  3822 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=47, attempt_no=0}) took 1611 ms. Trace:
I20260812 08:01:50.548691  3822 rpcz_store.cc:276] 0812 08:01:48.937403 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:48.937456 (+    53us) service_pool.cc:224] Handling call
0812 08:01:50.548563 (+1611107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:49.133871 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:49.134012 (+   141us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:49.134017 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:49.134019 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:49.134180 (+   161us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:49.134190 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:49.134193 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:49.134239 (+    46us) tablet.cc:701] Row locks acquired
0812 08:01:49.134240 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:49.134315 (+    75us) write_op.cc:270] Start()
0812 08:01:49.998462 (+864147us) write_op.cc:276] Timestamp: P: 1786521709134231 usec, L: 0
0812 08:01:49.998465 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:49.998627 (+   162us) log.cc:844] Serialized 354 byte log entry
0812 08:01:50.547845 (+549218us) op_driver.cc:464] REPLICATION: finished
0812 08:01:50.548145 (+   300us) write_op.cc:301] APPLY: starting
0812 08:01:50.548171 (+    26us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:50.548199 (+    28us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:50.548212 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:50.548275 (+    63us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:50.548306 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:50.548310 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:50.548371 (+    61us) log.cc:844] Serialized 22 byte log entry
0812 08:01:50.548465 (+    94us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:50.548480 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:50.548485 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":205,"num_ops":1,"prepare.queue_time_us":196054,"prepare.run_cpu_time_us":790,"prepare.run_wall_time_us":864868,"raft.queue_time_us":192,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":549333,"thread_start_us":103,"threads_started":1}]]}
W20260812 08:01:50.980834  3404 tablet_service.cc:3080] error setting up scanner d0e379e31d9043e7a22e17eb406b0e8e with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521709980569 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521709134231 usec, L: 0 Physical time difference: 0.846s: new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "66e95765ad864e888367c0d0ed69a798"
I20260812 08:01:50.981300  3404 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:58006 (request call id 27) took 1001 ms. Trace:
I20260812 08:01:50.981384  3404 rpcz_store.cc:276] 0812 08:01:49.980041 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:49.980108 (+    67us) service_pool.cc:224] Handling call
0812 08:01:49.980289 (+   181us) tablet_service.cc:2890] Created scanner d0e379e31d9043e7a22e17eb406b0e8e for tablet 4536d08ec31b4a218bbeee99964809e2, query id is 66e95765ad864e888367c0d0ed69a798
0812 08:01:49.980582 (+   293us) tablet_service.cc:3030] Creating iterator
0812 08:01:49.980607 (+    25us) tablet_service.cc:3408] Waiting safe time to advance
0812 08:01:50.980798 (+1000191us) tablet_service.cc:3055] Iterator created
0812 08:01:50.980820 (+    22us) tablet_service.cc:3077] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521709980569 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521709134231 usec, L: 0 Physical time difference: 0.846s
0812 08:01:50.981285 (+   465us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260812 08:01:51.004338  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:51.018817  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:51.018996  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:51.019656  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:51.020090  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:51.020123  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:51.020558  3822 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=48, attempt_no=0}) took 1094 ms. Trace:
I20260812 08:01:51.020660  3822 rpcz_store.cc:276] 0812 08:01:49.926096 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:49.926161 (+    65us) service_pool.cc:224] Handling call
0812 08:01:51.020546 (+1094385us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:49.998782 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:49.998903 (+   121us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:49.998908 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:49.998909 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:49.998989 (+    80us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:49.998999 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:49.999002 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:49.999049 (+    47us) tablet.cc:701] Row locks acquired
0812 08:01:49.999050 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:49.999093 (+    43us) write_op.cc:270] Start()
0812 08:01:50.882251 (+883158us) write_op.cc:276] Timestamp: P: 1786521709999056 usec, L: 0
0812 08:01:50.882255 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:50.882419 (+   164us) log.cc:844] Serialized 354 byte log entry
0812 08:01:51.020016 (+137597us) op_driver.cc:464] REPLICATION: finished
0812 08:01:51.020120 (+   104us) write_op.cc:301] APPLY: starting
0812 08:01:51.020137 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:51.020167 (+    30us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:51.020183 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:51.020256 (+    73us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:51.020284 (+    28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:51.020289 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:51.020356 (+    67us) log.cc:844] Serialized 22 byte log entry
0812 08:01:51.020453 (+    97us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:51.020467 (+    14us) write_op.cc:454] Released schema lock
0812 08:01:51.020474 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":55,"num_ops":1,"prepare.queue_time_us":72189,"prepare.run_cpu_time_us":637,"prepare.run_wall_time_us":883714,"replication_time_us":137727}]]}
I20260812 08:01:51.021034  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:51.021219  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:51.461164  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:51.461370  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:51.461951  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:51.462496  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:51.462561  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:51.462957  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:51.532356  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:51.532511  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:51.533154  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:51.533659  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 51 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:51.533874  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 51 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:51.534322  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:51.534528  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:51.566561  3830 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=49, attempt_no=0}) took 1016 ms. Trace:
I20260812 08:01:51.566699  3830 rpcz_store.cc:276] 0812 08:01:50.550192 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:50.550259 (+    67us) service_pool.cc:224] Handling call
0812 08:01:51.566540 (+1016281us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:50.882532 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:50.882681 (+   149us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:50.882686 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:50.882687 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:50.882764 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:50.882775 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:50.882778 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:50.882828 (+    50us) tablet.cc:701] Row locks acquired
0812 08:01:50.882829 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:01:50.882866 (+    37us) write_op.cc:270] Start()
0812 08:01:51.277035 (+394169us) write_op.cc:276] Timestamp: P: 1786521710882805 usec, L: 0
0812 08:01:51.277038 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:51.277266 (+   228us) log.cc:844] Serialized 354 byte log entry
0812 08:01:51.565751 (+288485us) op_driver.cc:464] REPLICATION: finished
0812 08:01:51.566080 (+   329us) write_op.cc:301] APPLY: starting
0812 08:01:51.566100 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:51.566133 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:51.566177 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:51.566249 (+    72us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:51.566282 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:51.566286 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:51.566364 (+    78us) log.cc:844] Serialized 22 byte log entry
0812 08:01:51.566428 (+    64us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:51.566443 (+    15us) write_op.cc:454] Released schema lock
0812 08:01:51.566448 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":262,"num_ops":1,"prepare.queue_time_us":331850,"prepare.run_cpu_time_us":725,"prepare.run_wall_time_us":394800,"replication_time_us":288662,"thread_start_us":110,"threads_started":1}]]}
W20260812 08:01:52.024101  3404 tablet_service.cc:3080] error setting up scanner c5fbb7db047147e88d5d7cb56aa5a1f5 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521711023783 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521710882805 usec, L: 0 Physical time difference: 0.141s: new_scan_request { tablet_id: "4536d08ec31b4a218bbeee99964809e2" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT cache_blocks: true order_mode: ORDERED row_format_flags: 0 authz_token { token_data: "\010\376\322\360\323\006\"3\n\005slave\022*\n e3ca0873806e43eba74992833197f7b2\020\001\030\001 \001(\001" signature: "<redacted>""\226gr\307\235\255eI\007\217\006W\210<\270\220\030\335\371\260m\235H\363J\0265\223]\031\336\202\317\245\274\355\276S\331l@\202\034\243\300E\177\345\234\365\262Hy&-Q\013\215\272\231\224\200\350\211" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "c64e6f3ff0bc4cfebe422ea00b757086"
I20260812 08:01:52.024523  3404 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:58006 (request call id 28) took 1001 ms. Trace:
I20260812 08:01:52.024602  3404 rpcz_store.cc:276] 0812 08:01:51.023328 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:51.023406 (+    78us) service_pool.cc:224] Handling call
0812 08:01:51.023590 (+   184us) tablet_service.cc:2890] Created scanner c5fbb7db047147e88d5d7cb56aa5a1f5 for tablet 4536d08ec31b4a218bbeee99964809e2, query id is c64e6f3ff0bc4cfebe422ea00b757086
0812 08:01:51.023811 (+   221us) tablet_service.cc:3030] Creating iterator
0812 08:01:51.023835 (+    24us) tablet_service.cc:3408] Waiting safe time to advance
0812 08:01:52.024070 (+1000235us) tablet_service.cc:3055] Iterator created
0812 08:01:52.024087 (+    17us) tablet_service.cc:3077] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786521711023783 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786521710882805 usec, L: 0 Physical time difference: 0.141s
0812 08:01:52.024511 (+   424us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260812 08:01:52.301790  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:52.570259  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:52.570447  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:52.570999  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:52.571466  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 52 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:52.571812  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 52 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:52.572328  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:52.572495  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:52.582345  3839 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=50, attempt_no=0}) took 1560 ms. Trace:
I20260812 08:01:52.582525  3839 rpcz_store.cc:276] 0812 08:01:51.022156 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:51.022233 (+    77us) service_pool.cc:224] Handling call
0812 08:01:52.582320 (+1560087us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:51.277382 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:51.277514 (+   132us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:51.277519 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:51.277521 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:51.277604 (+    83us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:51.277614 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:51.277618 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:51.277677 (+    59us) tablet.cc:701] Row locks acquired
0812 08:01:51.277679 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:51.277721 (+    42us) write_op.cc:270] Start()
0812 08:01:51.968883 (+691162us) write_op.cc:276] Timestamp: P: 1786521711277642 usec, L: 0
0812 08:01:51.968886 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:51.969045 (+   159us) log.cc:844] Serialized 354 byte log entry
0812 08:01:52.581603 (+612558us) op_driver.cc:464] REPLICATION: finished
0812 08:01:52.581854 (+   251us) write_op.cc:301] APPLY: starting
0812 08:01:52.581877 (+    23us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:52.581921 (+    44us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:52.581938 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:52.582009 (+    71us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:52.582038 (+    29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:52.582043 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:52.582122 (+    79us) log.cc:844] Serialized 22 byte log entry
0812 08:01:52.582206 (+    84us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:52.582225 (+    19us) write_op.cc:454] Released schema lock
0812 08:01:52.582233 (+     8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":191,"num_ops":1,"prepare.queue_time_us":254706,"prepare.run_cpu_time_us":675,"prepare.run_wall_time_us":691756,"replication_time_us":612639,"thread_start_us":97,"threads_started":1}]]}
I20260812 08:01:52.964598  3719 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:52.964769  3719 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:52.965463  3719 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:52.965972  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 52 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:52.965969  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 52 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:52.966804  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:53.227908  3791 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:53.228073  3791 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:53.228817  3791 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:53.229311  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:53.229367  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:53.230288  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:53.230473  3791 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:53.253201  3845 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:54314 (ReqId={client: c5b582bbe22c4c208a776163eab7e7d3, seq_no=51, attempt_no=0}) took 1685 ms. Trace:
I20260812 08:01:53.253321  3845 rpcz_store.cc:276] 0812 08:01:51.568032 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:51.568080 (+    48us) service_pool.cc:224] Handling call
0812 08:01:53.253178 (+1685098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:51.969174 (+     0us) write_op.cc:183] PREPARE: starting on tablet 4536d08ec31b4a218bbeee99964809e2
0812 08:01:51.969302 (+   128us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:51.969307 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:51.969308 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:51.969403 (+    95us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:51.969418 (+    15us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:51.969423 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:51.969471 (+    48us) tablet.cc:701] Row locks acquired
0812 08:01:51.969474 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:01:51.969524 (+    50us) write_op.cc:270] Start()
0812 08:01:52.941707 (+972183us) write_op.cc:276] Timestamp: P: 1786521711969485 usec, L: 0
0812 08:01:52.941711 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:01:52.941876 (+   165us) log.cc:844] Serialized 354 byte log entry
0812 08:01:53.252236 (+310360us) op_driver.cc:464] REPLICATION: finished
0812 08:01:53.252718 (+   482us) write_op.cc:301] APPLY: starting
0812 08:01:53.252743 (+    25us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:53.252780 (+    37us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:53.252795 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:53.252875 (+    80us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:53.252914 (+    39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:53.252918 (+     4us) write_op.cc:312] APPLY: finished
0812 08:01:53.252987 (+    69us) log.cc:844] Serialized 22 byte log entry
0812 08:01:53.253072 (+    85us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:53.253089 (+    17us) write_op.cc:454] Released schema lock
0812 08:01:53.253094 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":391,"num_ops":1,"prepare.queue_time_us":400787,"prepare.run_cpu_time_us":740,"prepare.run_wall_time_us":972796,"raft.queue_time_us":61,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":172,"replication_time_us":310484,"thread_start_us":177,"threads_started":1}]]}
I20260812 08:01:53.676538  3719 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:54.317190  3558 scanner-internal.cc:458] Time spent opening tablet: real 31.923s	user 0.008s	sys 0.000s
I20260812 08:01:54.512012  3851 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:54.512239  3851 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:54.512754  3851 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:54.513032  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:54.513516  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:54.513935  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:54.514143  3851 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:01:55.101698  3557 scanner-internal.cc:458] Time spent opening tablet: real 32.708s	user 0.009s	sys 0.000s
I20260812 08:01:55.138298  3868 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.138473  3868 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.139002  3868 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.139680  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.140172  3869 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.140306  3869 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.140849  3869 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.141191  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:55.142917  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:55.143087  3452 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a62d8151ca45cc8dc5074bcd719148 in term 1.
I20260812 08:01:55.143313  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.143416  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43174691357048359daa1eca5a316a75, e0a62d8151ca45cc8dc5074bcd719148; no voters: c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:55.143766  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:55.144369  3869 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:55.145848  3868 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:01:55.145941  3868 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.146004  3868 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:01:55.147312  3868 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.147567  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.147778  3868 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 election: Requested vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.148073  3820 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.148146  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75"
I20260812 08:01:55.148432  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e"
I20260812 08:01:55.148988  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:55.149351  3868 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 08:01:55.149834  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.150871  3846 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.152463  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.152921  3875 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.154572  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.154953  3875 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.156697  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.157073  3868 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:55.157212  3846 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.157166  3868 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.157961  3868 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.158392  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 3 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.158573  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 3 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:55.159065  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.159185  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:55.159399  3868 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:01:55.159472  3846 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.161161  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.161592  3875 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.163331  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.163710  3875 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.165378  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.167068  3875 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.168974  3868 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:55.169085  3868 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.169260  3299 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Rejecting Update request from peer c965722d7f0e4bd8948e3560c43cc14e for earlier term 1. Current term is 2. Ops: []
I20260812 08:01:55.169443  3820 raft_consensus.cc:3055] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:01:55.169488  3868 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.169523  3820 raft_consensus.cc:740] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c965722d7f0e4bd8948e3560c43cc14e, State: Running, Role: LEADER
I20260812 08:01:55.169725  3820 consensus_queue.cc:260] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 1.53, Last appended by leader: 53, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.169984  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 3 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:55.170241  3820 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 1 FOLLOWER]: Advancing to term 2
W20260812 08:01:55.170253  3069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:01:55.171849  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 3 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.171988  3142 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0a62d8151ca45cc8dc5074bcd719148 in term 2.
I20260812 08:01:55.172272  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75
I20260812 08:01:55.172458  3868 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:01:55.172513  3868 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:55.172570  3868 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:55.173722  3868 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.174176  3868 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 3 election: Requested vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.174546  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 3 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75"
I20260812 08:01:55.174974  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 3 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e"
I20260812 08:01:55.175089  3142 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:01:55.175349  3869 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.175441  3869 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.175817  3869 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.176105  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:55.176213  3299 raft_consensus.cc:2368] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43174691357048359daa1eca5a316a75 for earlier term 2. Current term is 3.
I20260812 08:01:55.176192  3142 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0a62d8151ca45cc8dc5074bcd719148 in term 3.
I20260812 08:01:55.176460  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75
I20260812 08:01:55.176630  3377 leader_election.cc:400] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519) with higher term. Message: Invalid argument: T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43174691357048359daa1eca5a316a75 for earlier term 2. Current term is 3.
I20260812 08:01:55.176699  3377 leader_election.cc:403] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260812 08:01:55.176919  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 2 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.177009  3869 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 1 FOLLOWER]: Advancing to term 3
I20260812 08:01:55.177055  3142 raft_consensus.cc:2368] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43174691357048359daa1eca5a316a75 for earlier term 2. Current term is 3.
I20260812 08:01:55.177397  3375 leader_election.cc:400] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227) with higher term. Message: Invalid argument: T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43174691357048359daa1eca5a316a75 for earlier term 2. Current term is 3.
I20260812 08:01:55.177984  3869 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519) with higher term. Message: Invalid argument: T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43174691357048359daa1eca5a316a75 for earlier term 2. Current term is 3.
I20260812 08:01:55.178601  3868 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:01:55.178823  3868 raft_consensus.cc:697] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 LEADER]: Becoming Leader. State: Replica: e0a62d8151ca45cc8dc5074bcd719148, State: Running, Role: LEADER
I20260812 08:01:55.179189  3868 consensus_queue.cc:237] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 1.53, Last appended by leader: 53, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.179608  3272 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:55.181226  3427 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:55.181967  2973 catalog_manager.cc:5719] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 reported cstate change: term changed from 1 to 3, leader changed from c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129) to e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130). New cstate: current_term: 3 leader_uuid: "e0a62d8151ca45cc8dc5074bcd719148" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } health_report { overall_health: UNKNOWN } } }
I20260812 08:01:55.182422  3452 raft_consensus.cc:1275] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 3 FOLLOWER]: Refusing update from remote peer e0a62d8151ca45cc8dc5074bcd719148: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 3 index: 54. (index mismatch)
I20260812 08:01:55.183450  3887 consensus_queue.cc:1048] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.183610  3846 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:55.183709  3846 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.184192  3846 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), 43174691357048359daa1eca5a316a75 (127.31.239.131:33841)
I20260812 08:01:55.184648  3869 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:55.184736  3869 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.184784  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:55.184895  3453 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c965722d7f0e4bd8948e3560c43cc14e in term 3.
I20260812 08:01:55.185078  3869 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.185417  3070 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e; no voters: 
I20260812 08:01:55.185524  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 4 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.185585  3846 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:01:55.185650  3141 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43174691357048359daa1eca5a316a75 in term 3.
I20260812 08:01:55.185700  3846 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:55.185738  3846 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:55.186740  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:55.186868  3846 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.187222  3142 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Rejecting Update request from peer e0a62d8151ca45cc8dc5074bcd719148 for earlier term 3. Current term is 4. Ops: []
I20260812 08:01:55.187606  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e; no voters: 
I20260812 08:01:55.187834  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75"
I20260812 08:01:55.187938  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 4 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148"
I20260812 08:01:55.187830  3869 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:01:55.188067  3869 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:55.188107  3869 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:01:55.188809  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 4 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:55.188997  3890 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 }, Status: INVALID_TERM, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.189025  3117 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:55.189327  3869 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.189760  3869 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 4 election: Requested vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.190271  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 4 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148"
I20260812 08:01:55.190361  3453 raft_consensus.cc:2393] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c965722d7f0e4bd8948e3560c43cc14e in current term 4: Already voted for candidate 43174691357048359daa1eca5a316a75 in this term.
I20260812 08:01:55.191018  3070 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c965722d7f0e4bd8948e3560c43cc14e; no voters: 43174691357048359daa1eca5a316a75, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:55.191207  3875 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 08:01:55.191408  3142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 4 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e"
I20260812 08:01:55.187232  3846 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 4 election: Requested vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), 43174691357048359daa1eca5a316a75 (127.31.239.131:33841)
I20260812 08:01:55.191563  3142 raft_consensus.cc:2393] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 43174691357048359daa1eca5a316a75 in current term 4: Already voted for candidate c965722d7f0e4bd8948e3560c43cc14e in this term.
I20260812 08:01:55.191866  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:55.192128  3869 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 08:01:55.198729  3846 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:55.198877  3846 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.199358  3846 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), 43174691357048359daa1eca5a316a75 (127.31.239.131:33841)
I20260812 08:01:55.200059  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 5 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:55.200222  3453 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c965722d7f0e4bd8948e3560c43cc14e in term 4.
I20260812 08:01:55.200223  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 5 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:55.200743  3070 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e; no voters: 
I20260812 08:01:55.201449  3846 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 08:01:55.201519  3846 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:55.201565  3846 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:01:55.202764  3846 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.203212  3846 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 5 election: Requested vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), 43174691357048359daa1eca5a316a75 (127.31.239.131:33841)
I20260812 08:01:55.203891  3453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 5 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75"
I20260812 08:01:55.204020  3453 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:01:55.204046  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "c965722d7f0e4bd8948e3560c43cc14e" candidate_term: 5 candidate_status { last_received { term: 1 index: 53 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148"
I20260812 08:01:55.205147  3453 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c965722d7f0e4bd8948e3560c43cc14e in term 5.
I20260812 08:01:55.205544  3070 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e; no voters: e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:55.205822  3846 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 5 FOLLOWER]: Leader election won for term 5
I20260812 08:01:55.205915  3846 raft_consensus.cc:697] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 5 LEADER]: Becoming Leader. State: Replica: c965722d7f0e4bd8948e3560c43cc14e, State: Running, Role: LEADER
I20260812 08:01:55.206053  3846 consensus_queue.cc:237] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 1.53, Last appended by leader: 53, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.207296  3453 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Rejecting Update request from peer e0a62d8151ca45cc8dc5074bcd719148 for earlier term 3. Current term is 5. Ops: [3.54-3.54]
I20260812 08:01:55.207260  3141 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 5 LEADER]: Rejecting Update request from peer e0a62d8151ca45cc8dc5074bcd719148 for earlier term 3. Current term is 5. Ops: [3.54-3.54]
I20260812 08:01:55.208362  2976 catalog_manager.cc:5719] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e reported cstate change: term changed from 3 to 5, leader changed from e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130) to c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129). New cstate: current_term: 5 leader_uuid: "c965722d7f0e4bd8948e3560c43cc14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } health_report { overall_health: HEALTHY } } }
I20260812 08:01:55.208593  3892 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.208750  3892 consensus_queue.cc:1059] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 }, Status: INVALID_TERM, Last received: 1.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.208910  3892 consensus_queue.cc:1243] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [LEADER]: Peer c965722d7f0e4bd8948e3560c43cc14e log is divergent from this leader: its last log entry 5.54 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 53
I20260812 08:01:55.209839  3453 raft_consensus.cc:1275] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Refusing update from remote peer c965722d7f0e4bd8948e3560c43cc14e: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 5 index: 54. (index mismatch)
I20260812 08:01:55.210029  3299 raft_consensus.cc:3055] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 08:01:55.210096  3299 raft_consensus.cc:740] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e0a62d8151ca45cc8dc5074bcd719148, State: Running, Role: LEADER
I20260812 08:01:55.210317  3299 consensus_queue.cc:260] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 3.54, Last appended by leader: 54, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.210552  3299 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 3 FOLLOWER]: Advancing to term 5
W20260812 08:01:55.211091  3219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:01:55.211691  3299 raft_consensus.cc:1275] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Refusing update from remote peer c965722d7f0e4bd8948e3560c43cc14e: Log matching property violated. Preceding OpId in replica: term: 3 index: 54. Preceding OpId from leader: term: 5 index: 54. (term mismatch)
I20260812 08:01:55.211771  3299 pending_rounds.cc:85] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148: Aborting all ops after (but not including) 53
I20260812 08:01:55.211845  3299 pending_rounds.cc:107] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148: Aborting uncommitted NO_OP operation due to leader change: 3.54
I20260812 08:01:55.211923  3299 raft_consensus.cc:2889] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260812 08:01:55.212150  3218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:01:55.212366  3219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:01:55.212328  3875 consensus_queue.cc:1048] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260812 08:01:55.213110  3875 consensus_queue.cc:1048] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
W20260812 08:01:55.213469  3219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:01:55.213519  3141 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P c965722d7f0e4bd8948e3560c43cc14e [term 5 LEADER]: Rejecting Update request from peer e0a62d8151ca45cc8dc5074bcd719148 for earlier term 3. Current term is 5. Ops: [3.54-3.54]
W20260812 08:01:55.213857  3218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:01:55.214766  3219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:01:55.215929  3219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:01:55.217097  3219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:01:55.217504  3452 raft_consensus.cc:1240] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Rejecting Update request from peer e0a62d8151ca45cc8dc5074bcd719148 for earlier term 3. Current term is 5. Ops: [3.54-3.54]
W20260812 08:01:55.218266  3219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 9704f775727d46be806233cb485aacf7 | 127.31.239.190:45371 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                                      Value                                                                                                       |      Tags       |         Master
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                                              | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                                              | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                                             | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                                                | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                                             | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                                             | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                                               | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                                              | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
W20260812 08:01:55.221930  3820 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 5 is higher.
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:38095 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 43174691357048359daa1eca5a316a75 | 127.31.239.131:33841 | HEALTHY | <none>   |       0        |       0
 c965722d7f0e4bd8948e3560c43cc14e | 127.31.239.129:37227 | HEALTHY | <none>   |       0        |       0
 e0a62d8151ca45cc8dc5074bcd719148 | 127.31.239.130:38519 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                     Flag                     |                                                                                                    Value                                                                                                     |      Tags       |      Tablet Server
----------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 consensus_inject_latency_ms_in_notifications | 50                                                                                                                                                                                                           | unsafe,hidden   | all 3 server(s) checked
 inject_latency_ms_before_starting_op         | 1000                                                                                                                                                                                                         | hidden,advanced | all 3 server(s) checked
 ipki_server_key_size                         | 768                                                                                                                                                                                                          | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets                | 127.31.239.129                                                                                                                                                                                               | experimental    | 127.31.239.129:37227
 local_ip_for_outbound_sockets                | 127.31.239.130                                                                                                                                                                                               | experimental    | 127.31.239.130:38519
 local_ip_for_outbound_sockets                | 127.31.239.131                                                                                                                                                                                               | experimental    | 127.31.239.131:33841
 never_fsync                                  | true                                                                                                                                                                                                         | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override              | 0                                                                                                                                                                                                            | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports             | true                                                                                                                                                                                                         | unsafe          | all 3 server(s) checked
 server_dump_info_format                      | pb                                                                                                                                                                                                           | hidden          | all 3 server(s) checked
 server_dump_info_path                        | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:37227
 server_dump_info_path                        | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:38519
 server_dump_info_path                        | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:33841

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:38095 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
Tablet 4536d08ec31b4a218bbeee99964809e2 of table 'test-workload' is conflicted: 3 replicas' active configs disagree with the leader master's
  e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519): RUNNING
  43174691357048359daa1eca5a316a75 (127.31.239.131:33841): RUNNING
  c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227): RUNNING [LEADER]
All reported replicas are:
  A = e0a62d8151ca45cc8dc5074bcd719148
  B = 43174691357048359daa1eca5a316a75
  C = c965722d7f0e4bd8948e3560c43cc14e
The consensus matrix is:
 Config source |   Replicas   | Current term | Config index | Committed?
---------------+--------------+--------------+--------------+------------
 master        | A   B   C*   |              |              | Yes
 A             | A*  B   C    | 3            | -1           | Yes
 B             | A   B   C    | 3            | -1           | Yes
 C             | A   B   C    | 4            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
     Name      | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+--------------------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 08:01:55.224838 32702 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
W20260812 08:01:55.262220  3820 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 5 is higher.
W20260812 08:01:55.270496  3820 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 5 is higher.
W20260812 08:01:55.290763  3820 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 5 is higher.
W20260812 08:01:55.329196  3820 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 5 is higher.
W20260812 08:01:55.367451  3820 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 5 is higher.
W20260812 08:01:55.391696  3820 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 5 is higher.
W20260812 08:01:55.433138  3820 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 5 is higher.
I20260812 08:01:55.438423  3427 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:01:55.438624  3117 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:01:55.442344  3272 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 9704f775727d46be806233cb485aacf7 | 127.31.239.190:45371 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                                      Value                                                                                                       |      Tags       |         Master
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                                              | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                                              | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                                             | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                                                | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                                             | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                                             | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                                               | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                                              | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:38095 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 43174691357048359daa1eca5a316a75 | 127.31.239.131:33841 | HEALTHY | <none>   |       0        |       0
 c965722d7f0e4bd8948e3560c43cc14e | 127.31.239.129:37227 | HEALTHY | <none>   |       1        |       0
 e0a62d8151ca45cc8dc5074bcd719148 | 127.31.239.130:38519 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                     Flag                     |                                                                                                    Value                                                                                                     |      Tags       |      Tablet Server
----------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 consensus_inject_latency_ms_in_notifications | 50                                                                                                                                                                                                           | unsafe,hidden   | all 3 server(s) checked
 inject_latency_ms_before_starting_op         | 1000                                                                                                                                                                                                         | hidden,advanced | all 3 server(s) checked
 ipki_server_key_size                         | 768                                                                                                                                                                                                          | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets                | 127.31.239.129                                                                                                                                                                                               | experimental    | 127.31.239.129:37227
 local_ip_for_outbound_sockets                | 127.31.239.130                                                                                                                                                                                               | experimental    | 127.31.239.130:38519
 local_ip_for_outbound_sockets                | 127.31.239.131                                                                                                                                                                                               | experimental    | 127.31.239.131:33841
 never_fsync                                  | true                                                                                                                                                                                                         | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override              | 0                                                                                                                                                                                                            | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports             | true                                                                                                                                                                                                         | unsafe          | all 3 server(s) checked
 server_dump_info_format                      | pb                                                                                                                                                                                                           | hidden          | all 3 server(s) checked
 server_dump_info_path                        | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:37227
 server_dump_info_path                        | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:38519
 server_dump_info_path                        | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:33841

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:38095 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:01:55.480398 32702 log_verifier.cc:126] Checking tablet 4536d08ec31b4a218bbeee99964809e2
I20260812 08:01:55.485251  3869 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.485428  3869 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.485929  3869 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.486114  3893 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.486246  3893 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.486389  3298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 6 candidate_status { last_received { term: 5 index: 54 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:55.486439  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 6 candidate_status { last_received { term: 5 index: 54 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.486711  3893 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.486989  3375 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43174691357048359daa1eca5a316a75; no voters: c965722d7f0e4bd8948e3560c43cc14e, e0a62d8151ca45cc8dc5074bcd719148
I20260812 08:01:55.487215  3869 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:55.487486  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 6 candidate_status { last_received { term: 5 index: 54 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:55.487668  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 6 candidate_status { last_received { term: 5 index: 54 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.488173  3216 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:55.488350  3893 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:55.511353  3893 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.511508  3893 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.511979  3893 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.512498  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 6 candidate_status { last_received { term: 5 index: 54 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:55.512535  3141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 6 candidate_status { last_received { term: 5 index: 54 } } ignore_live_leader: false dest_uuid: "c965722d7f0e4bd8948e3560c43cc14e" is_pre_election: true
I20260812 08:01:55.513127  3220 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0a62d8151ca45cc8dc5074bcd719148; no voters: 43174691357048359daa1eca5a316a75, c965722d7f0e4bd8948e3560c43cc14e
I20260812 08:01:55.513327  3893 raft_consensus.cc:2749] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:01:55.532181 32702 log_verifier.cc:177] Verified matching terms for 54 ops in tablet 4536d08ec31b4a218bbeee99964809e2
I20260812 08:01:55.555876 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 3049
I20260812 08:01:55.562328  3893 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.562465  3893 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.562947  3893 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 43174691357048359daa1eca5a316a75 (127.31.239.131:33841), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.563360  3452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "e0a62d8151ca45cc8dc5074bcd719148" candidate_term: 6 candidate_status { last_received { term: 5 index: 54 } } ignore_live_leader: false dest_uuid: "43174691357048359daa1eca5a316a75" is_pre_election: true
I20260812 08:01:55.565999  3869 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.566220  3869 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.566692  3869 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
I20260812 08:01:55.567113  3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4536d08ec31b4a218bbeee99964809e2" candidate_uuid: "43174691357048359daa1eca5a316a75" candidate_term: 6 candidate_status { last_received { term: 5 index: 54 } } ignore_live_leader: false dest_uuid: "e0a62d8151ca45cc8dc5074bcd719148" is_pre_election: true
I20260812 08:01:55.567274  3299 raft_consensus.cc:2468] T 4536d08ec31b4a218bbeee99964809e2 P e0a62d8151ca45cc8dc5074bcd719148 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43174691357048359daa1eca5a316a75 in term 5.
I20260812 08:01:55.567695  3377 leader_election.cc:304] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43174691357048359daa1eca5a316a75, e0a62d8151ca45cc8dc5074bcd719148; no voters: 
I20260812 08:01:55.568041  3869 raft_consensus.cc:2804] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 08:01:55.568116  3869 raft_consensus.cc:493] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c965722d7f0e4bd8948e3560c43cc14e)
I20260812 08:01:55.568171  3869 raft_consensus.cc:3060] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 5 FOLLOWER]: Advancing to term 6
W20260812 08:01:55.568696  3216 connection.cc:573] client connection to 127.31.239.129:37227 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:01:55.568795  3216 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
I20260812 08:01:55.569191 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 3200
I20260812 08:01:55.569373  3869 raft_consensus.cc:515] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a62d8151ca45cc8dc5074bcd719148" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38519 } } peers { permanent_uuid: "43174691357048359daa1eca5a316a75" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33841 } } peers { permanent_uuid: "c965722d7f0e4bd8948e3560c43cc14e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37227 } }
I20260812 08:01:55.569824  3869 leader_election.cc:290] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 6 election: Requested vote from peers e0a62d8151ca45cc8dc5074bcd719148 (127.31.239.130:38519), c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227)
W20260812 08:01:55.568590  3375 connection.cc:573] server connection from 127.31.239.129:44993 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:01:55.570811  3375 connection.cc:573] client connection to 127.31.239.129:37227 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:01:55.570940  3375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
W20260812 08:01:55.572124  3375 leader_election.cc:336] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227): Network error: Client connection negotiation failed: client connection to 127.31.239.129:37227: connect: Connection refused (error 111)
W20260812 08:01:55.572893  3375 leader_election.cc:336] T 4536d08ec31b4a218bbeee99964809e2 P 43174691357048359daa1eca5a316a75 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c965722d7f0e4bd8948e3560c43cc14e (127.31.239.129:37227): Network error: Client connection negotiation failed: client connection to 127.31.239.129:37227: connect: Connection refused (error 111)
W20260812 08:01:55.580047  3377 connection.cc:573] client connection to 127.31.239.130:38519 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:01:55.580529 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 3359
I20260812 08:01:55.593184 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 2941
2026-08-12T08:01:55Z chronyd exiting
[       OK ] RaftConsensusElectionITest.ChurnyElectionsWithNotificationLatency (34296 ms)
[ RUN      ] RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys
I20260812 08:01:55.623854 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:01:55.623927 32702 ts_itest-base.cc:116] --------------
I20260812 08:01:55.623944 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:01:55.623961 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:01:55.623988 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:01:55Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:01:55Z Disabled control of system clock
I20260812 08:01:55.634392 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:34449
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:32803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:34449 with env {}
W20260812 08:01:55.744781  3964 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:55.745092  3964 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:55.745193  3964 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:55.748658  3964 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:01:55.748770  3964 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:55.748811  3964 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:01:55.748849  3964 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:01:55.752930  3964 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:34449
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:34449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.3964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:55.754220  3964 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:55.755383  3964 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:01:55.761358  3972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:55.761410  3969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:55.761410  3970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:55.762050  3964 server_base.cc:1061] running on GCE node
I20260812 08:01:55.762720  3964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:55.763724  3964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:55.764925  3964 hybrid_clock.cc:648] HybridClock initialized: now 1786521715764907 us; error 45 us; skew 500 ppm
I20260812 08:01:55.767129  3964 webserver.cc:533] Webserver started at http://127.31.239.190:34587/ using document root <none> and password file <none>
I20260812 08:01:55.767751  3964 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:55.767841  3964 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:55.768074  3964 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:55.769707  3964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "3a36ee989d9c4b54a17003b9655b8731"
format_stamp: "Formatted at 2026-08-12 08:01:55 on dist-test-slave-9jjr"
I20260812 08:01:55.770291  3964 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "3a36ee989d9c4b54a17003b9655b8731"
format_stamp: "Formatted at 2026-08-12 08:01:55 on dist-test-slave-9jjr"
I20260812 08:01:55.773916  3964 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:55.776379  3978 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:55.777416  3964 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:55.777586  3964 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "3a36ee989d9c4b54a17003b9655b8731"
format_stamp: "Formatted at 2026-08-12 08:01:55 on dist-test-slave-9jjr"
I20260812 08:01:55.777704  3964 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:55.803970  3964 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:55.804754  3964 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:55.804968  3964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:55.813450  4038 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:34449 every 8 connection(s)
I20260812 08:01:55.813459  3964 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:34449
I20260812 08:01:55.814627  3964 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:01:55.817780  4039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:55.821110 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 3964
I20260812 08:01:55.821287 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:01:55.823380  4039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731: Bootstrap starting.
I20260812 08:01:55.825691  4039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:55.826495  4039 log.cc:826] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:55.828541  4039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731: No bootstrap required, opened a new log
I20260812 08:01:55.831293  4039 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a36ee989d9c4b54a17003b9655b8731" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 34449 } }
I20260812 08:01:55.831468  4039 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:55.831503  4039 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a36ee989d9c4b54a17003b9655b8731, State: Initialized, Role: FOLLOWER
I20260812 08:01:55.831828  4039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a36ee989d9c4b54a17003b9655b8731" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 34449 } }
I20260812 08:01:55.831933  4039 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:01:55.831970  4039 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:01:55.832041  4039 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:55.832818  4039 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a36ee989d9c4b54a17003b9655b8731" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 34449 } }
I20260812 08:01:55.833110  4039 leader_election.cc:304] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a36ee989d9c4b54a17003b9655b8731; no voters: 
I20260812 08:01:55.833348  4039 leader_election.cc:290] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:01:55.833480  4047 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:55.833707  4047 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [term 1 LEADER]: Becoming Leader. State: Replica: 3a36ee989d9c4b54a17003b9655b8731, State: Running, Role: LEADER
I20260812 08:01:55.833992  4047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a36ee989d9c4b54a17003b9655b8731" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 34449 } }
I20260812 08:01:55.834656  4039 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:01:55.835868  4050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a36ee989d9c4b54a17003b9655b8731. Latest consensus state: current_term: 1 leader_uuid: "3a36ee989d9c4b54a17003b9655b8731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a36ee989d9c4b54a17003b9655b8731" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 34449 } } }
I20260812 08:01:55.835911  4049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a36ee989d9c4b54a17003b9655b8731" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a36ee989d9c4b54a17003b9655b8731" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 34449 } } }
I20260812 08:01:55.835997  4050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:55.836036  4049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731 [sys.catalog]: This master's current role is: LEADER
I20260812 08:01:55.836424  4057 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:01:55.839668  4057 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:01:55.845496  4057 catalog_manager.cc:1383] Generated new cluster ID: 87bf3c779a53487da419858086d5a7f9
I20260812 08:01:55.845623  4057 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:01:55.878077  4057 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:01:55.879106  4057 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:01:55.890441  4057 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 3a36ee989d9c4b54a17003b9655b8731: Generated new TSK 0
I20260812 08:01:55.891265  4057 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:01:55.904405 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:34449
--builtin_ntp_servers=127.31.239.148:32803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
W20260812 08:01:56.017241  4068 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:56.017477  4068 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:56.017525  4068 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:56.021092  4068 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:56.021262  4068 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:01:56.025483  4068 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:34449
--never_fsync=true
--heap_profile_path=/tmp/kudu.4068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:56.026736  4068 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:56.027904  4068 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:56.030802  4068 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:01:56.034967  4078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:56.034961  4075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:56.034966  4082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:56.035355  4068 server_base.cc:1061] running on GCE node
I20260812 08:01:56.035750  4068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:56.036334  4068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:56.037514  4068 hybrid_clock.cc:648] HybridClock initialized: now 1786521716037499 us; error 34 us; skew 500 ppm
I20260812 08:01:56.039630  4068 webserver.cc:533] Webserver started at http://127.31.239.129:37203/ using document root <none> and password file <none>
I20260812 08:01:56.040289  4068 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:56.040385  4068 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:56.040642  4068 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:56.042416  4068 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "76f4cbd15ed14152b5c24635ba16d531"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.042969  4068 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "76f4cbd15ed14152b5c24635ba16d531"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.046695  4068 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:01:56.049283  4088 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.050735  4068 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:56.050894  4068 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "76f4cbd15ed14152b5c24635ba16d531"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.051044  4068 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:56.068105  4068 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:56.068847  4068 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:56.069061  4068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:56.069701  4068 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:56.070842  4068 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:56.070892  4068 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.070932  4068 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:56.070990  4068 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.081678  4068 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:39139
I20260812 08:01:56.081768  4217 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:39139 every 8 connection(s)
I20260812 08:01:56.082890  4068 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:01:56.091895 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 4068
I20260812 08:01:56.092025 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:01:56.092139  4218 heartbeater.cc:344] Connected to a master server at 127.31.239.190:34449
I20260812 08:01:56.092427  4218 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:56.093086  4218 heartbeater.cc:507] Master 127.31.239.190:34449 requested a full tablet report, sending...
I20260812 08:01:56.094563 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:34449
--builtin_ntp_servers=127.31.239.148:32803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
I20260812 08:01:56.094802  3996 ts_manager.cc:194] Registered new tserver with Master: 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139)
I20260812 08:01:56.096438  3996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:55251
W20260812 08:01:56.205444  4223 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:56.205708  4223 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:56.205758  4223 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:56.209277  4223 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:56.209410  4223 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:01:56.213537  4223 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:34449
--never_fsync=true
--heap_profile_path=/tmp/kudu.4223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:56.214784  4223 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:56.215981  4223 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:56.219264  4223 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:01:56.223703  4231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:56.223728  4230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:56.223790  4223 server_base.cc:1061] running on GCE node
W20260812 08:01:56.223721  4233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:56.224397  4223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:56.225055  4223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:56.226230  4223 hybrid_clock.cc:648] HybridClock initialized: now 1786521716226209 us; error 34 us; skew 500 ppm
I20260812 08:01:56.228353  4223 webserver.cc:533] Webserver started at http://127.31.239.130:43405/ using document root <none> and password file <none>
I20260812 08:01:56.228968  4223 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:56.229029  4223 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:56.229244  4223 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:56.230929  4223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "f91d6f49e46b4b379bf45b98bb7b2b77"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.231429  4223 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "f91d6f49e46b4b379bf45b98bb7b2b77"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.234963  4223 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:56.237462  4240 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.238605  4223 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:01:56.238766  4223 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "f91d6f49e46b4b379bf45b98bb7b2b77"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.238878  4223 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:56.249804  4223 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:56.250602  4223 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:56.250816  4223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:56.251412  4223 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:56.252454  4223 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:56.252527  4223 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.252599  4223 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:56.252648  4223 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.262660  4223 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:38555
I20260812 08:01:56.262688  4367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:38555 every 8 connection(s)
I20260812 08:01:56.263720  4223 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:01:56.272272 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 4223
I20260812 08:01:56.272411 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:01:56.272944  4368 heartbeater.cc:344] Connected to a master server at 127.31.239.190:34449
I20260812 08:01:56.273217  4368 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:56.273753  4368 heartbeater.cc:507] Master 127.31.239.190:34449 requested a full tablet report, sending...
I20260812 08:01:56.274696 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:34449
--builtin_ntp_servers=127.31.239.148:32803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--inject_latency_ms_before_starting_op=1000 with env {}
I20260812 08:01:56.275032  3996 ts_manager.cc:194] Registered new tserver with Master: f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:01:56.275610  3996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:43719
W20260812 08:01:56.383904  4371 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:01:56.384142  4371 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:01:56.384223  4371 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:01:56.388722  4371 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:01:56.388924  4371 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:01:56.393309  4371 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=2
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--inject_latency_ms_before_starting_op=1000
--tserver_master_addrs=127.31.239.190:34449
--never_fsync=true
--heap_profile_path=/tmp/kudu.4371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:01:56.394557  4371 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:01:56.395744  4371 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:01:56.398551  4371 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 1
W20260812 08:01:56.403137  4376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:56.403139  4380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:01:56.403123  4377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:01:56.403401  4371 server_base.cc:1061] running on GCE node
I20260812 08:01:56.403990  4371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:01:56.404636  4371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:01:56.405849  4371 hybrid_clock.cc:648] HybridClock initialized: now 1786521716405829 us; error 39 us; skew 500 ppm
I20260812 08:01:56.407995  4371 webserver.cc:533] Webserver started at http://127.31.239.131:44767/ using document root <none> and password file <none>
I20260812 08:01:56.408614  4371 fs_manager.cc:362] Metadata directory not provided
I20260812 08:01:56.408699  4371 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:01:56.408913  4371 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:01:56.410661  4371 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "6444d0e8ad5e4ff1afc7dfefdea88066"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.411168  4371 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "6444d0e8ad5e4ff1afc7dfefdea88066"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.414755  4371 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:01:56.417335  4386 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.418705  4371 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:01:56.418854  4371 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "6444d0e8ad5e4ff1afc7dfefdea88066"
format_stamp: "Formatted at 2026-08-12 08:01:56 on dist-test-slave-9jjr"
I20260812 08:01:56.418972  4371 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:01:56.443445  4371 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:01:56.444247  4371 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:01:56.444466  4371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:01:56.445096  4371 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:01:56.446244  4371 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:01:56.446307  4371 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.446388  4371 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:01:56.446427  4371 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:01:56.456893  4371 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:33391
I20260812 08:01:56.456950  4513 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:33391 every 8 connection(s)
I20260812 08:01:56.457942  4371 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:01:56.462090 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 4371
I20260812 08:01:56.462307 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:01:56.467025  4514 heartbeater.cc:344] Connected to a master server at 127.31.239.190:34449
I20260812 08:01:56.467317  4514 heartbeater.cc:461] Registering TS with master...
I20260812 08:01:56.467908  4514 heartbeater.cc:507] Master 127.31.239.190:34449 requested a full tablet report, sending...
I20260812 08:01:56.469033  3996 ts_manager.cc:194] Registered new tserver with Master: 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:01:56.469688  3996 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:50859
I20260812 08:01:56.477470 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:01:56.490845  3996 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59454:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:01:56.491977  3996 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:01:56.511029  4141 tablet_service.cc:1511] Processing CreateTablet for tablet fa5bc51157f040ff87e0fa8a13b54c6f (DEFAULT_TABLE table=test-workload [id=d8d2a14021e144208642ee05c8262aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:56.511404  4296 tablet_service.cc:1511] Processing CreateTablet for tablet fa5bc51157f040ff87e0fa8a13b54c6f (DEFAULT_TABLE table=test-workload [id=d8d2a14021e144208642ee05c8262aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:56.512082  4141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5bc51157f040ff87e0fa8a13b54c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:56.512445  4296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5bc51157f040ff87e0fa8a13b54c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:56.517503  4534 tablet_bootstrap.cc:492] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531: Bootstrap starting.
I20260812 08:01:56.519155  4535 tablet_bootstrap.cc:492] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77: Bootstrap starting.
I20260812 08:01:56.520249  4441 tablet_service.cc:1511] Processing CreateTablet for tablet fa5bc51157f040ff87e0fa8a13b54c6f (DEFAULT_TABLE table=test-workload [id=d8d2a14021e144208642ee05c8262aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:01:56.520979  4534 tablet_bootstrap.cc:654] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:56.521356  4441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5bc51157f040ff87e0fa8a13b54c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:01:56.521581  4535 tablet_bootstrap.cc:654] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:56.522161  4534 log.cc:826] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:56.522776  4535 log.cc:826] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:56.524327  4534 tablet_bootstrap.cc:492] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531: No bootstrap required, opened a new log
I20260812 08:01:56.524588  4534 ts_tablet_manager.cc:1403] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 08:01:56.527457  4534 raft_consensus.cc:359] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.527704  4534 raft_consensus.cc:385] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:56.527704  4539 tablet_bootstrap.cc:492] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066: Bootstrap starting.
I20260812 08:01:56.527781  4534 raft_consensus.cc:740] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f4cbd15ed14152b5c24635ba16d531, State: Initialized, Role: FOLLOWER
I20260812 08:01:56.528322  4534 consensus_queue.cc:260] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.528585  4540 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:56.528800  4540 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.529186  4218 heartbeater.cc:499] Master 127.31.239.190:34449 was elected leader, sending a full tablet report...
I20260812 08:01:56.529309  4534 ts_tablet_manager.cc:1434] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:01:56.530401  4539 tablet_bootstrap.cc:654] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066: Neither blocks nor log segments found. Creating new log.
I20260812 08:01:56.530820  4540 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:01:56.531144  4535 tablet_bootstrap.cc:492] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77: No bootstrap required, opened a new log
I20260812 08:01:56.531318  4539 log.cc:826] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066: Log is configured to *not* fsync() on all Append() calls
I20260812 08:01:56.531359  4535 ts_tablet_manager.cc:1403] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.000s
I20260812 08:01:56.533185  4539 tablet_bootstrap.cc:492] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066: No bootstrap required, opened a new log
I20260812 08:01:56.533382  4539 ts_tablet_manager.cc:1403] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:01:56.534758  4535 raft_consensus.cc:359] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.534982  4535 raft_consensus.cc:385] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:56.535032  4535 raft_consensus.cc:740] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f91d6f49e46b4b379bf45b98bb7b2b77, State: Initialized, Role: FOLLOWER
I20260812 08:01:56.535656  4535 consensus_queue.cc:260] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.536162  4545 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:56.536366  4545 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.536671  4535 ts_tablet_manager.cc:1434] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:01:56.537026  4368 heartbeater.cc:499] Master 127.31.239.190:34449 was elected leader, sending a full tablet report...
W20260812 08:01:56.537153  4089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.31.239.131:33391 for RPC RequestConsensusVote timed out after 0.006s (ON_OUTBOUND_QUEUE)
I20260812 08:01:56.537762  4539 raft_consensus.cc:359] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.537985  4539 raft_consensus.cc:385] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:01:56.538072  4539 raft_consensus.cc:740] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6444d0e8ad5e4ff1afc7dfefdea88066, State: Initialized, Role: FOLLOWER
I20260812 08:01:56.538631  4539 consensus_queue.cc:260] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.539597  4539 ts_tablet_manager.cc:1434] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:01:56.539966  4514 heartbeater.cc:499] Master 127.31.239.190:34449 was elected leader, sending a full tablet report...
I20260812 08:01:56.540755  4548 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:01:56.540915  4548 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.542164  4548 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:01:56.542320  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "76f4cbd15ed14152b5c24635ba16d531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:01:56.542441  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "76f4cbd15ed14152b5c24635ba16d531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:01:56.542523  4316 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f4cbd15ed14152b5c24635ba16d531 in term 0.
I20260812 08:01:56.543900  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "76f4cbd15ed14152b5c24635ba16d531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:01:56.544077  4463 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f4cbd15ed14152b5c24635ba16d531 in term 0.
I20260812 08:01:56.544471  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:56.544657  4164 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d6f49e46b4b379bf45b98bb7b2b77 in term 0.
I20260812 08:01:56.544847  4545 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:01:56.545233  4089 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531; no voters: f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:01:56.545428  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 
I20260812 08:01:56.545687  4541 raft_consensus.cc:2804] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:56.545755  4541 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:56.545836  4541 raft_consensus.cc:3060] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:56.545956  4545 raft_consensus.cc:2804] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:01:56.546114  4545 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:01:56.546258  4545 raft_consensus.cc:3060] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:56.547026  4541 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.547435  4541 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [CANDIDATE]: Term 1 election: Requested vote from peers f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:01:56.547645  4545 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.547911  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "76f4cbd15ed14152b5c24635ba16d531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77"
I20260812 08:01:56.548081  4316 raft_consensus.cc:2393] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 76f4cbd15ed14152b5c24635ba16d531 in current term 1: Already voted for candidate f91d6f49e46b4b379bf45b98bb7b2b77 in this term.
W20260812 08:01:56.548651  4243 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.31.239.131:33391 for RPC RequestConsensusVote timed out after 0.008s (ON_OUTBOUND_QUEUE)
I20260812 08:01:56.548907  4545 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 1 election: Requested vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
W20260812 08:01:56.549003  4390 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.129:39139 timed out after 0.006s (ON_OUTBOUND_QUEUE)
I20260812 08:01:56.549631  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "76f4cbd15ed14152b5c24635ba16d531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066"
I20260812 08:01:56.549752  4463 raft_consensus.cc:3060] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:01:56.550276  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531"
I20260812 08:01:56.550482  4164 raft_consensus.cc:2393] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f91d6f49e46b4b379bf45b98bb7b2b77 in current term 1: Already voted for candidate 76f4cbd15ed14152b5c24635ba16d531 in this term.
I20260812 08:01:56.551045  4463 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f4cbd15ed14152b5c24635ba16d531 in term 1.
I20260812 08:01:56.551548  4089 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531; no voters: f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:01:56.551595  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:56.551738  4164 raft_consensus.cc:2393] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6444d0e8ad5e4ff1afc7dfefdea88066 in current term 1: Already voted for candidate 76f4cbd15ed14152b5c24635ba16d531 in this term.
I20260812 08:01:56.551802  4541 raft_consensus.cc:2804] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:01:56.551908  4541 raft_consensus.cc:697] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 1 LEADER]: Becoming Leader. State: Replica: 76f4cbd15ed14152b5c24635ba16d531, State: Running, Role: LEADER
I20260812 08:01:56.551972  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066"
I20260812 08:01:56.552192  4463 raft_consensus.cc:2393] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f91d6f49e46b4b379bf45b98bb7b2b77 in current term 1: Already voted for candidate 76f4cbd15ed14152b5c24635ba16d531 in this term.
I20260812 08:01:56.552278  4541 consensus_queue.cc:237] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:56.551985  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:01:56.552728  4462 raft_consensus.cc:2393] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f91d6f49e46b4b379bf45b98bb7b2b77 in current term 1: Already voted for candidate 76f4cbd15ed14152b5c24635ba16d531 in this term.
I20260812 08:01:56.552700  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:01:56.552912  4545 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 08:01:56.554486  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:01:56.554654  4316 raft_consensus.cc:2393] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6444d0e8ad5e4ff1afc7dfefdea88066 in current term 1: Already voted for candidate f91d6f49e46b4b379bf45b98bb7b2b77 in this term.
I20260812 08:01:56.555008  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:01:56.555384  4549 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 08:01:56.556468  3996 catalog_manager.cc:5719] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129). New cstate: current_term: 1 leader_uuid: "76f4cbd15ed14152b5c24635ba16d531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } health_report { overall_health: UNKNOWN } } }
I20260812 08:01:56.557029  4560 consensus_queue.cc:1048] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:01:56.557180  4541 consensus_queue.cc:1048] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:01:56.586709  4563 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:01:56.586802  4563 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260812 08:01:56.824867  4462 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:01:56.824867  4316 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:01:56.824937  4316 fault_injection.cc:44] THIS SERVER MAY CRASH!
W20260812 08:01:56.824937  4462 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260812 08:01:57.328697  4549 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:01:57.328882  4549 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:57.329712  4549 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:01:57.330106  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:57.330273  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:01:57.330916  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:01:57.331276  4549 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:57.820717  4545 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:01:57.820879  4545 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:57.821640  4545 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:01:57.822085  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:57.822170  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:01:57.822674  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:01:58.446969  4549 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:01:58.447168  4549 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:58.447806  4549 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:01:58.448216  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:58.448312  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:01:58.448853  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:01:58.449030  4549 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:58.449355  4586 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=1, attempt_no=0}) took 1867 ms. Trace:
I20260812 08:01:58.449450  4586 rpcz_store.cc:276] 0812 08:01:56.582363 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:56.584864 (+  2501us) service_pool.cc:224] Handling call
0812 08:01:58.449340 (+1864476us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:56.822646 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:01:56.822780 (+   134us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:56.822785 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:56.822787 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:56.822860 (+    73us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:56.822887 (+    27us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:56.822891 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:56.822933 (+    42us) tablet.cc:701] Row locks acquired
0812 08:01:56.822935 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:56.822993 (+    58us) write_op.cc:270] Start()
0812 08:01:57.530161 (+707168us) write_op.cc:276] Timestamp: P: 1786521716822750 usec, L: 0
0812 08:01:57.530164 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:57.530328 (+   164us) log.cc:844] Serialized 345 byte log entry
0812 08:01:58.448563 (+918235us) op_driver.cc:464] REPLICATION: finished
0812 08:01:58.448887 (+   324us) write_op.cc:301] APPLY: starting
0812 08:01:58.448914 (+    27us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:58.448941 (+    27us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:58.448952 (+    11us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:58.449046 (+    94us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:58.449076 (+    30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:58.449100 (+    24us) write_op.cc:312] APPLY: finished
0812 08:01:58.449178 (+    78us) log.cc:844] Serialized 22 byte log entry
0812 08:01:58.449244 (+    66us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:58.449264 (+    20us) write_op.cc:454] Released schema lock
0812 08:01:58.449269 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":259,"num_ops":1,"prepare.queue_time_us":237305,"prepare.run_cpu_time_us":740,"prepare.run_wall_time_us":707795,"raft.queue_time_us":44,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":918367,"thread_start_us":70,"threads_started":1}]]}
I20260812 08:01:58.529752  4549 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:01:58.529909  4549 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:58.530429  4549 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:01:58.530948  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:01:58.531504  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:58.531906  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:01:58.532083  4549 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:58.538335  4545 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:58.632220  4549 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:01:58.632375  4549 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:58.632897  4549 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:01:58.633196  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:01:58.633244  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:58.633672  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:01:58.633867  4549 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:59.529556  4591 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:01:59.529733  4591 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:59.530452  4591 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:01:59.530892  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:59.530902  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:01:59.531445  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:01:59.531716  4591 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:01:59.532136  4594 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=2, attempt_no=0}) took 2198 ms. Trace:
I20260812 08:01:59.532212  4594 rpcz_store.cc:276] 0812 08:01:57.333815 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:57.333891 (+    76us) service_pool.cc:224] Handling call
0812 08:01:59.532116 (+2198225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:57.530464 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:01:57.530590 (+   126us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:57.530595 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:01:57.530597 (+     2us) tablet.cc:662] Decoding operations
0812 08:01:57.530681 (+    84us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:57.530689 (+     8us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:57.530692 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:58.449315 (+918623us) lock_manager.cc:598] Waited 918450us for lock on <redacted> (key hash 16074282746314381896)
0812 08:01:58.449327 (+    12us) tablet.cc:701] Row locks acquired
0812 08:01:58.449330 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:01:58.449369 (+    39us) write_op.cc:270] Start()
0812 08:01:59.146519 (+697150us) write_op.cc:276] Timestamp: P: 1786521718449321 usec, L: 0
0812 08:01:59.146522 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:01:59.146730 (+   208us) log.cc:844] Serialized 354 byte log entry
0812 08:01:59.530729 (+383999us) op_driver.cc:464] REPLICATION: finished
0812 08:01:59.530970 (+   241us) write_op.cc:301] APPLY: starting
0812 08:01:59.531003 (+    33us) tablet.cc:1367] starting BulkCheckPresence
0812 08:01:59.531034 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:01:59.531035 (+     1us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:01:59.531166 (+   131us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:01:59.531195 (+    29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:01:59.531200 (+     5us) write_op.cc:312] APPLY: finished
0812 08:01:59.531388 (+   188us) log.cc:844] Serialized 43 byte log entry
0812 08:01:59.531604 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:01:59.531627 (+    23us) write_op.cc:454] Released schema lock
0812 08:01:59.531633 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":190,"num_ops":1,"prepare.queue_time_us":195994,"prepare.run_cpu_time_us":864,"prepare.run_wall_time_us":1616360,"raft.queue_time_us":42,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":185,"replication_time_us":384170,"row_lock_wait_count":1,"row_lock_wait_us":918450,"thread_start_us":79,"threads_started":1}]]}
I20260812 08:01:59.940546  4592 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:01:59.940702  4592 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:01:59.941263  4592 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:01:59.941685  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:01:59.941738  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:01:59.942256  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:01:59.942553  4592 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:00.088182  4592 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:00.088344  4592 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:00.088846  4592 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:00.089196  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:00.089248  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:00.089696  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:00.089888  4592 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:00.849785  4592 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:00.849954  4592 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:00.850526  4592 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:00.850932  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:00.851090  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:00.851619  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:00.851929  4592 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:00.852030  4603 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=3, attempt_no=0}) took 2400 ms. Trace:
I20260812 08:02:00.852118  4603 rpcz_store.cc:276] 0812 08:01:58.451453 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:58.451522 (+    69us) service_pool.cc:224] Handling call
0812 08:02:00.852007 (+2400485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:01:59.146868 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:01:59.146999 (+   131us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:01:59.147003 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:01:59.147004 (+     1us) tablet.cc:662] Decoding operations
0812 08:01:59.147095 (+    91us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:01:59.147106 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:01:59.147112 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:01:59.147164 (+    52us) tablet.cc:701] Row locks acquired
0812 08:01:59.147166 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:01:59.147209 (+    43us) write_op.cc:270] Start()
0812 08:02:00.126355 (+979146us) write_op.cc:276] Timestamp: P: 1786521719147168 usec, L: 0
0812 08:02:00.126359 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:00.126584 (+   225us) log.cc:844] Serialized 354 byte log entry
0812 08:02:00.851040 (+724456us) op_driver.cc:464] REPLICATION: finished
0812 08:02:00.851313 (+   273us) write_op.cc:301] APPLY: starting
0812 08:02:00.851331 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:00.851363 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:00.851378 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:00.851446 (+    68us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:00.851493 (+    47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:00.851500 (+     7us) write_op.cc:312] APPLY: finished
0812 08:02:00.851576 (+    76us) log.cc:844] Serialized 22 byte log entry
0812 08:02:00.851811 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:00.851827 (+    16us) write_op.cc:454] Released schema lock
0812 08:02:00.851834 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":217,"num_ops":1,"prepare.queue_time_us":694840,"prepare.run_cpu_time_us":754,"prepare.run_wall_time_us":979806,"raft.queue_time_us":21,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":724646,"spinlock_wait_cycles":25856,"thread_start_us":75,"threads_started":1}]]}
I20260812 08:02:01.114513  4599 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:01.114720  4599 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:01.115451  4599 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:01.115976  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:01.116061  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:01.116568  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:01.665657  4599 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:01.667867  4614 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=4, attempt_no=0}) took 2133 ms. Trace:
I20260812 08:02:01.667984  4614 rpcz_store.cc:276] 0812 08:01:59.534215 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:01:59.534276 (+    61us) service_pool.cc:224] Handling call
0812 08:02:01.667846 (+2133570us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:00.126715 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:00.126849 (+   134us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:00.126854 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:00.126856 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:00.126933 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:00.126948 (+    15us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:00.126950 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:00.127007 (+    57us) tablet.cc:701] Row locks acquired
0812 08:02:00.127009 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:00.127050 (+    41us) write_op.cc:270] Start()
0812 08:02:00.961232 (+834182us) write_op.cc:276] Timestamp: P: 1786521720127014 usec, L: 0
0812 08:02:00.961235 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:00.961554 (+   319us) log.cc:844] Serialized 354 byte log entry
0812 08:02:01.667109 (+705555us) op_driver.cc:464] REPLICATION: finished
0812 08:02:01.667367 (+   258us) write_op.cc:301] APPLY: starting
0812 08:02:01.667384 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:01.667423 (+    39us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:01.667436 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:01.667514 (+    78us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:01.667544 (+    30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:01.667548 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:01.667648 (+   100us) log.cc:844] Serialized 22 byte log entry
0812 08:02:01.667748 (+   100us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:01.667763 (+    15us) write_op.cc:454] Released schema lock
0812 08:02:01.667769 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":200,"num_ops":1,"prepare.queue_time_us":592094,"prepare.run_cpu_time_us":843,"prepare.run_wall_time_us":834899,"replication_time_us":705834,"thread_start_us":80,"threads_started":1}]]}
I20260812 08:02:01.710456  4592 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:01.710606  4592 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:01.711169  4592 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:01.711661  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:01.712606  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:01.713021  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:01.817181  4592 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:02.463295  4619 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:02.463483  4619 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:02.464335  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:02.464660  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:02.465128  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:02.465129  4619 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:02.465626  4619 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:02.979066  4622 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:02.979305  4622 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:02.980381  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:02.980451  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:02.981009  4622 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:02.981040  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:02.980741  4625 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=6, attempt_no=0}) took 1311 ms. Trace:
I20260812 08:02:02.981384  4625 rpcz_store.cc:276] 0812 08:02:01.669528 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:01.669616 (+    88us) service_pool.cc:224] Handling call
0812 08:02:02.980715 (+1311099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:01.670173 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:01.670274 (+   101us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:01.670277 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:01.670278 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:01.670338 (+    60us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:01.670345 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:01.670347 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:01.670380 (+    33us) tablet.cc:701] Row locks acquired
0812 08:02:01.670381 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:01.670416 (+    35us) write_op.cc:270] Start()
0812 08:02:02.586560 (+916144us) write_op.cc:276] Timestamp: P: 1786521721670381 usec, L: 0
0812 08:02:02.586566 (+     6us) op_driver.cc:348] REPLICATION: starting
0812 08:02:02.586782 (+   216us) log.cc:844] Serialized 354 byte log entry
0812 08:02:02.980061 (+393279us) op_driver.cc:464] REPLICATION: finished
0812 08:02:02.980332 (+   271us) write_op.cc:301] APPLY: starting
0812 08:02:02.980351 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:02.980382 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:02.980398 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:02.980465 (+    67us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:02.980496 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:02.980500 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:02.980560 (+    60us) log.cc:844] Serialized 22 byte log entry
0812 08:02:02.980620 (+    60us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:02.980634 (+    14us) write_op.cc:454] Released schema lock
0812 08:02:02.980639 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":219,"num_ops":1,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":663,"prepare.run_wall_time_us":916734,"replication_time_us":393455,"thread_start_us":69,"threads_started":1}]]}
I20260812 08:02:03.199958  4619 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:03.200112  4619 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:03.200768  4619 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:03.201282  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:03.201299  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:03.201853  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:03.726082  4622 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:03.727885  4634 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=7, attempt_no=0}) took 2054 ms. Trace:
I20260812 08:02:03.727983  4634 rpcz_store.cc:276] 0812 08:02:01.673287 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:01.673365 (+    78us) service_pool.cc:224] Handling call
0812 08:02:03.727843 (+2054478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:02.586885 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:02.587044 (+   159us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:02.587050 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:02:02.587052 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:02.587147 (+    95us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:02.587157 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:02.587160 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:02.587209 (+    49us) tablet.cc:701] Row locks acquired
0812 08:02:02.587212 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:02:02.587258 (+    46us) write_op.cc:270] Start()
0812 08:02:02.965445 (+378187us) write_op.cc:276] Timestamp: P: 1786521722587187 usec, L: 0
0812 08:02:02.965455 (+    10us) op_driver.cc:348] REPLICATION: starting
0812 08:02:02.965742 (+   287us) log.cc:844] Serialized 354 byte log entry
0812 08:02:03.727245 (+761503us) op_driver.cc:464] REPLICATION: finished
0812 08:02:03.727426 (+   181us) write_op.cc:301] APPLY: starting
0812 08:02:03.727440 (+    14us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:03.727469 (+    29us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:03.727483 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:03.727539 (+    56us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:03.727561 (+    22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:03.727564 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:03.727691 (+   127us) log.cc:844] Serialized 22 byte log entry
0812 08:02:03.727753 (+    62us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:03.727768 (+    15us) write_op.cc:454] Released schema lock
0812 08:02:03.727773 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":145,"num_ops":1,"prepare.queue_time_us":913208,"prepare.run_cpu_time_us":866,"prepare.run_wall_time_us":378945,"replication_time_us":761755,"thread_start_us":64,"threads_started":1}]]}
I20260812 08:02:04.168437  4619 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:04.169936  4634 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=8, attempt_no=0}) took 1186 ms. Trace:
I20260812 08:02:04.170034  4634 rpcz_store.cc:276] 0812 08:02:02.983041 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:02.983118 (+    77us) service_pool.cc:224] Handling call
0812 08:02:04.169919 (+1186801us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:02.983554 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:02.983673 (+   119us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:02.983676 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:02.983677 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:02.983731 (+    54us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:02.983737 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:02.983739 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:02.983771 (+    32us) tablet.cc:701] Row locks acquired
0812 08:02:02.983772 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:02.983800 (+    28us) write_op.cc:270] Start()
0812 08:02:03.073007 (+ 89207us) write_op.cc:276] Timestamp: P: 1786521722983759 usec, L: 0
0812 08:02:03.073014 (+     7us) op_driver.cc:348] REPLICATION: starting
0812 08:02:03.073254 (+   240us) log.cc:844] Serialized 354 byte log entry
0812 08:02:04.169414 (+1096160us) op_driver.cc:464] REPLICATION: finished
0812 08:02:04.169522 (+   108us) write_op.cc:301] APPLY: starting
0812 08:02:04.169540 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:04.169577 (+    37us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:04.169593 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:04.169650 (+    57us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:04.169675 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:04.169679 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:04.169741 (+    62us) log.cc:844] Serialized 22 byte log entry
0812 08:02:04.169820 (+    79us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:04.169833 (+    13us) write_op.cc:454] Released schema lock
0812 08:02:04.169839 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":56,"num_ops":1,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":684,"prepare.run_wall_time_us":89762,"replication_time_us":1096362}]]}
I20260812 08:02:04.510962  4622 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:04.511117  4622 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:04.511690  4622 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:04.511996  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:04.512102  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 10 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:04.513000  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:04.513168  4622 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:04.676240  4619 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:04.676396  4619 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:04.677002  4619 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:04.677444  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:04.677843  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:04.678344  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:04.678651  4619 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:05.345541  4619 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:05.345714  4619 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:05.346307  4619 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:05.346776  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:05.346782  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:05.347249  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:05.347429  4619 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:05.347791  4651 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=10, attempt_no=0}) took 1176 ms. Trace:
I20260812 08:02:05.347884  4651 rpcz_store.cc:276] 0812 08:02:04.171650 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:04.171717 (+    67us) service_pool.cc:224] Handling call
0812 08:02:05.347775 (+1176058us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:04.605049 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:04.605177 (+   128us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:04.605183 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:02:04.605187 (+     4us) tablet.cc:662] Decoding operations
0812 08:02:04.605263 (+    76us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:04.605273 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:04.605278 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:04.605322 (+    44us) tablet.cc:701] Row locks acquired
0812 08:02:04.605323 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:04.605360 (+    37us) write_op.cc:270] Start()
0812 08:02:04.843534 (+238174us) write_op.cc:276] Timestamp: P: 1786521724605298 usec, L: 0
0812 08:02:04.843538 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:04.843741 (+   203us) log.cc:844] Serialized 354 byte log entry
0812 08:02:05.346979 (+503238us) op_driver.cc:464] REPLICATION: finished
0812 08:02:05.347308 (+   329us) write_op.cc:301] APPLY: starting
0812 08:02:05.347324 (+    16us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:05.347352 (+    28us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:05.347388 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:05.347451 (+    63us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:05.347505 (+    54us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:05.347509 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:05.347590 (+    81us) log.cc:844] Serialized 43 byte log entry
0812 08:02:05.347650 (+    60us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:05.347663 (+    13us) write_op.cc:454] Released schema lock
0812 08:02:05.347669 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":277,"num_ops":1,"prepare.queue_time_us":432977,"prepare.run_cpu_time_us":690,"prepare.run_wall_time_us":238777,"replication_time_us":503411,"thread_start_us":81,"threads_started":1}]]}
I20260812 08:02:05.431406  4622 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:05.431566  4622 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:05.432147  4622 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:05.432459  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:05.432590  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:05.433265  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:05.962915  4622 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:06.042896  4619 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:06.043110  4619 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:06.043756  4619 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:06.044180  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:06.044219  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:06.044696  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:06.044937  4619 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:06.045428  4661 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=11, attempt_no=0}) took 1366 ms. Trace:
I20260812 08:02:06.045512  4661 rpcz_store.cc:276] 0812 08:02:04.679315 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:04.679401 (+    86us) service_pool.cc:224] Handling call
0812 08:02:06.045416 (+1366015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:04.843917 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:04.844127 (+   210us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:04.844132 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:04.844134 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:04.844222 (+    88us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:04.844232 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:04.844235 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:04.844279 (+    44us) tablet.cc:701] Row locks acquired
0812 08:02:04.844281 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:04.844328 (+    47us) write_op.cc:270] Start()
0812 08:02:05.520499 (+676171us) write_op.cc:276] Timestamp: P: 1786521724844296 usec, L: 0
0812 08:02:05.520503 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:05.520734 (+   231us) log.cc:844] Serialized 354 byte log entry
0812 08:02:06.044340 (+523606us) op_driver.cc:464] REPLICATION: finished
0812 08:02:06.044830 (+   490us) write_op.cc:301] APPLY: starting
0812 08:02:06.044851 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:06.044884 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:06.044900 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:06.044959 (+    59us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:06.044998 (+    39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:06.045007 (+     9us) write_op.cc:312] APPLY: finished
0812 08:02:06.045091 (+    84us) log.cc:844] Serialized 43 byte log entry
0812 08:02:06.045304 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:06.045318 (+    14us) write_op.cc:454] Released schema lock
0812 08:02:06.045323 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":399,"num_ops":1,"prepare.queue_time_us":164027,"prepare.run_cpu_time_us":813,"prepare.run_wall_time_us":676901,"replication_time_us":523802,"spinlock_wait_cycles":768,"thread_start_us":73,"threads_started":1}]]}
I20260812 08:02:06.117580  4622 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:06.117736  4622 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:06.118345  4622 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:06.118630  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:06.118729  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 13 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:06.119220  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:06.119386  4622 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:06.598869  4622 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:06.599022  4622 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:06.599886  4622 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:06.600238  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:06.600443  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:06.601040  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:06.601398  4622 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:07.097657  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:07.097818  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:07.098371  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:07.098706  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:07.098889  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 14 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:07.099371  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:07.099526  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:07.719777  4664 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:07.719970  4664 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:07.720594  4664 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:07.721079  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:07.721144  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:07.721697  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:07.721978  4664 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:07.722177  4669 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=13, attempt_no=0}) took 1675 ms. Trace:
I20260812 08:02:07.722256  4669 rpcz_store.cc:276] 0812 08:02:06.046968 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:06.047039 (+    71us) service_pool.cc:224] Handling call
0812 08:02:07.722157 (+1675118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:06.130707 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:06.130830 (+   123us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:06.130835 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:06.130837 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:06.130908 (+    71us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:06.130919 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:06.130922 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:06.130966 (+    44us) tablet.cc:701] Row locks acquired
0812 08:02:06.130968 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:06.131011 (+    43us) write_op.cc:270] Start()
0812 08:02:07.130209 (+999198us) write_op.cc:276] Timestamp: P: 1786521726130955 usec, L: 0
0812 08:02:07.130212 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:07.130357 (+   145us) log.cc:844] Serialized 354 byte log entry
0812 08:02:07.721125 (+590768us) op_driver.cc:464] REPLICATION: finished
0812 08:02:07.721453 (+   328us) write_op.cc:301] APPLY: starting
0812 08:02:07.721472 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:07.721725 (+   253us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:07.721742 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:07.721804 (+    62us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:07.721835 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:07.721840 (+     5us) write_op.cc:312] APPLY: finished
0812 08:02:07.721949 (+   109us) log.cc:844] Serialized 43 byte log entry
0812 08:02:07.722007 (+    58us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:07.722023 (+    16us) write_op.cc:454] Released schema lock
0812 08:02:07.722028 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":270,"num_ops":1,"prepare.queue_time_us":83236,"prepare.run_cpu_time_us":633,"prepare.run_wall_time_us":999743,"raft.queue_time_us":76,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"replication_time_us":590878,"thread_start_us":95,"threads_started":1}]]}
I20260812 08:02:08.000458  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:08.000613  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:08.001199  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:08.001571  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:08.001675  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:08.002574  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:08.002785  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:08.256748  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:08.256911  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:08.257509  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:08.257915  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:08.258047  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:08.258623  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:08.258674  4677 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=14, attempt_no=0}) took 2123 ms. Trace:
I20260812 08:02:08.258911  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:08.258733  4677 rpcz_store.cc:276] 0812 08:02:06.135375 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:06.135435 (+    60us) service_pool.cc:224] Handling call
0812 08:02:08.258660 (+2123225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:07.130476 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:07.130600 (+   124us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:07.130605 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:07.130607 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:07.130682 (+    75us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:07.130692 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:07.130695 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:07.130749 (+    54us) tablet.cc:701] Row locks acquired
0812 08:02:07.130750 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:07.130789 (+    39us) write_op.cc:270] Start()
0812 08:02:08.128932 (+998143us) write_op.cc:276] Timestamp: P: 1786521727130733 usec, L: 0
0812 08:02:08.128935 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:08.129077 (+   142us) log.cc:844] Serialized 354 byte log entry
0812 08:02:08.257771 (+128694us) op_driver.cc:464] REPLICATION: finished
0812 08:02:08.258051 (+   280us) write_op.cc:301] APPLY: starting
0812 08:02:08.258072 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:08.258106 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:08.258120 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:08.258210 (+    90us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:08.258243 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:08.258248 (+     5us) write_op.cc:312] APPLY: finished
0812 08:02:08.258317 (+    69us) log.cc:844] Serialized 22 byte log entry
0812 08:02:08.258554 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:08.258569 (+    15us) write_op.cc:454] Released schema lock
0812 08:02:08.258575 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":231,"num_ops":1,"prepare.queue_time_us":994729,"prepare.run_cpu_time_us":665,"prepare.run_wall_time_us":998721,"raft.queue_time_us":58,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":172,"replication_time_us":128802,"thread_start_us":100,"threads_started":1}]]}
I20260812 08:02:08.914914  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:08.915081  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:08.915619  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:08.915984  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:08.916177  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:08.916613  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:08.916843  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:08.917222  4684 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=15, attempt_no=0}) took 1193 ms. Trace:
I20260812 08:02:08.917303  4684 rpcz_store.cc:276] 0812 08:02:07.723871 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:07.723917 (+    46us) service_pool.cc:224] Handling call
0812 08:02:08.917204 (+1193287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:08.129217 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:08.129345 (+   128us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:08.129350 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:08.129352 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:08.129436 (+    84us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:08.129446 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:08.129449 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:08.129499 (+    50us) tablet.cc:701] Row locks acquired
0812 08:02:08.129500 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:08.129547 (+    47us) write_op.cc:270] Start()
0812 08:02:08.338722 (+209175us) write_op.cc:276] Timestamp: P: 1786521728129486 usec, L: 0
0812 08:02:08.338726 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:08.338885 (+   159us) log.cc:844] Serialized 354 byte log entry
0812 08:02:08.916567 (+577682us) op_driver.cc:464] REPLICATION: finished
0812 08:02:08.916792 (+   225us) write_op.cc:301] APPLY: starting
0812 08:02:08.916812 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:08.916843 (+    31us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:08.916857 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:08.916933 (+    76us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:08.916974 (+    41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:08.916979 (+     5us) write_op.cc:312] APPLY: finished
0812 08:02:08.917048 (+    69us) log.cc:844] Serialized 22 byte log entry
0812 08:02:08.917107 (+    59us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:08.917121 (+    14us) write_op.cc:454] Released schema lock
0812 08:02:08.917127 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":163,"num_ops":1,"prepare.queue_time_us":404841,"prepare.run_cpu_time_us":668,"prepare.run_wall_time_us":209754,"replication_time_us":577806,"thread_start_us":81,"threads_started":1}]]}
I20260812 08:02:09.012269  4664 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:09.012451  4664 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:09.013024  4664 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:09.013561  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:09.013520  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:09.013988  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:09.639480  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:09.639658  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:09.640239  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:09.640652  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:09.640733  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 18 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:09.641268  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:09.641558  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:09.642031  4692 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=16, attempt_no=0}) took 1381 ms. Trace:
I20260812 08:02:09.642169  4692 rpcz_store.cc:276] 0812 08:02:08.260084 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:08.260222 (+   138us) service_pool.cc:224] Handling call
0812 08:02:09.642014 (+1381792us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:08.339006 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:08.339134 (+   128us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:08.339141 (+     7us) write_op.cc:435] Acquired schema lock
0812 08:02:08.339143 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:08.339226 (+    83us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:08.339236 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:08.339239 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:08.339291 (+    52us) tablet.cc:701] Row locks acquired
0812 08:02:08.339292 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:08.339352 (+    60us) write_op.cc:270] Start()
0812 08:02:08.990505 (+651153us) write_op.cc:276] Timestamp: P: 1786521728339267 usec, L: 0
0812 08:02:08.990509 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:08.990687 (+   178us) log.cc:844] Serialized 354 byte log entry
0812 08:02:09.641329 (+650642us) op_driver.cc:464] REPLICATION: finished
0812 08:02:09.641569 (+   240us) write_op.cc:301] APPLY: starting
0812 08:02:09.641590 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:09.641623 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:09.641636 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:09.641729 (+    93us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:09.641760 (+    31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:09.641765 (+     5us) write_op.cc:312] APPLY: finished
0812 08:02:09.641838 (+    73us) log.cc:844] Serialized 22 byte log entry
0812 08:02:09.641909 (+    71us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:09.641924 (+    15us) write_op.cc:454] Released schema lock
0812 08:02:09.641931 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":173,"mutex_wait_us":3,"num_ops":1,"prepare.queue_time_us":78363,"prepare.run_cpu_time_us":740,"prepare.run_wall_time_us":651810,"raft.queue_time_us":50,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"replication_time_us":650781,"spinlock_wait_cycles":116608,"thread_start_us":75,"threads_started":1}]]}
I20260812 08:02:10.084168  4664 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:10.084297  4463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:50635 (request call id 2544) took 1070 ms. Trace:
I20260812 08:02:10.084424  4463 rpcz_store.cc:276] 0812 08:02:09.013849 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:09.013907 (+    58us) service_pool.cc:224] Handling call
0812 08:02:09.014068 (+   161us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:02:09.014203 (+   135us) raft_consensus.cc:1534] Early marking committed up to index 16
0812 08:02:09.014349 (+   146us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:02:09.014419 (+    70us) write_op.cc:270] Start()
0812 08:02:09.353610 (+339191us) write_op.cc:276] Timestamp: P: 1786521728129486 usec, L: 0
0812 08:02:09.354001 (+   391us) write_op.cc:270] Start()
0812 08:02:10.083202 (+729201us) write_op.cc:276] Timestamp: P: 1786521728339267 usec, L: 0
0812 08:02:10.083704 (+   502us) log.cc:844] Serialized 708 byte log entry
0812 08:02:10.083825 (+   121us) raft_consensus.cc:1645] Marking committed up to 17
0812 08:02:10.084024 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:02:10.084056 (+    32us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:02:10.084231 (+   175us) raft_consensus.cc:1685] finished
0812 08:02:10.084233 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:02:10.084281 (+    48us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:09.353837 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:09.353971 (+   134us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:09.353975 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:09.353977 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:09.354079 (+   102us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:09.354088 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:09.354091 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:09.354185 (+    94us) tablet.cc:701] Row locks acquired
0812 08:02:09.354187 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:10.083893 (+729706us) op_driver.cc:464] REPLICATION: finished
0812 08:02:10.084154 (+   261us) write_op.cc:301] APPLY: starting
Related trace 'op':
0812 08:02:10.083650 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:10.083780 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:10.083784 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:10.083787 (+     3us) tablet.cc:662] Decoding operations
0812 08:02:10.083856 (+    69us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:10.083890 (+    34us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:10.083893 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:10.083937 (+    44us) tablet.cc:701] Row locks acquired
0812 08:02:10.083939 (+     2us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":67,"threads_started":1,"wal-append.queue_time_us":131,"child_traces":[["op",{"apply.queue_time_us":217,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":86,"prepare.run_cpu_time_us":444,"prepare.run_wall_time_us":445,"replication_time_us":1069453,"thread_start_us":72,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":28,"prepare.queue_time_us":274,"prepare.run_cpu_time_us":368,"prepare.run_wall_time_us":369,"thread_start_us":102,"threads_started":1}]]}
I20260812 08:02:10.443635  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:10.443814  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:10.444510  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:10.445003  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:10.445456  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 19 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:10.445897  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:10.446148  4699 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=17, attempt_no=0}) took 1527 ms. Trace:
I20260812 08:02:10.446211  4699 rpcz_store.cc:276] 0812 08:02:08.918805 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:08.918869 (+    64us) service_pool.cc:224] Handling call
0812 08:02:10.446106 (+1527237us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:08.990842 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:08.990967 (+   125us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:08.990972 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:08.990974 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:08.991052 (+    78us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:08.991059 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:08.991061 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:08.991122 (+    61us) tablet.cc:701] Row locks acquired
0812 08:02:08.991124 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:08.991167 (+    43us) write_op.cc:270] Start()
0812 08:02:09.648308 (+657141us) write_op.cc:276] Timestamp: P: 1786521728991131 usec, L: 0
0812 08:02:09.648312 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:09.648487 (+   175us) log.cc:844] Serialized 354 byte log entry
0812 08:02:10.444900 (+796413us) op_driver.cc:464] REPLICATION: finished
0812 08:02:10.445112 (+   212us) write_op.cc:301] APPLY: starting
0812 08:02:10.445132 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:10.445756 (+   624us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:10.445772 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:10.445836 (+    64us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:10.445869 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:10.445874 (+     5us) write_op.cc:312] APPLY: finished
0812 08:02:10.445941 (+    67us) log.cc:844] Serialized 22 byte log entry
0812 08:02:10.446010 (+    69us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:10.446025 (+    15us) write_op.cc:454] Released schema lock
0812 08:02:10.446031 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":155,"num_ops":1,"prepare.queue_time_us":71517,"prepare.run_cpu_time_us":647,"prepare.run_wall_time_us":657716,"replication_time_us":796547,"thread_start_us":87,"threads_started":1}]]}
I20260812 08:02:11.034564  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:11.036522  4707 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=18, attempt_no=0}) took 1392 ms. Trace:
I20260812 08:02:11.036630  4707 rpcz_store.cc:276] 0812 08:02:09.643782 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:09.643828 (+    46us) service_pool.cc:224] Handling call
0812 08:02:11.036501 (+1392673us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:09.648598 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:09.648719 (+   121us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:09.648724 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:09.648728 (+     4us) tablet.cc:662] Decoding operations
0812 08:02:09.648801 (+    73us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:09.648810 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:09.648815 (+     5us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:09.648864 (+    49us) tablet.cc:701] Row locks acquired
0812 08:02:09.648867 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:02:09.648911 (+    44us) write_op.cc:270] Start()
0812 08:02:09.673110 (+ 24199us) write_op.cc:276] Timestamp: P: 1786521729648865 usec, L: 0
0812 08:02:09.673114 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:09.673372 (+   258us) log.cc:844] Serialized 354 byte log entry
0812 08:02:11.035745 (+1362373us) op_driver.cc:464] REPLICATION: finished
0812 08:02:11.036026 (+   281us) write_op.cc:301] APPLY: starting
0812 08:02:11.036043 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:11.036069 (+    26us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:11.036083 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:11.036268 (+   185us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:11.036294 (+    26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:11.036297 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:11.036357 (+    60us) log.cc:844] Serialized 22 byte log entry
0812 08:02:11.036405 (+    48us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:11.036416 (+    11us) write_op.cc:454] Released schema lock
0812 08:02:11.036420 (+     4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":227,"num_ops":1,"prepare.queue_time_us":4348,"prepare.run_cpu_time_us":874,"prepare.run_wall_time_us":24963,"replication_time_us":1362602,"thread_start_us":95,"threads_started":1}]]}
I20260812 08:02:11.943357  4664 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:11.943538  4664 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:11.943821  4463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:50635 (request call id 2545) took 1857 ms. Trace:
I20260812 08:02:11.943890  4463 rpcz_store.cc:276] 0812 08:02:10.086240 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:10.086294 (+    54us) service_pool.cc:224] Handling call
0812 08:02:10.086454 (+   160us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:02:10.086523 (+    69us) raft_consensus.cc:1534] Early marking committed up to index 18
0812 08:02:10.086615 (+    92us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:02:10.086767 (+   152us) write_op.cc:270] Start()
0812 08:02:11.049052 (+962285us) write_op.cc:276] Timestamp: P: 1786521728991131 usec, L: 0
0812 08:02:11.049456 (+   404us) write_op.cc:270] Start()
0812 08:02:11.942640 (+893184us) write_op.cc:276] Timestamp: P: 1786521729648865 usec, L: 0
0812 08:02:11.943102 (+   462us) log.cc:844] Serialized 708 byte log entry
0812 08:02:11.943266 (+   164us) raft_consensus.cc:1645] Marking committed up to 18
0812 08:02:11.943274 (+     8us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:02:11.943308 (+    34us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:02:11.943718 (+   410us) raft_consensus.cc:1685] finished
0812 08:02:11.943740 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:02:11.943802 (+    62us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:11.049439 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:11.049576 (+   137us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:11.049580 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:11.049581 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:11.049691 (+   110us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:11.049707 (+    16us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:11.049711 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:11.049768 (+    57us) tablet.cc:701] Row locks acquired
0812 08:02:11.049769 (+     1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:02:11.943086 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:11.943216 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:11.943222 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:02:11.943223 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:11.943289 (+    66us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:11.943299 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:11.943301 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:11.943366 (+    65us) tablet.cc:701] Row locks acquired
0812 08:02:11.943367 (+     1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":106,"threads_started":1,"wal-append.queue_time_us":174,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":7,"prepare.queue_time_us":229,"prepare.run_cpu_time_us":438,"prepare.run_wall_time_us":438,"thread_start_us":90,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":273,"prepare.run_cpu_time_us":369,"prepare.run_wall_time_us":369,"thread_start_us":93,"threads_started":1}]]}
I20260812 08:02:11.944245  4664 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:11.944649  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:11.944868  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 20 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:11.945565  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:11.945772  4664 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:12.017534  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:12.017696  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:12.018529  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:12.018952  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:12.019032  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 21 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:12.019526  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:12.019711  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:12.020388  4719 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=19, attempt_no=0}) took 1572 ms. Trace:
I20260812 08:02:12.020469  4719 rpcz_store.cc:276] 0812 08:02:10.447600 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:10.447661 (+    61us) service_pool.cc:224] Handling call
0812 08:02:12.020370 (+1572709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:10.448182 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:10.448277 (+    95us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:10.448280 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:10.448281 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:10.448335 (+    54us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:10.448341 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:10.448343 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:10.448398 (+    55us) tablet.cc:701] Row locks acquired
0812 08:02:10.448400 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:10.448467 (+    67us) write_op.cc:270] Start()
0812 08:02:10.956645 (+508178us) write_op.cc:276] Timestamp: P: 1786521730448416 usec, L: 0
0812 08:02:10.956649 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:10.956856 (+   207us) log.cc:844] Serialized 354 byte log entry
0812 08:02:12.019394 (+1062538us) op_driver.cc:464] REPLICATION: finished
0812 08:02:12.019882 (+   488us) write_op.cc:301] APPLY: starting
0812 08:02:12.019900 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:12.019935 (+    35us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:12.019949 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:12.020043 (+    94us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:12.020069 (+    26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:12.020073 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:12.020194 (+   121us) log.cc:844] Serialized 43 byte log entry
0812 08:02:12.020257 (+    63us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:12.020271 (+    14us) write_op.cc:454] Released schema lock
0812 08:02:12.020277 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":233,"num_ops":1,"prepare.queue_time_us":173,"prepare.run_cpu_time_us":686,"prepare.run_wall_time_us":508767,"replication_time_us":1062711,"thread_start_us":210,"threads_started":2}]]}
I20260812 08:02:12.548357  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:12.548521  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:12.549023  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:12.549549  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:12.549643  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:12.550148  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:12.550385  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:12.550807  4726 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=20, attempt_no=0}) took 1512 ms. Trace:
I20260812 08:02:12.550894  4726 rpcz_store.cc:276] 0812 08:02:11.038054 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:11.038144 (+    90us) service_pool.cc:224] Handling call
0812 08:02:12.550790 (+1512646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:11.038568 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:11.038677 (+   109us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:11.038680 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:11.038681 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:11.038733 (+    52us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:11.038739 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:11.038741 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:11.038771 (+    30us) tablet.cc:701] Row locks acquired
0812 08:02:11.038772 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:11.038799 (+    27us) write_op.cc:270] Start()
0812 08:02:11.165950 (+127151us) write_op.cc:276] Timestamp: P: 1786521731038757 usec, L: 0
0812 08:02:11.165954 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:11.166230 (+   276us) log.cc:844] Serialized 354 byte log entry
0812 08:02:12.550058 (+1383828us) op_driver.cc:464] REPLICATION: finished
0812 08:02:12.550318 (+   260us) write_op.cc:301] APPLY: starting
0812 08:02:12.550338 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:12.550372 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:12.550387 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:12.550453 (+    66us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:12.550495 (+    42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:12.550501 (+     6us) write_op.cc:312] APPLY: finished
0812 08:02:12.550587 (+    86us) log.cc:844] Serialized 43 byte log entry
0812 08:02:12.550665 (+    78us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:12.550686 (+    21us) write_op.cc:454] Released schema lock
0812 08:02:12.550693 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":196,"num_ops":1,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":663,"prepare.run_wall_time_us":127731,"replication_time_us":1384070,"thread_start_us":92,"threads_started":1}]]}
I20260812 08:02:12.849839  4664 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:12.850013  4664 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:12.850728  4664 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:12.851143  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:12.851182  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 22 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:12.851630  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:13.479794  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:13.479954  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:13.480571  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:13.480985  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:13.481076  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 23 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:13.481575  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:13.482014  4735 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=21, attempt_no=0}) took 1460 ms. Trace:
I20260812 08:02:13.482146  4735 rpcz_store.cc:276] 0812 08:02:12.021914 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:12.021984 (+    70us) service_pool.cc:224] Handling call
0812 08:02:13.481906 (+1459922us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:12.022529 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:12.022620 (+    91us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:12.022623 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:12.022624 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:12.022678 (+    54us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:12.022683 (+     5us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:12.022685 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:12.022742 (+    57us) tablet.cc:701] Row locks acquired
0812 08:02:12.022743 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:12.022771 (+    28us) write_op.cc:270] Start()
0812 08:02:12.167933 (+145162us) write_op.cc:276] Timestamp: P: 1786521732022739 usec, L: 0
0812 08:02:12.167938 (+     5us) op_driver.cc:348] REPLICATION: starting
0812 08:02:12.168151 (+   213us) log.cc:844] Serialized 354 byte log entry
0812 08:02:13.481087 (+1312936us) op_driver.cc:464] REPLICATION: finished
0812 08:02:13.481481 (+   394us) write_op.cc:301] APPLY: starting
0812 08:02:13.481501 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:13.481538 (+    37us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:13.481551 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:13.481612 (+    61us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:13.481635 (+    23us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:13.481638 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:13.481743 (+   105us) log.cc:844] Serialized 43 byte log entry
0812 08:02:13.481801 (+    58us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:13.481815 (+    14us) write_op.cc:454] Released schema lock
0812 08:02:13.481821 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":336,"num_ops":1,"prepare.queue_time_us":142,"prepare.run_cpu_time_us":642,"prepare.run_wall_time_us":145711,"replication_time_us":1313112,"thread_start_us":138,"threads_started":2}]]}
I20260812 08:02:13.556799  4664 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:14.274883  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:14.276746  4744 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=22, attempt_no=0}) took 1724 ms. Trace:
I20260812 08:02:14.276862  4744 rpcz_store.cc:276] 0812 08:02:12.552291 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:12.552358 (+    67us) service_pool.cc:224] Handling call
0812 08:02:14.276723 (+1724365us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:12.552821 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:12.552910 (+    89us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:12.552913 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:12.552915 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:12.552965 (+    50us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:12.552990 (+    25us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:12.552996 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:12.553036 (+    40us) tablet.cc:701] Row locks acquired
0812 08:02:12.553037 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:12.553073 (+    36us) write_op.cc:270] Start()
0812 08:02:13.310230 (+757157us) write_op.cc:276] Timestamp: P: 1786521732553038 usec, L: 0
0812 08:02:13.310234 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:13.310451 (+   217us) log.cc:844] Serialized 354 byte log entry
0812 08:02:14.276044 (+965593us) op_driver.cc:464] REPLICATION: finished
0812 08:02:14.276265 (+   221us) write_op.cc:301] APPLY: starting
0812 08:02:14.276281 (+    16us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:14.276309 (+    28us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:14.276323 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:14.276378 (+    55us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:14.276400 (+    22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:14.276403 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:14.276514 (+   111us) log.cc:844] Serialized 43 byte log entry
0812 08:02:14.276574 (+    60us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:14.276589 (+    15us) write_op.cc:454] Released schema lock
0812 08:02:14.276595 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":139,"num_ops":1,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":633,"prepare.run_wall_time_us":757698,"replication_time_us":965778,"thread_start_us":87,"threads_started":1}]]}
I20260812 08:02:14.297560  4664 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:14.297713  4664 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:14.298362  4664 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:14.298694  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:14.298811  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 24 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:14.299335  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:14.311086  4664 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:14.351569  4663 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:14.351723  4663 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:14.352290  4663 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:14.352604  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:14.352702  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:14.353080  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:14.353616  4663 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:14.464803  4664 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:14.464969  4664 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:14.465444  4664 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:14.465862  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:14.470593  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 25 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:14.471493  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:14.471694  4664 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:15.604905  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:15.605098  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:15.605773  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:15.606253  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:15.606253  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:15.606982  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:15.607436  4754 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=24, attempt_no=0}) took 1329 ms. Trace:
I20260812 08:02:15.607530  4754 rpcz_store.cc:276] 0812 08:02:14.278436 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:14.278478 (+    42us) service_pool.cc:224] Handling call
0812 08:02:15.607420 (+1328942us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:14.295009 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:14.295141 (+   132us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:14.295145 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:14.295147 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:14.295223 (+    76us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:14.295233 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:14.295236 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:14.295332 (+    96us) tablet.cc:701] Row locks acquired
0812 08:02:14.295334 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:14.295379 (+    45us) write_op.cc:270] Start()
0812 08:02:15.211526 (+916147us) write_op.cc:276] Timestamp: P: 1786521734295329 usec, L: 0
0812 08:02:15.211531 (+     5us) op_driver.cc:348] REPLICATION: starting
0812 08:02:15.211752 (+   221us) log.cc:844] Serialized 354 byte log entry
0812 08:02:15.606621 (+394869us) op_driver.cc:464] REPLICATION: finished
0812 08:02:15.607002 (+   381us) write_op.cc:301] APPLY: starting
0812 08:02:15.607020 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:15.607055 (+    35us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:15.607070 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:15.607133 (+    63us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:15.607165 (+    32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:15.607169 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:15.607255 (+    86us) log.cc:844] Serialized 43 byte log entry
0812 08:02:15.607311 (+    56us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:15.607326 (+    15us) write_op.cc:454] Released schema lock
0812 08:02:15.607331 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":323,"num_ops":1,"prepare.queue_time_us":16173,"prepare.run_cpu_time_us":795,"prepare.run_wall_time_us":916851,"raft.queue_time_us":250,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":392,"replication_time_us":395053,"spinlock_wait_cycles":91648,"thread_start_us":107,"threads_started":1}]]}
I20260812 08:02:16.135730  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:16.135900  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:16.136467  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:16.136925  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:16.136919  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 26 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:16.137442  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:16.151479  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:16.153330  4765 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=25, attempt_no=0}) took 1839 ms. Trace:
I20260812 08:02:16.153438  4765 rpcz_store.cc:276] 0812 08:02:14.314029 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:14.314098 (+    69us) service_pool.cc:224] Handling call
0812 08:02:16.153306 (+1839208us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:15.211895 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:15.212019 (+   124us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:15.212025 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:02:15.212027 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:15.212108 (+    81us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:15.212117 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:15.212120 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:15.212166 (+    46us) tablet.cc:701] Row locks acquired
0812 08:02:15.212170 (+     4us) write_op.cc:260] PREPARE: finished
0812 08:02:15.212233 (+    63us) write_op.cc:270] Start()
0812 08:02:15.212358 (+   125us) write_op.cc:276] Timestamp: P: 1786521735212187 usec, L: 0
0812 08:02:15.212361 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:15.212482 (+   121us) log.cc:844] Serialized 354 byte log entry
0812 08:02:16.152595 (+940113us) op_driver.cc:464] REPLICATION: finished
0812 08:02:16.152803 (+   208us) write_op.cc:301] APPLY: starting
0812 08:02:16.152824 (+    21us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:16.152860 (+    36us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:16.152874 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:16.152950 (+    76us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:16.152977 (+    27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:16.152981 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:16.153095 (+   114us) log.cc:844] Serialized 43 byte log entry
0812 08:02:16.153162 (+    67us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:16.153188 (+    26us) write_op.cc:454] Released schema lock
0812 08:02:16.153194 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":149,"num_ops":1,"prepare.queue_time_us":897390,"prepare.run_cpu_time_us":600,"prepare.run_wall_time_us":648,"replication_time_us":940199,"thread_start_us":84,"threads_started":1}]]}
I20260812 08:02:16.500289  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:16.500501  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:16.501050  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:16.501470  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:16.501549  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:16.502036  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:16.502370  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:16.639621  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:16.657167  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:16.657359  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:16.658032  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:16.658573  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:16.661633  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 28 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:16.662442  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:16.663110  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:16.940233  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:16.940407  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:16.940951  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:16.941311  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:16.941517  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:16.942088  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:16.942351  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:17.087692  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:17.087860  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:17.088434  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:17.088949  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:17.088948  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 30 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:17.089548  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:17.089771  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:17.433517  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:17.433724  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:17.434370  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:17.434790  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:17.434927  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 29 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:17.435422  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:17.831297  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:17.831458  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:17.831996  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:17.832518  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:17.833277  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 31 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:17.834185  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:18.421751  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:18.423585  4781 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=30, attempt_no=0}) took 1332 ms. Trace:
I20260812 08:02:18.423714  4781 rpcz_store.cc:276] 0812 08:02:17.091158 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:17.091210 (+    52us) service_pool.cc:224] Handling call
0812 08:02:18.423563 (+1332353us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:17.363279 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:17.363406 (+   127us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:17.363411 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:17.363413 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:17.363490 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:17.363501 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:17.363504 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:17.363551 (+    47us) tablet.cc:701] Row locks acquired
0812 08:02:17.363553 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:17.363632 (+    79us) write_op.cc:270] Start()
0812 08:02:17.411807 (+ 48175us) write_op.cc:276] Timestamp: P: 1786521737363562 usec, L: 0
0812 08:02:17.411811 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:17.412054 (+   243us) log.cc:844] Serialized 354 byte log entry
0812 08:02:18.422906 (+1010852us) op_driver.cc:464] REPLICATION: finished
0812 08:02:18.423133 (+   227us) write_op.cc:301] APPLY: starting
0812 08:02:18.423150 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:18.423182 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:18.423196 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:18.423258 (+    62us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:18.423291 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:18.423295 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:18.423380 (+    85us) log.cc:844] Serialized 43 byte log entry
0812 08:02:18.423454 (+    74us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:18.423466 (+    12us) write_op.cc:454] Released schema lock
0812 08:02:18.423471 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":182,"num_ops":1,"prepare.queue_time_us":271631,"prepare.run_cpu_time_us":785,"prepare.run_wall_time_us":48862,"replication_time_us":1011065,"thread_start_us":65,"threads_started":1}]]}
I20260812 08:02:18.713882  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:18.714092  4316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:34709 (request call id 2912) took 1279 ms. Trace:
I20260812 08:02:18.714239  4316 rpcz_store.cc:276] 0812 08:02:17.435096 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:17.435141 (+    45us) service_pool.cc:224] Handling call
0812 08:02:17.435311 (+   170us) raft_consensus.cc:1471] Updating replica for 3 ops
0812 08:02:17.435411 (+   100us) raft_consensus.cc:1534] Early marking committed up to index 29
0812 08:02:17.435623 (+   212us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0812 08:02:17.435803 (+   180us) write_op.cc:270] Start()
0812 08:02:18.286990 (+851187us) write_op.cc:276] Timestamp: P: 1786521736839827 usec, L: 0
0812 08:02:18.287388 (+   398us) write_op.cc:270] Start()
0812 08:02:18.512555 (+225167us) write_op.cc:276] Timestamp: P: 1786521737058787 usec, L: 0
0812 08:02:18.512833 (+   278us) write_op.cc:270] Start()
0812 08:02:18.713042 (+200209us) write_op.cc:276] Timestamp: P: 1786521737363562 usec, L: 0
0812 08:02:18.713401 (+   359us) log.cc:844] Serialized 1062 byte log entry
0812 08:02:18.713575 (+   174us) raft_consensus.cc:1645] Marking committed up to 30
0812 08:02:18.713773 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:02:18.713810 (+    37us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:02:18.714000 (+   190us) raft_consensus.cc:1685] finished
0812 08:02:18.714002 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:02:18.714069 (+    67us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:18.287429 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:18.287543 (+   114us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:18.287547 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:18.287548 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:18.287612 (+    64us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:18.287621 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:18.287623 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:18.287671 (+    48us) tablet.cc:701] Row locks acquired
0812 08:02:18.287672 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:18.713619 (+425947us) op_driver.cc:464] REPLICATION: finished
0812 08:02:18.713871 (+   252us) write_op.cc:301] APPLY: starting
0812 08:02:18.713884 (+    13us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:18.713918 (+    34us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:18.713922 (+     4us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:18.713989 (+    67us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:18.714018 (+    29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:18.714045 (+    27us) write_op.cc:312] APPLY: finished
0812 08:02:18.714218 (+   173us) log.cc:844] Serialized 43 byte log entry
0812 08:02:18.714319 (+   101us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:18.714330 (+    11us) write_op.cc:454] Released schema lock
0812 08:02:18.714335 (+     5us) write_op.cc:341] FINISH: Updating metrics
0812 08:02:18.714435 (+   100us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:18.714440 (+     5us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 08:02:18.512800 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:18.512917 (+   117us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:18.512922 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:18.512923 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:18.512988 (+    65us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:18.512998 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:18.513000 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:18.513044 (+    44us) tablet.cc:701] Row locks acquired
0812 08:02:18.513045 (+     1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:02:18.713305 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:18.713519 (+   214us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:18.713525 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:02:18.713526 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:18.713609 (+    83us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:18.713619 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:18.713621 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:18.713663 (+    42us) tablet.cc:701] Row locks acquired
0812 08:02:18.713664 (+     1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":116,"threads_started":1,"wal-append.queue_time_us":199,"child_traces":[["op",{"apply.queue_time_us":205,"apply.run_cpu_time_us":552,"apply.run_wall_time_us":552,"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":297,"prepare.run_cpu_time_us":328,"prepare.run_wall_time_us":329,"replication_time_us":1277793,"thread_start_us":212,"threads_started":2}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":86,"prepare.run_cpu_time_us":338,"prepare.run_wall_time_us":338}],["op",{"num_ops":1,"partition_lock_wait_us":5,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":424,"prepare.run_wall_time_us":424}]]}
I20260812 08:02:19.312767  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:19.312940  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:19.313683  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:19.314056  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:19.314205  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 33 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:19.314728  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:19.314760  4792 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=31, attempt_no=0}) took 1480 ms. Trace:
I20260812 08:02:19.314905  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:19.314834  4792 rpcz_store.cc:276] 0812 08:02:17.834374 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:17.834436 (+    62us) service_pool.cc:224] Handling call
0812 08:02:19.314743 (+1480307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:17.835022 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:17.835126 (+   104us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:17.835129 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:17.835130 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:17.835186 (+    56us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:17.835192 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:17.835194 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:17.835224 (+    30us) tablet.cc:701] Row locks acquired
0812 08:02:17.835225 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:17.835252 (+    27us) write_op.cc:270] Start()
0812 08:02:18.316439 (+481187us) write_op.cc:276] Timestamp: P: 1786521737835212 usec, L: 0
0812 08:02:18.316442 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:18.316662 (+   220us) log.cc:844] Serialized 354 byte log entry
0812 08:02:19.314083 (+997421us) op_driver.cc:464] REPLICATION: finished
0812 08:02:19.314325 (+   242us) write_op.cc:301] APPLY: starting
0812 08:02:19.314345 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:19.314375 (+    30us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:19.314387 (+    12us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:19.314445 (+    58us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:19.314471 (+    26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:19.314475 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:19.314557 (+    82us) log.cc:844] Serialized 43 byte log entry
0812 08:02:19.314619 (+    62us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:19.314645 (+    26us) write_op.cc:454] Released schema lock
0812 08:02:19.314651 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":185,"num_ops":1,"prepare.queue_time_us":184,"prepare.run_cpu_time_us":667,"prepare.run_wall_time_us":481759,"replication_time_us":997603,"thread_start_us":111,"threads_started":1}]]}
I20260812 08:02:19.832243  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:19.832410  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:19.833058  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:19.833504  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:19.833563  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:19.834435  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:19.834622  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:19.834513  4798 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=32, attempt_no=0}) took 1409 ms. Trace:
I20260812 08:02:19.834837  4798 rpcz_store.cc:276] 0812 08:02:18.425279 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:18.425356 (+    77us) service_pool.cc:224] Handling call
0812 08:02:19.834496 (+1409140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:18.425746 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:18.425837 (+    91us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:18.425840 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:18.425841 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:18.425894 (+    53us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:18.425900 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:18.425902 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:18.425933 (+    31us) tablet.cc:701] Row locks acquired
0812 08:02:18.425933 (+     0us) write_op.cc:260] PREPARE: finished
0812 08:02:18.425962 (+    29us) write_op.cc:270] Start()
0812 08:02:18.443115 (+ 17153us) write_op.cc:276] Timestamp: P: 1786521738425916 usec, L: 0
0812 08:02:18.443119 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:18.443351 (+   232us) log.cc:844] Serialized 354 byte log entry
0812 08:02:19.833706 (+1390355us) op_driver.cc:464] REPLICATION: finished
0812 08:02:19.834058 (+   352us) write_op.cc:301] APPLY: starting
0812 08:02:19.834077 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:19.834110 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:19.834153 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:19.834220 (+    67us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:19.834258 (+    38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:19.834264 (+     6us) write_op.cc:312] APPLY: finished
0812 08:02:19.834339 (+    75us) log.cc:844] Serialized 22 byte log entry
0812 08:02:19.834401 (+    62us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:19.834414 (+    13us) write_op.cc:454] Released schema lock
0812 08:02:19.834419 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":291,"num_ops":1,"prepare.queue_time_us":43,"prepare.run_cpu_time_us":599,"prepare.run_wall_time_us":17664,"replication_time_us":1390552,"thread_start_us":177,"threads_started":1}]]}
I20260812 08:02:20.119400  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:20.119556  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:20.119948  4316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:34709 (request call id 2913) took 1403 ms. Trace:
I20260812 08:02:20.120119  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:20.120038  4316 rpcz_store.cc:276] 0812 08:02:18.716201 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:18.716281 (+    80us) service_pool.cc:224] Handling call
0812 08:02:18.716425 (+   144us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:02:18.716496 (+    71us) raft_consensus.cc:1534] Early marking committed up to index 32
0812 08:02:18.716719 (+   223us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:02:18.716849 (+   130us) write_op.cc:270] Start()
0812 08:02:19.232048 (+515199us) write_op.cc:276] Timestamp: P: 1786521737835212 usec, L: 0
0812 08:02:19.232443 (+   395us) write_op.cc:270] Start()
0812 08:02:20.118653 (+886210us) write_op.cc:276] Timestamp: P: 1786521738425916 usec, L: 0
0812 08:02:20.119174 (+   521us) log.cc:844] Serialized 708 byte log entry
0812 08:02:20.119306 (+   132us) raft_consensus.cc:1645] Marking committed up to 32
0812 08:02:20.119313 (+     7us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:02:20.119352 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:02:20.119874 (+   522us) raft_consensus.cc:1685] finished
0812 08:02:20.119878 (+     4us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:02:20.119931 (+    53us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:19.232446 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:19.232559 (+   113us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:19.232563 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:19.232564 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:19.232627 (+    63us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:19.232658 (+    31us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:19.232660 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:19.232699 (+    39us) tablet.cc:701] Row locks acquired
0812 08:02:19.232700 (+     1us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:02:20.119119 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:20.119249 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:20.119253 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:20.119255 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:20.119317 (+    62us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:20.119326 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:20.119328 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:20.119390 (+    62us) tablet.cc:701] Row locks acquired
0812 08:02:20.119391 (+     1us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":72,"threads_started":1,"wal-append.queue_time_us":222,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":251,"prepare.run_cpu_time_us":343,"prepare.run_wall_time_us":344,"thread_start_us":99,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":4,"prepare.queue_time_us":305,"prepare.run_cpu_time_us":373,"prepare.run_wall_time_us":374,"thread_start_us":116,"threads_started":1}]]}
I20260812 08:02:20.120584  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:20.120615  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 34 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:20.121059  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:20.121284  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:20.448307  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:20.448459  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:20.449002  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:20.449375  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:20.449463  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:20.449944  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:20.450169  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:20.450249  4807 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=33, attempt_no=0}) took 1134 ms. Trace:
I20260812 08:02:20.450356  4807 rpcz_store.cc:276] 0812 08:02:19.316276 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:19.316341 (+    65us) service_pool.cc:224] Handling call
0812 08:02:20.450233 (+1133892us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:19.316822 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:19.316916 (+    94us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:19.316919 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:19.316920 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:19.316973 (+    53us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:19.316978 (+     5us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:19.316980 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:19.317011 (+    31us) tablet.cc:701] Row locks acquired
0812 08:02:19.317012 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:19.317041 (+    29us) write_op.cc:270] Start()
0812 08:02:19.954190 (+637149us) write_op.cc:276] Timestamp: P: 1786521739317004 usec, L: 0
0812 08:02:19.954193 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:19.954374 (+   181us) log.cc:844] Serialized 354 byte log entry
0812 08:02:20.449502 (+495128us) op_driver.cc:464] REPLICATION: finished
0812 08:02:20.449770 (+   268us) write_op.cc:301] APPLY: starting
0812 08:02:20.449789 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:20.449821 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:20.449834 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:20.449889 (+    55us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:20.449927 (+    38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:20.449930 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:20.449995 (+    65us) log.cc:844] Serialized 43 byte log entry
0812 08:02:20.450076 (+    81us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:20.450092 (+    16us) write_op.cc:454] Released schema lock
0812 08:02:20.450099 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":213,"num_ops":1,"prepare.queue_time_us":143,"prepare.run_cpu_time_us":534,"prepare.run_wall_time_us":637608,"replication_time_us":495276,"thread_start_us":139,"threads_started":2}]]}
I20260812 08:02:20.566982  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:20.567147  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:20.567751  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:20.568296  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:20.568689  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:20.569099  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:20.569283  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:20.665140  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:20.665293  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:20.665304  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:20.665421  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:20.665805  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:20.665870  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:20.666397  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:20.666744  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:20.667104  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:20.667253  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:20.667434  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 35 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:20.667809  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:20.667821  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:20.668082  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:21.576407  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:21.576575  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:21.577240  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:21.577725  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:21.577782  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:21.578301  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:21.578539  4813 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=34, attempt_no=0}) took 1742 ms. Trace:
I20260812 08:02:21.578577  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:21.578611  4813 rpcz_store.cc:276] 0812 08:02:19.836306 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:19.836531 (+   225us) service_pool.cc:224] Handling call
0812 08:02:21.578522 (+1741991us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:19.954469 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:19.954599 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:19.954603 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:19.954605 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:19.954694 (+    89us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:19.954704 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:19.954708 (+     4us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:19.954754 (+    46us) tablet.cc:701] Row locks acquired
0812 08:02:19.954755 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:19.954799 (+    44us) write_op.cc:270] Start()
0812 08:02:20.780950 (+826151us) write_op.cc:276] Timestamp: P: 1786521739954746 usec, L: 0
0812 08:02:20.780953 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:20.781156 (+   203us) log.cc:844] Serialized 354 byte log entry
0812 08:02:21.577722 (+796566us) op_driver.cc:464] REPLICATION: finished
0812 08:02:21.577957 (+   235us) write_op.cc:301] APPLY: starting
0812 08:02:21.577976 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:21.578012 (+    36us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:21.578030 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:21.578167 (+   137us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:21.578205 (+    38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:21.578209 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:21.578334 (+   125us) log.cc:844] Serialized 43 byte log entry
0812 08:02:21.578403 (+    69us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:21.578416 (+    13us) write_op.cc:454] Released schema lock
0812 08:02:21.578422 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":184,"num_ops":1,"prepare.queue_time_us":117479,"prepare.run_cpu_time_us":700,"prepare.run_wall_time_us":826779,"raft.queue_time_us":26,"raft.run_cpu_time_us":30,"raft.run_wall_time_us":31,"replication_time_us":796737,"spinlock_wait_cycles":81408,"thread_start_us":67,"threads_started":1}]]}
I20260812 08:02:21.665046  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:21.665197  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:21.665761  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:21.666152  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:21.666155  4316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 36 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:21.666710  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:21.666996  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:22.166818  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:22.166986  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:22.167582  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:22.168005  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:22.168084  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:22.168522  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:22.168780  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:22.169103  4820 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=35, attempt_no=0}) took 1717 ms. Trace:
I20260812 08:02:22.169198  4820 rpcz_store.cc:276] 0812 08:02:20.451709 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:20.451792 (+    83us) service_pool.cc:224] Handling call
0812 08:02:22.169091 (+1717299us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:20.781302 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:20.781432 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:20.781437 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:20.781439 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:20.781517 (+    78us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:20.781524 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:20.781526 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:20.781564 (+    38us) tablet.cc:701] Row locks acquired
0812 08:02:20.781565 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:20.781621 (+    56us) write_op.cc:270] Start()
0812 08:02:21.757787 (+976166us) write_op.cc:276] Timestamp: P: 1786521740781577 usec, L: 0
0812 08:02:21.757791 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:21.757987 (+   196us) log.cc:844] Serialized 354 byte log entry
0812 08:02:22.167965 (+409978us) op_driver.cc:464] REPLICATION: finished
0812 08:02:22.168452 (+   487us) write_op.cc:301] APPLY: starting
0812 08:02:22.168470 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:22.168502 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:22.168517 (+    15us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:22.168574 (+    57us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:22.168624 (+    50us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:22.168633 (+     9us) write_op.cc:312] APPLY: finished
0812 08:02:22.168733 (+   100us) log.cc:844] Serialized 43 byte log entry
0812 08:02:22.168957 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:22.168972 (+    15us) write_op.cc:454] Released schema lock
0812 08:02:22.168978 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":431,"num_ops":1,"prepare.queue_time_us":329087,"prepare.run_cpu_time_us":818,"prepare.run_wall_time_us":976900,"raft.queue_time_us":151,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":6,"replication_time_us":410135,"spinlock_wait_cycles":4480,"thread_start_us":97,"threads_started":1}]]}
I20260812 08:02:22.526760  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:22.526965  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:22.527580  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:22.528050  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:22.528101  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 37 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:22.528724  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:22.535561  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:22.816838  4751 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:22.816978  4751 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:22.817500  4751 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:22.818022  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:22.818038  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:22.818784  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:22.819093  4751 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:22.898164  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:22.898308  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:22.898798  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:22.899483  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:22.899483  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 38 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:22.900187  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:23.554394  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:23.875504  4833 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:23.875751  4833 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:23.876391  4833 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:23.876732  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:23.876914  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:23.877454  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:23.877637  4833 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:23.878094  4836 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=38, attempt_no=0}) took 1339 ms. Trace:
I20260812 08:02:23.878225  4836 rpcz_store.cc:276] 0812 08:02:22.538639 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:22.538753 (+   114us) service_pool.cc:224] Handling call
0812 08:02:23.878066 (+1339313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:22.586862 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:22.586992 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:22.586996 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:22.586998 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:22.587073 (+    75us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:22.587124 (+    51us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:22.587127 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:22.587195 (+    68us) tablet.cc:701] Row locks acquired
0812 08:02:22.587198 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:02:22.587247 (+    49us) write_op.cc:270] Start()
0812 08:02:23.559505 (+972258us) write_op.cc:276] Timestamp: P: 1786521742587182 usec, L: 0
0812 08:02:23.559509 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:23.559723 (+   214us) log.cc:844] Serialized 354 byte log entry
0812 08:02:23.877071 (+317348us) op_driver.cc:464] REPLICATION: finished
0812 08:02:23.877397 (+   326us) write_op.cc:301] APPLY: starting
0812 08:02:23.877415 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:23.877447 (+    32us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:23.877460 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:23.877525 (+    65us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:23.877557 (+    32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:23.877561 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:23.877799 (+   238us) log.cc:844] Serialized 22 byte log entry
0812 08:02:23.877863 (+    64us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:23.877970 (+   107us) write_op.cc:454] Released schema lock
0812 08:02:23.877978 (+     8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":251,"num_ops":1,"prepare.queue_time_us":47687,"prepare.run_cpu_time_us":1029,"prepare.run_wall_time_us":973088,"raft.queue_time_us":416,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":191,"replication_time_us":317101,"spinlock_wait_cycles":125568,"thread_start_us":213,"threads_started":2}]]}
I20260812 08:02:24.299615  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:24.299788  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:24.300318  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:24.300691  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:24.300691  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:24.301285  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:24.301478  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:24.575315  4841 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:24.575489  4841 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:24.576463  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:24.576568  4841 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:24.576764  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:24.577247  4843 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=39, attempt_no=0}) took 1757 ms. Trace:
I20260812 08:02:24.577312  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:24.577613  4841 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:24.577451  4843 rpcz_store.cc:276] 0812 08:02:22.820253 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:22.820314 (+    61us) service_pool.cc:224] Handling call
0812 08:02:24.577231 (+1756917us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:23.559977 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:23.560106 (+   129us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:23.560111 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:23.560113 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:23.560188 (+    75us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:23.560195 (+     7us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:23.560197 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:23.560259 (+    62us) tablet.cc:701] Row locks acquired
0812 08:02:23.560260 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:23.560306 (+    46us) write_op.cc:270] Start()
0812 08:02:24.548424 (+988118us) write_op.cc:276] Timestamp: P: 1786521743560225 usec, L: 0
0812 08:02:24.548428 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:24.548579 (+   151us) log.cc:844] Serialized 354 byte log entry
0812 08:02:24.576351 (+ 27772us) op_driver.cc:464] REPLICATION: finished
0812 08:02:24.576823 (+   472us) write_op.cc:301] APPLY: starting
0812 08:02:24.576842 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:24.576875 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:24.576889 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:24.576947 (+    58us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:24.576987 (+    40us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:24.576997 (+    10us) write_op.cc:312] APPLY: finished
0812 08:02:24.577062 (+    65us) log.cc:844] Serialized 22 byte log entry
0812 08:02:24.577138 (+    76us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:24.577155 (+    17us) write_op.cc:454] Released schema lock
0812 08:02:24.577161 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":418,"num_ops":1,"prepare.queue_time_us":739228,"prepare.run_cpu_time_us":753,"prepare.run_wall_time_us":988808,"raft.queue_time_us":287,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":183,"replication_time_us":27886,"thread_start_us":203,"threads_started":2}]]}
I20260812 08:02:25.156381  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:25.156536  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:25.157013  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:25.157526  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:25.157541  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:25.158036  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:25.158280  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:25.920209  4841 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:25.920392  4841 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:25.920993  4841 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:25.921403  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:25.921514  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:25.922051  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:25.923069  4859 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=40, attempt_no=0}) took 2043 ms. Trace:
I20260812 08:02:25.923148  4859 rpcz_store.cc:276] 0812 08:02:23.879695 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:23.879797 (+   102us) service_pool.cc:224] Handling call
0812 08:02:25.923036 (+2043239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:24.548812 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:24.548937 (+   125us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:24.548941 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:24.548943 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:24.549020 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:24.549029 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:24.549032 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:24.549077 (+    45us) tablet.cc:701] Row locks acquired
0812 08:02:24.549080 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:02:24.549128 (+    48us) write_op.cc:270] Start()
0812 08:02:25.022272 (+473144us) write_op.cc:276] Timestamp: P: 1786521744549064 usec, L: 0
0812 08:02:25.022275 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:25.022429 (+   154us) log.cc:844] Serialized 354 byte log entry
0812 08:02:25.921853 (+899424us) op_driver.cc:464] REPLICATION: finished
0812 08:02:25.922655 (+   802us) write_op.cc:301] APPLY: starting
0812 08:02:25.922674 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:25.922722 (+    48us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:25.922736 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:25.922789 (+    53us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:25.922813 (+    24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:25.922817 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:25.922912 (+    95us) log.cc:844] Serialized 43 byte log entry
0812 08:02:25.922954 (+    42us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:25.922965 (+    11us) write_op.cc:454] Released schema lock
0812 08:02:25.922968 (+     3us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":746,"mutex_wait_us":19,"num_ops":1,"prepare.queue_time_us":668649,"prepare.run_cpu_time_us":677,"prepare.run_wall_time_us":473755,"raft.queue_time_us":259,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":899543,"thread_start_us":687,"threads_started":1}]]}
I20260812 08:02:26.010262  4841 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:26.011926  4859 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=41, attempt_no=0}) took 1433 ms. Trace:
I20260812 08:02:26.012044  4859 rpcz_store.cc:276] 0812 08:02:24.578883 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:24.578948 (+    65us) service_pool.cc:224] Handling call
0812 08:02:26.011908 (+1432960us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:25.022591 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:25.022751 (+   160us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:25.022757 (+     6us) write_op.cc:435] Acquired schema lock
0812 08:02:25.022759 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:25.022836 (+    77us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:25.022848 (+    12us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:25.022851 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:25.022894 (+    43us) tablet.cc:701] Row locks acquired
0812 08:02:25.022896 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:25.022945 (+    49us) write_op.cc:270] Start()
0812 08:02:25.097098 (+ 74153us) write_op.cc:276] Timestamp: P: 1786521745022896 usec, L: 0
0812 08:02:25.097101 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:25.097309 (+   208us) log.cc:844] Serialized 354 byte log entry
0812 08:02:26.011284 (+913975us) op_driver.cc:464] REPLICATION: finished
0812 08:02:26.011451 (+   167us) write_op.cc:301] APPLY: starting
0812 08:02:26.011473 (+    22us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:26.011506 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:26.011528 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:26.011596 (+    68us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:26.011629 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:26.011634 (+     5us) write_op.cc:312] APPLY: finished
0812 08:02:26.011730 (+    96us) log.cc:844] Serialized 22 byte log entry
0812 08:02:26.011805 (+    75us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:26.011819 (+    14us) write_op.cc:454] Released schema lock
0812 08:02:26.011824 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":87,"num_ops":1,"prepare.queue_time_us":443289,"prepare.run_cpu_time_us":702,"prepare.run_wall_time_us":74773,"replication_time_us":914144}]]}
I20260812 08:02:26.396296  4750 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:26.396453  4750 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:26.396850  4316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.31.239.129:34709 (request call id 3329) took 1238 ms. Trace:
I20260812 08:02:26.397017  4750 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:26.396944  4316 rpcz_store.cc:276] 0812 08:02:25.158105 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:25.158177 (+    72us) service_pool.cc:224] Handling call
0812 08:02:25.158340 (+   163us) raft_consensus.cc:1471] Updating replica for 2 ops
0812 08:02:25.158460 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 41
0812 08:02:25.158614 (+   154us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0812 08:02:25.158729 (+   115us) write_op.cc:270] Start()
0812 08:02:25.866914 (+708185us) write_op.cc:276] Timestamp: P: 1786521744549064 usec, L: 0
0812 08:02:25.867391 (+   477us) write_op.cc:270] Start()
0812 08:02:26.395599 (+528208us) write_op.cc:276] Timestamp: P: 1786521745022896 usec, L: 0
0812 08:02:26.396082 (+   483us) log.cc:844] Serialized 708 byte log entry
0812 08:02:26.396207 (+   125us) raft_consensus.cc:1645] Marking committed up to 41
0812 08:02:26.396213 (+     6us) raft_consensus.cc:1697] Filling consensus response to leader.
0812 08:02:26.396250 (+    37us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0812 08:02:26.396786 (+   536us) raft_consensus.cc:1685] finished
0812 08:02:26.396788 (+     2us) raft_consensus.cc:1691] UpdateReplicas() finished
0812 08:02:26.396832 (+    44us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:25.867358 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:25.867479 (+   121us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:25.867484 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:25.867485 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:25.867550 (+    65us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:25.867561 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:25.867563 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:25.867604 (+    41us) tablet.cc:701] Row locks acquired
0812 08:02:25.867604 (+     0us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0812 08:02:26.395973 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:26.396098 (+   125us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:26.396103 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:26.396105 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:26.396246 (+   141us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:26.396257 (+    11us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:26.396263 (+     6us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:26.396317 (+    54us) tablet.cc:701] Row locks acquired
0812 08:02:26.396318 (+     1us) write_op.cc:260] PREPARE: finished
Metrics: {"spinlock_wait_cycles":87808,"thread_start_us":70,"threads_started":1,"wal-append.queue_time_us":259,"child_traces":[["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":263,"prepare.run_cpu_time_us":334,"prepare.run_wall_time_us":334,"thread_start_us":100,"threads_started":1}],["op",{"num_ops":1,"partition_lock_wait_us":6,"prepare.queue_time_us":204,"prepare.run_cpu_time_us":415,"prepare.run_wall_time_us":414,"thread_start_us":105,"threads_started":1}]]}
I20260812 08:02:26.397425  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:26.397703  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:26.398229  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:26.398783  4750 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:26.465863  4841 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:26.466027  4841 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:26.466595  4841 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:26.466876  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:26.467011  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 43 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:26.467383  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:26.467547  4841 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:26.932255  4867 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:26.932433  4867 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:26.933043  4867 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:26.933403  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:26.933542  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:26.933982  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:26.934366  4867 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:26.934377  4869 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=42, attempt_no=0}) took 1009 ms. Trace:
I20260812 08:02:26.934438  4869 rpcz_store.cc:276] 0812 08:02:25.924575 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:25.924640 (+    65us) service_pool.cc:224] Handling call
0812 08:02:26.934347 (+1009707us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:25.925176 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:25.925285 (+   109us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:25.925287 (+     2us) write_op.cc:435] Acquired schema lock
0812 08:02:25.925288 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:25.925343 (+    55us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:25.925349 (+     6us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:25.925351 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:25.925382 (+    31us) tablet.cc:701] Row locks acquired
0812 08:02:25.925383 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:25.925412 (+    29us) write_op.cc:270] Start()
0812 08:02:26.897529 (+972117us) write_op.cc:276] Timestamp: P: 1786521745925369 usec, L: 0
0812 08:02:26.897532 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:26.897738 (+   206us) log.cc:844] Serialized 354 byte log entry
0812 08:02:26.933387 (+ 35649us) op_driver.cc:464] REPLICATION: finished
0812 08:02:26.933864 (+   477us) write_op.cc:301] APPLY: starting
0812 08:02:26.933884 (+    20us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:26.933917 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:26.933930 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:26.933989 (+    59us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:26.934022 (+    33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:26.934026 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:26.934169 (+   143us) log.cc:844] Serialized 43 byte log entry
0812 08:02:26.934234 (+    65us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:26.934247 (+    13us) write_op.cc:454] Released schema lock
0812 08:02:26.934253 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":288,"num_ops":1,"prepare.queue_time_us":203,"prepare.run_cpu_time_us":614,"prepare.run_wall_time_us":972669,"raft.queue_time_us":43,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":35821,"spinlock_wait_cycles":52608,"thread_start_us":215,"threads_started":2}]]}
I20260812 08:02:27.350631  4867 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:27.350816  4867 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.351464  4867 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:27.351833  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:27.351980  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:27.352442  4869 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:40354 (ReqId={client: b16b13de5e2c43f0b1e7b2797eb5dca9, seq_no=43, attempt_no=0}) took 1338 ms. Trace:
I20260812 08:02:27.352447  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:27.352701  4867 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:27.352525  4869 rpcz_store.cc:276] 0812 08:02:26.013654 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:26.013725 (+    71us) service_pool.cc:224] Handling call
0812 08:02:27.352427 (+1338702us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:26.897887 (+     0us) write_op.cc:183] PREPARE: starting on tablet fa5bc51157f040ff87e0fa8a13b54c6f
0812 08:02:26.898022 (+   135us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:26.898027 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:26.898029 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:26.898102 (+    73us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:26.898112 (+    10us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:26.898115 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:26.898182 (+    67us) tablet.cc:701] Row locks acquired
0812 08:02:26.898185 (+     3us) write_op.cc:260] PREPARE: finished
0812 08:02:26.898223 (+    38us) write_op.cc:270] Start()
0812 08:02:27.048369 (+150146us) write_op.cc:276] Timestamp: P: 1786521746898175 usec, L: 0
0812 08:02:27.048373 (+     4us) op_driver.cc:348] REPLICATION: starting
0812 08:02:27.048529 (+   156us) log.cc:844] Serialized 354 byte log entry
0812 08:02:27.351849 (+303320us) op_driver.cc:464] REPLICATION: finished
0812 08:02:27.351962 (+   113us) write_op.cc:301] APPLY: starting
0812 08:02:27.351980 (+    18us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:27.352013 (+    33us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:27.352029 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:27.352087 (+    58us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:27.352115 (+    28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:27.352119 (+     4us) write_op.cc:312] APPLY: finished
0812 08:02:27.352237 (+   118us) log.cc:844] Serialized 43 byte log entry
0812 08:02:27.352290 (+    53us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:27.352329 (+    39us) write_op.cc:454] Released schema lock
0812 08:02:27.352334 (+     5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":67,"num_ops":1,"prepare.queue_time_us":883675,"prepare.run_cpu_time_us":765,"prepare.run_wall_time_us":150821,"replication_time_us":303441}]]}
I20260812 08:02:27.421139  4141 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:02:27.421257  4296 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:27.509610  4841 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:27.509778  4841 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.510699  4841 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:27.511366  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:27.511552  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 44 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:27.512212  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066; no voters: 76f4cbd15ed14152b5c24635ba16d531, f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:27.512935  4441 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:27.920657  4841 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 3a36ee989d9c4b54a17003b9655b8731 | 127.31.239.190:34449 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                                   Value                                                                                                    |      Tags       |         Master
----------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                                        | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                                        | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                                       | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                                          | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                                       | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                                       | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                                         | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                                        | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:32803 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 6444d0e8ad5e4ff1afc7dfefdea88066 | 127.31.239.131:33391 | HEALTHY | <none>   |       0        |       0
 76f4cbd15ed14152b5c24635ba16d531 | 127.31.239.129:39139 | HEALTHY | <none>   |       1        |       0
 f91d6f49e46b4b379bf45b98bb7b2b77 | 127.31.239.130:38555 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       3

Unusual flags for Tablet Server:
                 Flag                 |                                                                                                 Value                                                                                                  |      Tags       |      Tablet Server
--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 inject_latency_ms_before_starting_op | 1000                                                                                                                                                                                                   | hidden,advanced | all 3 server(s) checked
 ipki_server_key_size                 | 768                                                                                                                                                                                                    | experimental    | all 3 server(s) checked
 local_ip_for_outbound_sockets        | 127.31.239.129                                                                                                                                                                                         | experimental    | 127.31.239.129:39139
 local_ip_for_outbound_sockets        | 127.31.239.130                                                                                                                                                                                         | experimental    | 127.31.239.130:38555
 local_ip_for_outbound_sockets        | 127.31.239.131                                                                                                                                                                                         | experimental    | 127.31.239.131:33391
 never_fsync                          | true                                                                                                                                                                                                   | unsafe,advanced | all 3 server(s) checked
 openssl_security_level_override      | 0                                                                                                                                                                                                      | unsafe,hidden   | all 3 server(s) checked
 rpc_server_allow_ephemeral_ports     | true                                                                                                                                                                                                   | unsafe          | all 3 server(s) checked
 server_dump_info_format              | pb                                                                                                                                                                                                     | hidden          | all 3 server(s) checked
 server_dump_info_path                | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:39139
 server_dump_info_path                | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:38555
 server_dump_info_path                | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:33391

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:32803 | all 3 server(s) checked
 time_source         | builtin              | all 3 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 4 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
     Name      | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
---------------+----+---------+---------------+---------+------------+------------------+-------------
 test-workload | 3  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 3
 Tables         | 1
 Tablets        | 1
 Replicas       | 3

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:02:27.945545 32702 log_verifier.cc:126] Checking tablet fa5bc51157f040ff87e0fa8a13b54c6f
I20260812 08:02:27.951439  4907 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:27.951646  4907 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.952236  4841 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:27.952378  4841 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.952615  4907 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:27.952859  4841 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:27.952865  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:27.953099  4462 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d6f49e46b4b379bf45b98bb7b2b77 in term 1.
I20260812 08:02:27.953313  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" is_pre_election: true
I20260812 08:02:27.953433  4315 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6444d0e8ad5e4ff1afc7dfefdea88066 in term 1.
I20260812 08:02:27.953434  4243 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066, f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 
I20260812 08:02:27.953715  4907 raft_consensus.cc:2804] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:27.953770  4391 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066, f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 
I20260812 08:02:27.953822  4907 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:27.953871  4907 raft_consensus.cc:3060] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:27.953959  4841 raft_consensus.cc:2804] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:27.954049  4841 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 76f4cbd15ed14152b5c24635ba16d531)
I20260812 08:02:27.954146  4841 raft_consensus.cc:3060] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:27.954864  4907 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.955418  4841 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.955521  4907 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 election: Requested vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:27.955578  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066"
I20260812 08:02:27.955711  4462 raft_consensus.cc:2393] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f91d6f49e46b4b379bf45b98bb7b2b77 in current term 2: Already voted for candidate 6444d0e8ad5e4ff1afc7dfefdea88066 in this term.
I20260812 08:02:27.955883  4841 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 election: Requested vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), f91d6f49e46b4b379bf45b98bb7b2b77 (127.31.239.130:38555)
I20260812 08:02:27.956261  4315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77"
I20260812 08:02:27.956426  4315 raft_consensus.cc:2393] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6444d0e8ad5e4ff1afc7dfefdea88066 in current term 2: Already voted for candidate f91d6f49e46b4b379bf45b98bb7b2b77 in this term.
W20260812 08:02:27.960489  4246 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.31.239.129:39139 timed out after 0.008s (SENT)
I20260812 08:02:27.960922  4315 raft_consensus.cc:1240] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Rejecting Update request from peer 76f4cbd15ed14152b5c24635ba16d531 for earlier term 1. Current term is 2. Ops: []
I20260812 08:02:27.961642  4905 consensus_queue.cc:1059] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 }, Status: INVALID_TERM, Last received: 1.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260812 08:02:27.961946  4905 raft_consensus.cc:3055] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:27.962013  4905 raft_consensus.cc:740] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 76f4cbd15ed14152b5c24635ba16d531, State: Running, Role: LEADER
I20260812 08:02:27.962283  4905 consensus_queue.cc:260] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 1.45, Last appended by leader: 45, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.962604  4905 raft_consensus.cc:3060] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:27.962666  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:27.962947  4164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531"
I20260812 08:02:27.963316  4161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
W20260812 08:02:27.963860  4091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:27.963996  4161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531"
I20260812 08:02:27.963879  4163 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f91d6f49e46b4b379bf45b98bb7b2b77 in term 2.
I20260812 08:02:27.964337  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:27.964552  4907 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 08:02:27.965097  4462 raft_consensus.cc:1240] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 2 FOLLOWER]: Rejecting Update request from peer 76f4cbd15ed14152b5c24635ba16d531 for earlier term 1. Current term is 2. Ops: []
I20260812 08:02:27.965306  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
W20260812 08:02:27.965343  4091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:27.965408  4163 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6444d0e8ad5e4ff1afc7dfefdea88066 in term 2.
I20260812 08:02:27.965593  4161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" candidate_term: 2 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531"
I20260812 08:02:27.966957  4161 raft_consensus.cc:2468] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6444d0e8ad5e4ff1afc7dfefdea88066 in term 2.
I20260812 08:02:27.967314  4390 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531; no voters: f91d6f49e46b4b379bf45b98bb7b2b77
I20260812 08:02:27.967545  4841 raft_consensus.cc:2804] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:27.967787  4841 raft_consensus.cc:697] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [term 2 LEADER]: Becoming Leader. State: Replica: 6444d0e8ad5e4ff1afc7dfefdea88066, State: Running, Role: LEADER
I20260812 08:02:27.968168  4841 consensus_queue.cc:237] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 1.45, Last appended by leader: 45, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.970939  4161 raft_consensus.cc:1275] T fa5bc51157f040ff87e0fa8a13b54c6f P 76f4cbd15ed14152b5c24635ba16d531 [term 2 FOLLOWER]: Refusing update from remote peer 6444d0e8ad5e4ff1afc7dfefdea88066: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 2 index: 46. (index mismatch)
I20260812 08:02:27.971081  3996 catalog_manager.cc:5719] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 reported cstate change: term changed from 1 to 2, leader changed from 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129) to 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131). New cstate: current_term: 2 leader_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:27.971176  4315 raft_consensus.cc:1275] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Refusing update from remote peer 6444d0e8ad5e4ff1afc7dfefdea88066: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 2 index: 46. (index mismatch)
I20260812 08:02:27.971961  4841 consensus_queue.cc:1048] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260812 08:02:27.972091  4907 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:27.972215  4907 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:27.972368  4841 consensus_queue.cc:1048] T fa5bc51157f040ff87e0fa8a13b54c6f P 6444d0e8ad5e4ff1afc7dfefdea88066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260812 08:02:27.972695  4907 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:27.973522  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 3 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:27.974814  4161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 3 candidate_status { last_received { term: 1 index: 45 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:27.975250  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:27.976565  4907 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:02:28.013717 32702 log_verifier.cc:177] Verified matching terms for 46 ops in tablet fa5bc51157f040ff87e0fa8a13b54c6f
I20260812 08:02:28.055841  4907 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6444d0e8ad5e4ff1afc7dfefdea88066)
I20260812 08:02:28.056013  4907 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:28.056535  4907 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:28.057365  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 46 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
I20260812 08:02:28.058058  4163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 46 } } ignore_live_leader: false dest_uuid: "76f4cbd15ed14152b5c24635ba16d531" is_pre_election: true
I20260812 08:02:28.058625  4246 leader_election.cc:304] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f91d6f49e46b4b379bf45b98bb7b2b77; no voters: 6444d0e8ad5e4ff1afc7dfefdea88066, 76f4cbd15ed14152b5c24635ba16d531
I20260812 08:02:28.058995  4907 raft_consensus.cc:2749] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:02:28.060246 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 4068
I20260812 08:02:28.066856  4907 raft_consensus.cc:493] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6444d0e8ad5e4ff1afc7dfefdea88066)
I20260812 08:02:28.067001  4907 raft_consensus.cc:515] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f4cbd15ed14152b5c24635ba16d531" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 39139 } } peers { permanent_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 38555 } } peers { permanent_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 33391 } }
I20260812 08:02:28.067591  4907 leader_election.cc:290] T fa5bc51157f040ff87e0fa8a13b54c6f P f91d6f49e46b4b379bf45b98bb7b2b77 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 76f4cbd15ed14152b5c24635ba16d531 (127.31.239.129:39139), 6444d0e8ad5e4ff1afc7dfefdea88066 (127.31.239.131:33391)
I20260812 08:02:28.069648  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa5bc51157f040ff87e0fa8a13b54c6f" candidate_uuid: "f91d6f49e46b4b379bf45b98bb7b2b77" candidate_term: 3 candidate_status { last_received { term: 2 index: 46 } } ignore_live_leader: false dest_uuid: "6444d0e8ad5e4ff1afc7dfefdea88066" is_pre_election: true
W20260812 08:02:28.076229  4246 connection.cc:573] client connection to 127.31.239.129:39139 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:28.076982 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 4223
W20260812 08:02:28.079248  4390 connection.cc:573] client connection to 127.31.239.129:39139 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:28.079399  4390 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
W20260812 08:02:28.091171  4391 connection.cc:573] client connection to 127.31.239.130:38555 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:28.091615 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 4371
I20260812 08:02:28.105512 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 3964
2026-08-12T08:02:28Z chronyd exiting
[       OK ] RaftConsensusElectionITest.ChurnyElectionsWithDuplicateKeys (32512 ms)
[ RUN      ] RaftConsensusElectionITest.AutomaticLeaderElection
I20260812 08:02:28.136654 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:28.136716 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:28.136737 32702 ts_itest-base.cc:117] 5 tablet servers
I20260812 08:02:28.136749 32702 ts_itest-base.cc:118] 5 replicas per TS
I20260812 08:02:28.136759 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:28Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:28Z Disabled control of system clock
I20260812 08:02:28.147570 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:37915
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:37915 with env {}
W20260812 08:02:28.260159  4937 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:28.260426  4937 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:28.260468  4937 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:28.264086  4937 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:28.264163  4937 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:28.264184  4937 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:28.264202  4937 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:28.268410  4937 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:37915
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:37915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.4937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:28.269600  4937 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:28.270812  4937 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:28.277398  4948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:28.277400  4945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:28.277398  4944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:28.277474  4937 server_base.cc:1061] running on GCE node
I20260812 08:02:28.278281  4937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:28.279356  4937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:28.280558  4937 hybrid_clock.cc:648] HybridClock initialized: now 1786521748280549 us; error 43 us; skew 500 ppm
I20260812 08:02:28.282711  4937 webserver.cc:533] Webserver started at http://127.31.239.190:36217/ using document root <none> and password file <none>
I20260812 08:02:28.283385  4937 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:28.283495  4937 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:28.283695  4937 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:28.285323  4937 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "dce4946d8c5f45658d977e102896a10d"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.285789  4937 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "dce4946d8c5f45658d977e102896a10d"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.289487  4937 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:02:28.292044  4954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.293378  4937 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:02:28.293556  4937 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "dce4946d8c5f45658d977e102896a10d"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.293684  4937 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:28.310052  4937 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:28.310998  4937 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:28.311242  4937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:28.320406  4937 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:37915
I20260812 08:02:28.320406  5011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:37915 every 8 connection(s)
I20260812 08:02:28.321697  4937 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:28.324506 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 4937
I20260812 08:02:28.324697 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:28.325524  5012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:28.332412  5012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d: Bootstrap starting.
I20260812 08:02:28.335345  5012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:28.336182  5012 log.cc:826] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:28.338392  5012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d: No bootstrap required, opened a new log
I20260812 08:02:28.341368  5012 raft_consensus.cc:359] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce4946d8c5f45658d977e102896a10d" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37915 } }
I20260812 08:02:28.341599  5012 raft_consensus.cc:385] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:28.341637  5012 raft_consensus.cc:740] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dce4946d8c5f45658d977e102896a10d, State: Initialized, Role: FOLLOWER
I20260812 08:02:28.342221  5012 consensus_queue.cc:260] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce4946d8c5f45658d977e102896a10d" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37915 } }
I20260812 08:02:28.342401  5012 raft_consensus.cc:399] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:28.342485  5012 raft_consensus.cc:493] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:28.342612  5012 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:28.343706  5012 raft_consensus.cc:515] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce4946d8c5f45658d977e102896a10d" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37915 } }
I20260812 08:02:28.344173  5012 leader_election.cc:304] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dce4946d8c5f45658d977e102896a10d; no voters: 
I20260812 08:02:28.344578  5012 leader_election.cc:290] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:28.344720  5017 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:28.344996  5017 raft_consensus.cc:697] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [term 1 LEADER]: Becoming Leader. State: Replica: dce4946d8c5f45658d977e102896a10d, State: Running, Role: LEADER
I20260812 08:02:28.345353  5017 consensus_queue.cc:237] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce4946d8c5f45658d977e102896a10d" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37915 } }
I20260812 08:02:28.345904  5012 sys_catalog.cc:565] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:28.347106  5019 sys_catalog.cc:455] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dce4946d8c5f45658d977e102896a10d. Latest consensus state: current_term: 1 leader_uuid: "dce4946d8c5f45658d977e102896a10d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce4946d8c5f45658d977e102896a10d" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37915 } } }
I20260812 08:02:28.347419  5019 sys_catalog.cc:458] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:28.347389  5018 sys_catalog.cc:455] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dce4946d8c5f45658d977e102896a10d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce4946d8c5f45658d977e102896a10d" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 37915 } } }
I20260812 08:02:28.347487  5018 sys_catalog.cc:458] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:28.348815  5027 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:28.352324  5027 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:28.358443  5027 catalog_manager.cc:1383] Generated new cluster ID: a807f85a1b994025b56e4e1f9c0c1ee9
I20260812 08:02:28.358582  5027 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:28.375734  5027 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:28.376677  5027 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:28.384289  5027 catalog_manager.cc:6092] T 00000000000000000000000000000000 P dce4946d8c5f45658d977e102896a10d: Generated new TSK 0
I20260812 08:02:28.385006  5027 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:28.398774 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--builtin_ntp_servers=127.31.239.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
W20260812 08:02:28.516183  5039 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:28.516415  5039 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:28.516461  5039 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:28.520819  5039 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:28.520963  5039 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:28.525323  5039 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--never_fsync=true
--heap_profile_path=/tmp/kudu.5039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:28.526645  5039 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:28.527791  5039 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:28.534808  5046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:28.534811  5050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:28.534888  5047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:28.535151  5039 server_base.cc:1061] running on GCE node
I20260812 08:02:28.535528  5039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:28.536115  5039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:28.537297  5039 hybrid_clock.cc:648] HybridClock initialized: now 1786521748537287 us; error 27 us; skew 500 ppm
I20260812 08:02:28.539180  5039 webserver.cc:533] Webserver started at http://127.31.239.129:33215/ using document root <none> and password file <none>
I20260812 08:02:28.539808  5039 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:28.539901  5039 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:28.540136  5039 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:28.541694  5039 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "d9fd97ec87df4aa3a9fcabd782129a93"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.542253  5039 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "d9fd97ec87df4aa3a9fcabd782129a93"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.545800  5039 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:02:28.548300  5056 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.549330  5039 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:28.549466  5039 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "d9fd97ec87df4aa3a9fcabd782129a93"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.549575  5039 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:28.597496  5039 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:28.598335  5039 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:28.598546  5039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:28.599229  5039 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:28.600195  5039 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:28.600252  5039 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.600291  5039 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:28.600307  5039 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.610219  5039 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:38309
I20260812 08:02:28.610235  5182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:38309 every 8 connection(s)
I20260812 08:02:28.611275  5039 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:28.617425 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 5039
I20260812 08:02:28.617590 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:28.620151 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--builtin_ntp_servers=127.31.239.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260812 08:02:28.620155  5183 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37915
I20260812 08:02:28.620422  5183 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:28.620954  5183 heartbeater.cc:507] Master 127.31.239.190:37915 requested a full tablet report, sending...
I20260812 08:02:28.622524  4971 ts_manager.cc:194] Registered new tserver with Master: d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309)
I20260812 08:02:28.623719  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:42139
W20260812 08:02:28.733078  5186 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:28.733379  5186 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:28.733462  5186 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:28.737291  5186 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:28.737486  5186 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:28.741576  5186 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--never_fsync=true
--heap_profile_path=/tmp/kudu.5186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:28.742889  5186 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:28.744086  5186 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:28.750865  5192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:28.750952  5186 server_base.cc:1061] running on GCE node
W20260812 08:02:28.750891  5196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:28.750865  5194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:28.751565  5186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:28.752144  5186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:28.753331  5186 hybrid_clock.cc:648] HybridClock initialized: now 1786521748753313 us; error 42 us; skew 500 ppm
I20260812 08:02:28.755326  5186 webserver.cc:533] Webserver started at http://127.31.239.130:45707/ using document root <none> and password file <none>
I20260812 08:02:28.755945  5186 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:28.756034  5186 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:28.756282  5186 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:28.757938  5186 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "eab02bd9929045c98cf8847fc13be150"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.758510  5186 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "eab02bd9929045c98cf8847fc13be150"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.762053  5186 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.003s
I20260812 08:02:28.764417  5203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.765424  5186 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:28.765565  5186 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "eab02bd9929045c98cf8847fc13be150"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.765686  5186 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:28.782850  5186 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:28.783604  5186 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:28.783846  5186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:28.784468  5186 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:28.785555  5186 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:28.785632  5186 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.785715  5186 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:28.785753  5186 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.796032  5186 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:45057
I20260812 08:02:28.796060  5334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:45057 every 8 connection(s)
I20260812 08:02:28.797117  5186 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:28.797386 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 5186
I20260812 08:02:28.797513 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:02:28.800309 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--builtin_ntp_servers=127.31.239.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260812 08:02:28.807062  5335 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37915
I20260812 08:02:28.807360  5335 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:28.807969  5335 heartbeater.cc:507] Master 127.31.239.190:37915 requested a full tablet report, sending...
I20260812 08:02:28.809170  4971 ts_manager.cc:194] Registered new tserver with Master: eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057)
I20260812 08:02:28.809830  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:54443
W20260812 08:02:28.917575  5338 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:28.917814  5338 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:28.917860  5338 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:28.921523  5338 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:28.921657  5338 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:02:28.925792  5338 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--never_fsync=true
--heap_profile_path=/tmp/kudu.5338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:28.927062  5338 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:28.928308  5338 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:28.935501  5345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:28.935526  5347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:28.935716  5338 server_base.cc:1061] running on GCE node
W20260812 08:02:28.935523  5344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:28.936208  5338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:28.937117  5338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:28.938300  5338 hybrid_clock.cc:648] HybridClock initialized: now 1786521748938276 us; error 38 us; skew 500 ppm
I20260812 08:02:28.940163  5338 webserver.cc:533] Webserver started at http://127.31.239.131:42775/ using document root <none> and password file <none>
I20260812 08:02:28.940760  5338 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:28.940846  5338 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:28.941073  5338 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:28.942773  5338 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "299a5b6829884aba886935181e35f495"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.943289  5338 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "299a5b6829884aba886935181e35f495"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.946767  5338 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:28.949363  5353 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.950552  5338 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:28.950695  5338 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "299a5b6829884aba886935181e35f495"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:28.950804  5338 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:28.969348  5338 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:28.970257  5338 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:28.970471  5338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:28.971108  5338 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:28.972174  5338 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:28.972224  5338 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.972294  5338 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:28.972332  5338 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:28.982666  5338 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:40159
I20260812 08:02:28.982744  5483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:40159 every 8 connection(s)
I20260812 08:02:28.983762  5338 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:02:28.987973 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 5338
I20260812 08:02:28.988112 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:02:28.990633 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.132:0
--local_ip_for_outbound_sockets=127.31.239.132
--webserver_interface=127.31.239.132
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--builtin_ntp_servers=127.31.239.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260812 08:02:28.992921  5484 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37915
I20260812 08:02:28.993185  5484 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:28.993737  5484 heartbeater.cc:507] Master 127.31.239.190:37915 requested a full tablet report, sending...
I20260812 08:02:28.994880  4971 ts_manager.cc:194] Registered new tserver with Master: 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:28.995538  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:50777
W20260812 08:02:29.101231  5487 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:29.101470  5487 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:29.101517  5487 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:29.105136  5487 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:29.105276  5487 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.132
I20260812 08:02:29.109279  5487 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.31.239.132
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--never_fsync=true
--heap_profile_path=/tmp/kudu.5487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:29.110560  5487 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:29.111744  5487 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:29.118602  5494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:29.118719  5487 server_base.cc:1061] running on GCE node
W20260812 08:02:29.118577  5492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:29.118572  5496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:29.119325  5487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:29.119939  5487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:29.121140  5487 hybrid_clock.cc:648] HybridClock initialized: now 1786521749121095 us; error 45 us; skew 500 ppm
I20260812 08:02:29.123302  5487 webserver.cc:533] Webserver started at http://127.31.239.132:35987/ using document root <none> and password file <none>
I20260812 08:02:29.124033  5487 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:29.124104  5487 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:29.124342  5487 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:29.125939  5487 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "147b0e8e9d7543c5aa67a366ea229238"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-9jjr"
I20260812 08:02:29.126500  5487 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "147b0e8e9d7543c5aa67a366ea229238"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-9jjr"
I20260812 08:02:29.129992  5487 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:29.132421  5502 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.133445  5487 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:29.133601  5487 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "147b0e8e9d7543c5aa67a366ea229238"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-9jjr"
I20260812 08:02:29.133720  5487 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:29.152021  5487 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:29.152774  5487 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:29.152987  5487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:29.153587  5487 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:29.154769  5487 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:29.154842  5487 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.154917  5487 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:29.154969  5487 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.166065  5487 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.132:38687
I20260812 08:02:29.166227  5636 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.132:38687 every 8 connection(s)
I20260812 08:02:29.167172  5487 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260812 08:02:29.169303 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 5487
I20260812 08:02:29.169435 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260812 08:02:29.172145 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.133:0
--local_ip_for_outbound_sockets=127.31.239.133
--webserver_interface=127.31.239.133
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--builtin_ntp_servers=127.31.239.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260812 08:02:29.177095  5638 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37915
I20260812 08:02:29.177426  5638 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:29.178259  5638 heartbeater.cc:507] Master 127.31.239.190:37915 requested a full tablet report, sending...
I20260812 08:02:29.179698  4971 ts_manager.cc:194] Registered new tserver with Master: 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687)
I20260812 08:02:29.180552  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.132:51439
W20260812 08:02:29.285516  5642 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:29.285754  5642 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:29.285799  5642 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:29.289305  5642 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:29.289439  5642 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.133
I20260812 08:02:29.293598  5642 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.31.239.133
--webserver_port=0
--tserver_master_addrs=127.31.239.190:37915
--never_fsync=true
--heap_profile_path=/tmp/kudu.5642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.133

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:29.294883  5642 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:29.296140  5642 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:29.302863  5647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:29.302917  5642 server_base.cc:1061] running on GCE node
W20260812 08:02:29.302891  5648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:29.302863  5650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:29.303503  5642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:29.304150  5642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:29.305346  5642 hybrid_clock.cc:648] HybridClock initialized: now 1786521749305324 us; error 37 us; skew 500 ppm
I20260812 08:02:29.307377  5642 webserver.cc:533] Webserver started at http://127.31.239.133:45847/ using document root <none> and password file <none>
I20260812 08:02:29.307996  5642 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:29.308082  5642 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:29.308347  5642 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:29.310002  5642 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "67a8770af8ec430d98c29597a24e595f"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-9jjr"
I20260812 08:02:29.310593  5642 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "67a8770af8ec430d98c29597a24e595f"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-9jjr"
I20260812 08:02:29.314112  5642 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:29.316558  5657 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.317783  5642 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:29.317929  5642 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "67a8770af8ec430d98c29597a24e595f"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-9jjr"
I20260812 08:02:29.318042  5642 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:29.336289  5642 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:29.337232  5642 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:29.337443  5642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:29.338049  5642 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:29.339202  5642 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:29.339284  5642 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.339361  5642 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:29.339404  5642 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:29.353075  5642 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.133:44305
I20260812 08:02:29.353111  5783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.133:44305 every 8 connection(s)
I20260812 08:02:29.354368  5642 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260812 08:02:29.361124 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 5642
I20260812 08:02:29.361310 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260812 08:02:29.364178  5785 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37915
I20260812 08:02:29.364441  5785 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:29.364949  5785 heartbeater.cc:507] Master 127.31.239.190:37915 requested a full tablet report, sending...
I20260812 08:02:29.366003  4971 ts_manager.cc:194] Registered new tserver with Master: 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305)
I20260812 08:02:29.366645  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.133:43983
I20260812 08:02:29.376343 32702 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260812 08:02:29.386428  4971 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38024:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
W20260812 08:02:29.388873  4971 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260812 08:02:29.407811  5558 tablet_service.cc:1511] Processing CreateTablet for tablet 360d8d2470484289a921033e1ebb6135 (DEFAULT_TABLE table=TestTable [id=e7951843a25649709ee9d0bd222f6396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:29.408092  5257 tablet_service.cc:1511] Processing CreateTablet for tablet 360d8d2470484289a921033e1ebb6135 (DEFAULT_TABLE table=TestTable [id=e7951843a25649709ee9d0bd222f6396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:29.408474  5715 tablet_service.cc:1511] Processing CreateTablet for tablet 360d8d2470484289a921033e1ebb6135 (DEFAULT_TABLE table=TestTable [id=e7951843a25649709ee9d0bd222f6396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:29.408902  5558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d8d2470484289a921033e1ebb6135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:29.409009  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d8d2470484289a921033e1ebb6135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:29.409296  5715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d8d2470484289a921033e1ebb6135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:29.412920  5405 tablet_service.cc:1511] Processing CreateTablet for tablet 360d8d2470484289a921033e1ebb6135 (DEFAULT_TABLE table=TestTable [id=e7951843a25649709ee9d0bd222f6396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:29.413864  5405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d8d2470484289a921033e1ebb6135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:29.415598  5107 tablet_service.cc:1511] Processing CreateTablet for tablet 360d8d2470484289a921033e1ebb6135 (DEFAULT_TABLE table=TestTable [id=e7951843a25649709ee9d0bd222f6396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:29.416477  5107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360d8d2470484289a921033e1ebb6135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:29.420331  5810 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495: Bootstrap starting.
I20260812 08:02:29.421186  5809 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f: Bootstrap starting.
I20260812 08:02:29.421808  5811 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Bootstrap starting.
I20260812 08:02:29.422448  5812 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93: Bootstrap starting.
I20260812 08:02:29.422974  5810 tablet_bootstrap.cc:654] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:29.423623  5808 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Bootstrap starting.
I20260812 08:02:29.423995  5811 tablet_bootstrap.cc:654] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:29.424053  5810 log.cc:826] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:29.424837  5811 log.cc:826] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:29.425922  5808 tablet_bootstrap.cc:654] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:29.425944  5810 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495: No bootstrap required, opened a new log
I20260812 08:02:29.426047  5812 tablet_bootstrap.cc:654] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:29.426162  5810 ts_tablet_manager.cc:1403] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:29.426783  5811 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: No bootstrap required, opened a new log
I20260812 08:02:29.426784  5808 log.cc:826] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:29.426990  5811 ts_tablet_manager.cc:1403] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:29.427093  5812 log.cc:826] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:29.427513  5809 tablet_bootstrap.cc:654] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:29.428325  5809 log.cc:826] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:29.429762  5811 raft_consensus.cc:359] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.429782  5810 raft_consensus.cc:359] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.429983  5810 raft_consensus.cc:385] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:29.429984  5811 raft_consensus.cc:385] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:29.430045  5810 raft_consensus.cc:740] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299a5b6829884aba886935181e35f495, State: Initialized, Role: FOLLOWER
I20260812 08:02:29.430049  5811 raft_consensus.cc:740] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eab02bd9929045c98cf8847fc13be150, State: Initialized, Role: FOLLOWER
I20260812 08:02:29.430290  5809 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f: No bootstrap required, opened a new log
I20260812 08:02:29.430483  5809 ts_tablet_manager.cc:1403] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f: Time spent bootstrapping tablet: real 0.009s	user 0.005s	sys 0.000s
I20260812 08:02:29.430538  5810 consensus_queue.cc:260] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.430542  5811 consensus_queue.cc:260] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.431273  5484 heartbeater.cc:499] Master 127.31.239.190:37915 was elected leader, sending a full tablet report...
I20260812 08:02:29.431468  5811 ts_tablet_manager.cc:1434] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:29.432169  5335 heartbeater.cc:499] Master 127.31.239.190:37915 was elected leader, sending a full tablet report...
I20260812 08:02:29.433419  5810 ts_tablet_manager.cc:1434] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260812 08:02:29.433656  5809 raft_consensus.cc:359] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.433925  5809 raft_consensus.cc:385] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:29.433988  5809 raft_consensus.cc:740] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67a8770af8ec430d98c29597a24e595f, State: Initialized, Role: FOLLOWER
I20260812 08:02:29.434515  5809 consensus_queue.cc:260] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.435469  5809 ts_tablet_manager.cc:1434] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:29.435609  5812 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93: No bootstrap required, opened a new log
I20260812 08:02:29.435855  5812 ts_tablet_manager.cc:1403] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.000s
I20260812 08:02:29.437016  5808 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: No bootstrap required, opened a new log
I20260812 08:02:29.437288  5808 ts_tablet_manager.cc:1403] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Time spent bootstrapping tablet: real 0.014s	user 0.000s	sys 0.004s
I20260812 08:02:29.438426  5785 heartbeater.cc:499] Master 127.31.239.190:37915 was elected leader, sending a full tablet report...
I20260812 08:02:29.439050  5812 raft_consensus.cc:359] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.439281  5812 raft_consensus.cc:385] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:29.439352  5812 raft_consensus.cc:740] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9fd97ec87df4aa3a9fcabd782129a93, State: Initialized, Role: FOLLOWER
I20260812 08:02:29.439860  5812 consensus_queue.cc:260] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.440462  5808 raft_consensus.cc:359] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.440681  5808 raft_consensus.cc:385] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:29.440752  5808 raft_consensus.cc:740] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147b0e8e9d7543c5aa67a366ea229238, State: Initialized, Role: FOLLOWER
I20260812 08:02:29.440889  5812 ts_tablet_manager.cc:1434] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:02:29.441130  5183 heartbeater.cc:499] Master 127.31.239.190:37915 was elected leader, sending a full tablet report...
I20260812 08:02:29.441192  5808 consensus_queue.cc:260] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.442044  5808 ts_tablet_manager.cc:1434] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260812 08:02:29.442534  5638 heartbeater.cc:499] Master 127.31.239.190:37915 was elected leader, sending a full tablet report...
I20260812 08:02:29.484969  5828 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 08:02:29.485069  5485 tablet.cc:2406] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:29.485240  5828 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.486814  5828 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:29.492726  5585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "eab02bd9929045c98cf8847fc13be150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147b0e8e9d7543c5aa67a366ea229238" is_pre_election: true
I20260812 08:02:29.493083  5585 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eab02bd9929045c98cf8847fc13be150 in term 0.
I20260812 08:02:29.493085  5426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "eab02bd9929045c98cf8847fc13be150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495" is_pre_election: true
I20260812 08:02:29.493084  5734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "eab02bd9929045c98cf8847fc13be150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67a8770af8ec430d98c29597a24e595f" is_pre_election: true
I20260812 08:02:29.493247  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "eab02bd9929045c98cf8847fc13be150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" is_pre_election: true
I20260812 08:02:29.493328  5426 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eab02bd9929045c98cf8847fc13be150 in term 0.
I20260812 08:02:29.493391  5734 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eab02bd9929045c98cf8847fc13be150 in term 0.
I20260812 08:02:29.493466  5130 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eab02bd9929045c98cf8847fc13be150 in term 0.
I20260812 08:02:29.493854  5205 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 147b0e8e9d7543c5aa67a366ea229238, 299a5b6829884aba886935181e35f495, eab02bd9929045c98cf8847fc13be150; no voters: 
I20260812 08:02:29.494202  5828 raft_consensus.cc:2804] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:29.494306  5828 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:29.494367  5828 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:29.495296  5828 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.495857  5828 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [CANDIDATE]: Term 1 election: Requested vote from peers 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:29.496156  5734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "eab02bd9929045c98cf8847fc13be150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67a8770af8ec430d98c29597a24e595f"
I20260812 08:02:29.496263  5585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "eab02bd9929045c98cf8847fc13be150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147b0e8e9d7543c5aa67a366ea229238"
I20260812 08:02:29.496299  5734 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:29.496290  5426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "eab02bd9929045c98cf8847fc13be150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495"
I20260812 08:02:29.496385  5585 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:29.496407  5426 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:29.496397  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "eab02bd9929045c98cf8847fc13be150" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93"
I20260812 08:02:29.496556  5130 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:29.497792  5426 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eab02bd9929045c98cf8847fc13be150 in term 1.
I20260812 08:02:29.497993  5130 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eab02bd9929045c98cf8847fc13be150 in term 1.
I20260812 08:02:29.498221  5734 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eab02bd9929045c98cf8847fc13be150 in term 1.
I20260812 08:02:29.498481  5585 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eab02bd9929045c98cf8847fc13be150 in term 1.
I20260812 08:02:29.498473  5208 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 299a5b6829884aba886935181e35f495, d9fd97ec87df4aa3a9fcabd782129a93, eab02bd9929045c98cf8847fc13be150; no voters: 
I20260812 08:02:29.498696  5828 raft_consensus.cc:2804] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:29.498984  5828 raft_consensus.cc:697] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 1 LEADER]: Becoming Leader. State: Replica: eab02bd9929045c98cf8847fc13be150, State: Running, Role: LEADER
I20260812 08:02:29.499316  5828 consensus_queue.cc:237] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:29.503234  4971 catalog_manager.cc:5719] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 reported cstate change: term changed from 0 to 1, leader changed from <none> to eab02bd9929045c98cf8847fc13be150 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "eab02bd9929045c98cf8847fc13be150" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:29.529259 32702 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260812 08:02:29.530946 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver d9fd97ec87df4aa3a9fcabd782129a93 to finish bootstrapping
I20260812 08:02:29.537297 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver eab02bd9929045c98cf8847fc13be150 to finish bootstrapping
I20260812 08:02:29.542779 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 299a5b6829884aba886935181e35f495 to finish bootstrapping
I20260812 08:02:29.548280 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 147b0e8e9d7543c5aa67a366ea229238 to finish bootstrapping
W20260812 08:02:29.548656  5336 tablet.cc:2406] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:29.553257 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 67a8770af8ec430d98c29597a24e595f to finish bootstrapping
I20260812 08:02:29.564690 32702 raft_consensus_election-itest.cc:400] Writing data to leader of 5-node config (5 alive)...
I20260812 08:02:29.580402  5585 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 1 FOLLOWER]: Refusing update from remote peer eab02bd9929045c98cf8847fc13be150: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:29.580402  5734 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 1 FOLLOWER]: Refusing update from remote peer eab02bd9929045c98cf8847fc13be150: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:29.580402  5426 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 1 FOLLOWER]: Refusing update from remote peer eab02bd9929045c98cf8847fc13be150: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:29.580402  5130 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 1 FOLLOWER]: Refusing update from remote peer eab02bd9929045c98cf8847fc13be150: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:29.581138  5837 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:29.581305  5844 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:29.581442  5828 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:29.581667  5845 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [LEADER]: Connected to new peer: Peer: permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:29.592103  5849 mvcc.cc:204] Tried to move back new op lower bound from 7317593086273024000 to 7317593085953318912. Current Snapshot: MvccSnapshot[applied={T|T < 7317593086273024000}]
I20260812 08:02:29.593247  5843 mvcc.cc:204] Tried to move back new op lower bound from 7317593086273024000 to 7317593085953318912. Current Snapshot: MvccSnapshot[applied={T|T < 7317593086273024000}]
I20260812 08:02:29.593696  5846 mvcc.cc:204] Tried to move back new op lower bound from 7317593086273024000 to 7317593085953318912. Current Snapshot: MvccSnapshot[applied={T|T < 7317593086273024000}]
I20260812 08:02:29.595279  5850 mvcc.cc:204] Tried to move back new op lower bound from 7317593086273024000 to 7317593085953318912. Current Snapshot: MvccSnapshot[applied={T|T < 7317593086273024000}]
I20260812 08:02:29.595455  5848 mvcc.cc:204] Tried to move back new op lower bound from 7317593086273024000 to 7317593085953318912. Current Snapshot: MvccSnapshot[applied={T|T < 7317593086273024000}]
I20260812 08:02:29.625757 32702 raft_consensus_election-itest.cc:411] Killing current leader eab02bd9929045c98cf8847fc13be150...
I20260812 08:02:29.625890 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 5186
W20260812 08:02:29.637406  5057 connection.cc:573] server connection from 127.31.239.130:46237 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:29.637810  5505 connection.cc:573] server connection from 127.31.239.130:51947 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:29.638235 32702 raft_consensus_election-itest.cc:415] Waiting for new guy to be elected leader.
I20260812 08:02:31.126452  5866 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eab02bd9929045c98cf8847fc13be150)
I20260812 08:02:31.126425  5865 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eab02bd9929045c98cf8847fc13be150)
I20260812 08:02:31.126612  5866 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:31.126634  5865 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:31.126740  5867 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eab02bd9929045c98cf8847fc13be150)
I20260812 08:02:31.126881  5867 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:31.127758  5868 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eab02bd9929045c98cf8847fc13be150)
I20260812 08:02:31.128104  5865 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:31.128476  5868 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:31.129308  5867 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
W20260812 08:02:31.129786  5662 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
W20260812 08:02:31.130689  5060 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:31.131331  5866 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309)
W20260812 08:02:31.131774  5506 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:31.132380  5868 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
W20260812 08:02:31.133594  5359 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
W20260812 08:02:31.134076  5060 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:31.134651  5425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495" is_pre_election: true
I20260812 08:02:31.134809  5425 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67a8770af8ec430d98c29597a24e595f in term 1.
I20260812 08:02:31.138309  5734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "299a5b6829884aba886935181e35f495" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "67a8770af8ec430d98c29597a24e595f" is_pre_election: true
I20260812 08:02:31.138487  5734 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 299a5b6829884aba886935181e35f495 in term 1.
I20260812 08:02:31.138548  5425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495" is_pre_election: true
I20260812 08:02:31.138687  5425 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9fd97ec87df4aa3a9fcabd782129a93 in term 1.
I20260812 08:02:31.138974  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "147b0e8e9d7543c5aa67a366ea229238" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" is_pre_election: true
I20260812 08:02:31.139103  5130 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 147b0e8e9d7543c5aa67a366ea229238 in term 1.
W20260812 08:02:31.140363  5662 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:31.141145  5425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "147b0e8e9d7543c5aa67a366ea229238" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495" is_pre_election: true
I20260812 08:02:31.141281  5425 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 147b0e8e9d7543c5aa67a366ea229238 in term 1.
I20260812 08:02:31.141654  5503 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 147b0e8e9d7543c5aa67a366ea229238, 299a5b6829884aba886935181e35f495, d9fd97ec87df4aa3a9fcabd782129a93; no voters: 
I20260812 08:02:31.141925  5867 raft_consensus.cc:2804] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:31.141978  5867 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eab02bd9929045c98cf8847fc13be150)
I20260812 08:02:31.142014  5867 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:31.143326  5867 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:31.143990  5867 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [CANDIDATE]: Term 2 election: Requested vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:31.144052  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" is_pre_election: true
I20260812 08:02:31.144191  5130 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67a8770af8ec430d98c29597a24e595f in term 1.
I20260812 08:02:31.144526  5662 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 299a5b6829884aba886935181e35f495, 67a8770af8ec430d98c29597a24e595f, d9fd97ec87df4aa3a9fcabd782129a93; no voters: eab02bd9929045c98cf8847fc13be150
I20260812 08:02:31.144929  5865 raft_consensus.cc:2804] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:31.144953  5585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "147b0e8e9d7543c5aa67a366ea229238" is_pre_election: true
I20260812 08:02:31.145002  5865 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 1 FOLLOWER]: Starting leader election (detected failure of leader eab02bd9929045c98cf8847fc13be150)
I20260812 08:02:31.145048  5865 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:31.145109  5585 raft_consensus.cc:2393] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67a8770af8ec430d98c29597a24e595f in current term 2: Already voted for candidate 147b0e8e9d7543c5aa67a366ea229238 in this term.
I20260812 08:02:31.145983  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "299a5b6829884aba886935181e35f495" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" is_pre_election: true
I20260812 08:02:31.146116  5129 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 299a5b6829884aba886935181e35f495 in term 1.
I20260812 08:02:31.146243  5865 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
W20260812 08:02:31.146277  5359 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:31.146281  5425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "147b0e8e9d7543c5aa67a366ea229238" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495"
I20260812 08:02:31.146507  5425 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:31.146575  5359 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 299a5b6829884aba886935181e35f495, 67a8770af8ec430d98c29597a24e595f, d9fd97ec87df4aa3a9fcabd782129a93; no voters: eab02bd9929045c98cf8847fc13be150
I20260812 08:02:31.146781  5865 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 2 election: Requested vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:31.146869  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "147b0e8e9d7543c5aa67a366ea229238" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93"
I20260812 08:02:31.146970  5130 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:31.147249  5426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495"
I20260812 08:02:31.147581  5425 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 147b0e8e9d7543c5aa67a366ea229238 in term 2.
W20260812 08:02:31.147802  5506 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:31.148053  5130 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 147b0e8e9d7543c5aa67a366ea229238 in term 2.
I20260812 08:02:31.148175  5866 raft_consensus.cc:2764] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260812 08:02:31.148370  5506 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 147b0e8e9d7543c5aa67a366ea229238, 299a5b6829884aba886935181e35f495, d9fd97ec87df4aa3a9fcabd782129a93; no voters: 
I20260812 08:02:31.148490  5585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "147b0e8e9d7543c5aa67a366ea229238"
I20260812 08:02:31.148562  5867 raft_consensus.cc:2804] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:31.148778  5867 raft_consensus.cc:697] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 2 LEADER]: Becoming Leader. State: Replica: 147b0e8e9d7543c5aa67a366ea229238, State: Running, Role: LEADER
I20260812 08:02:31.148962  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93"
I20260812 08:02:31.149103  5130 raft_consensus.cc:2393] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 67a8770af8ec430d98c29597a24e595f in current term 2: Already voted for candidate 147b0e8e9d7543c5aa67a366ea229238 in this term.
I20260812 08:02:31.149122  5867 consensus_queue.cc:237] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:31.149212  5734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "147b0e8e9d7543c5aa67a366ea229238" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "67a8770af8ec430d98c29597a24e595f" is_pre_election: true
I20260812 08:02:31.149369  5734 raft_consensus.cc:2393] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 147b0e8e9d7543c5aa67a366ea229238 in current term 2: Already voted for candidate 67a8770af8ec430d98c29597a24e595f in this term.
I20260812 08:02:31.149626  5735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "147b0e8e9d7543c5aa67a366ea229238" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "67a8770af8ec430d98c29597a24e595f"
I20260812 08:02:31.149783  5735 raft_consensus.cc:2393] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 147b0e8e9d7543c5aa67a366ea229238 in current term 2: Already voted for candidate 67a8770af8ec430d98c29597a24e595f in this term.
W20260812 08:02:31.150265  5506 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:31.150276  5583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "299a5b6829884aba886935181e35f495" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "147b0e8e9d7543c5aa67a366ea229238" is_pre_election: true
I20260812 08:02:31.151523  5662 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 67a8770af8ec430d98c29597a24e595f; no voters: 147b0e8e9d7543c5aa67a366ea229238, 299a5b6829884aba886935181e35f495, d9fd97ec87df4aa3a9fcabd782129a93
W20260812 08:02:31.151672  5662 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:31.151705  5865 raft_consensus.cc:2749] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 08:02:31.152290  5735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "67a8770af8ec430d98c29597a24e595f" is_pre_election: true
I20260812 08:02:31.152427  5735 raft_consensus.cc:2393] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9fd97ec87df4aa3a9fcabd782129a93 in current term 2: Already voted for candidate 67a8770af8ec430d98c29597a24e595f in this term.
I20260812 08:02:31.152760  4971 catalog_manager.cc:5719] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 reported cstate change: term changed from 1 to 2, leader changed from eab02bd9929045c98cf8847fc13be150 (127.31.239.130) to 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132). New cstate: current_term: 2 leader_uuid: "147b0e8e9d7543c5aa67a366ea229238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:31.154001  5585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" candidate_term: 2 candidate_status { last_received { term: 1 index: 6 } } ignore_live_leader: false dest_uuid: "147b0e8e9d7543c5aa67a366ea229238" is_pre_election: true
I20260812 08:02:31.154495  5060 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 299a5b6829884aba886935181e35f495, d9fd97ec87df4aa3a9fcabd782129a93; no voters: 147b0e8e9d7543c5aa67a366ea229238, 67a8770af8ec430d98c29597a24e595f, eab02bd9929045c98cf8847fc13be150
I20260812 08:02:31.154757  5868 raft_consensus.cc:2749] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:31.191457 32702 raft_consensus_election-itest.cc:400] Writing data to leader of 5-node config (4 alive)...
W20260812 08:02:31.194350  5791 meta_cache.cc:302] tablet 360d8d2470484289a921033e1ebb6135: replica eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057) has failed: Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
W20260812 08:02:31.201005  5693 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50146: Illegal state: replica 67a8770af8ec430d98c29597a24e595f is not leader of this config: current role FOLLOWER
I20260812 08:02:31.215348  5130 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Refusing update from remote peer 147b0e8e9d7543c5aa67a366ea229238: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260812 08:02:31.215372  5425 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Refusing update from remote peer 147b0e8e9d7543c5aa67a366ea229238: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260812 08:02:31.215549  5735 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Refusing update from remote peer 147b0e8e9d7543c5aa67a366ea229238: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20260812 08:02:31.215966  5915 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260812 08:02:31.216198  5506 consensus_peers.cc:597] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 -> Peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Couldn't send request to peer eab02bd9929045c98cf8847fc13be150. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:31.216207  5916 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 08:02:31.216358  5906 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 08:02:31.246978 32702 raft_consensus_election-itest.cc:411] Killing current leader 147b0e8e9d7543c5aa67a366ea229238...
I20260812 08:02:31.247184 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 5487
W20260812 08:02:31.259014  5357 connection.cc:573] server connection from 127.31.239.132:58941 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:31.259435 32702 raft_consensus_election-itest.cc:415] Waiting for new guy to be elected leader.
I20260812 08:02:32.747598  5931 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 147b0e8e9d7543c5aa67a366ea229238)
I20260812 08:02:32.747747  5931 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:32.748260  5932 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 147b0e8e9d7543c5aa67a366ea229238)
I20260812 08:02:32.748457  5933 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 147b0e8e9d7543c5aa67a366ea229238)
I20260812 08:02:32.748533  5931 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:32.748466  5932 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:32.748673  5933 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:32.749097  5425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495" is_pre_election: true
I20260812 08:02:32.749231  5425 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67a8770af8ec430d98c29597a24e595f in term 2.
I20260812 08:02:32.749307  5933 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309)
I20260812 08:02:32.749544  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" is_pre_election: true
I20260812 08:02:32.750253  5129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "299a5b6829884aba886935181e35f495" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" is_pre_election: true
I20260812 08:02:32.750339  5130 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67a8770af8ec430d98c29597a24e595f in term 2.
W20260812 08:02:32.750876  5662 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:32.750952  5932 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:32.751034  5662 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 299a5b6829884aba886935181e35f495, 67a8770af8ec430d98c29597a24e595f, d9fd97ec87df4aa3a9fcabd782129a93; no voters: eab02bd9929045c98cf8847fc13be150
W20260812 08:02:32.751173  5662 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687): Network error: Client connection negotiation failed: client connection to 127.31.239.132:38687: connect: Connection refused (error 111)
I20260812 08:02:32.751251  5735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "299a5b6829884aba886935181e35f495" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "67a8770af8ec430d98c29597a24e595f" is_pre_election: true
I20260812 08:02:32.751145  5734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "67a8770af8ec430d98c29597a24e595f" is_pre_election: true
I20260812 08:02:32.751269  5931 raft_consensus.cc:2804] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260812 08:02:32.751506  5359 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
I20260812 08:02:32.751539  5931 raft_consensus.cc:493] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 147b0e8e9d7543c5aa67a366ea229238)
I20260812 08:02:32.751587  5931 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 2 FOLLOWER]: Advancing to term 3
W20260812 08:02:32.752290  5359 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687): Network error: Client connection negotiation failed: client connection to 127.31.239.132:38687: connect: Connection refused (error 111)
I20260812 08:02:32.752360  5359 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 299a5b6829884aba886935181e35f495; no voters: 147b0e8e9d7543c5aa67a366ea229238, d9fd97ec87df4aa3a9fcabd782129a93, eab02bd9929045c98cf8847fc13be150
I20260812 08:02:32.752382  5425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495" is_pre_election: true
I20260812 08:02:32.752475  5425 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9fd97ec87df4aa3a9fcabd782129a93 in term 2.
I20260812 08:02:32.752717  5933 raft_consensus.cc:2749] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:02:32.752777  5931 raft_consensus.cc:515] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
W20260812 08:02:32.752888  5060 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
W20260812 08:02:32.753006  5060 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687): Network error: Client connection negotiation failed: client connection to 127.31.239.132:38687: connect: Connection refused (error 111)
I20260812 08:02:32.753036  5735 raft_consensus.cc:2393] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 299a5b6829884aba886935181e35f495 in current term 3: Already voted for candidate 67a8770af8ec430d98c29597a24e595f in this term.
I20260812 08:02:32.753082  5060 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 299a5b6829884aba886935181e35f495, d9fd97ec87df4aa3a9fcabd782129a93; no voters: 147b0e8e9d7543c5aa67a366ea229238, 67a8770af8ec430d98c29597a24e595f, eab02bd9929045c98cf8847fc13be150
I20260812 08:02:32.753322  5931 leader_election.cc:290] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 3 election: Requested vote from peers eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057), 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687), d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309), 299a5b6829884aba886935181e35f495 (127.31.239.131:40159)
I20260812 08:02:32.753535  5932 raft_consensus.cc:2749] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:02:32.753701  5425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "299a5b6829884aba886935181e35f495"
I20260812 08:02:32.753808  5425 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:32.754056  5130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "360d8d2470484289a921033e1ebb6135" candidate_uuid: "67a8770af8ec430d98c29597a24e595f" candidate_term: 3 candidate_status { last_received { term: 2 index: 12 } } ignore_live_leader: false dest_uuid: "d9fd97ec87df4aa3a9fcabd782129a93"
I20260812 08:02:32.754195  5130 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:32.754880  5425 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67a8770af8ec430d98c29597a24e595f in term 3.
W20260812 08:02:32.754947  5662 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111)
W20260812 08:02:32.755065  5662 leader_election.cc:336] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687): Network error: Client connection negotiation failed: client connection to 127.31.239.132:38687: connect: Connection refused (error 111)
I20260812 08:02:32.755285  5130 raft_consensus.cc:2468] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67a8770af8ec430d98c29597a24e595f in term 3.
I20260812 08:02:32.755679  5662 leader_election.cc:304] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: 299a5b6829884aba886935181e35f495, 67a8770af8ec430d98c29597a24e595f, d9fd97ec87df4aa3a9fcabd782129a93; no voters: 147b0e8e9d7543c5aa67a366ea229238, eab02bd9929045c98cf8847fc13be150
I20260812 08:02:32.755898  5931 raft_consensus.cc:2804] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:02:32.756158  5931 raft_consensus.cc:697] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [term 3 LEADER]: Becoming Leader. State: Replica: 67a8770af8ec430d98c29597a24e595f, State: Running, Role: LEADER
I20260812 08:02:32.756474  5931 consensus_queue.cc:237] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 2.12, Last appended by leader: 12, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:32.759380  4971 catalog_manager.cc:5719] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f reported cstate change: term changed from 2 to 3, leader changed from 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132) to 67a8770af8ec430d98c29597a24e595f (127.31.239.133). New cstate: current_term: 3 leader_uuid: "67a8770af8ec430d98c29597a24e595f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:32.795258 32702 raft_consensus_election-itest.cc:400] Writing data to leader of 5-node config (3 alive)...
W20260812 08:02:32.798216  5791 meta_cache.cc:302] tablet 360d8d2470484289a921033e1ebb6135: replica 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687) has failed: Network error: Client connection negotiation failed: client connection to 127.31.239.132:38687: connect: Connection refused (error 111)
I20260812 08:02:32.805853  5425 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P 299a5b6829884aba886935181e35f495 [term 3 FOLLOWER]: Refusing update from remote peer 67a8770af8ec430d98c29597a24e595f: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 08:02:32.805869  5130 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P d9fd97ec87df4aa3a9fcabd782129a93 [term 3 FOLLOWER]: Refusing update from remote peer 67a8770af8ec430d98c29597a24e595f: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 08:02:32.806420  5954 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 08:02:32.806602  5955 consensus_queue.cc:1048] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [LEADER]: Connected to new peer: Peer: permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260812 08:02:32.806885  5662 consensus_peers.cc:597] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f -> Peer eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): Couldn't send request to peer eab02bd9929045c98cf8847fc13be150. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.130:45057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:32.806998  5662 consensus_peers.cc:597] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f -> Peer 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687): Couldn't send request to peer 147b0e8e9d7543c5aa67a366ea229238. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.132:38687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:32.830739 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.132:38687
--local_ip_for_outbound_sockets=127.31.239.132
--tserver_master_addrs=127.31.239.190:37915
--webserver_port=35987
--webserver_interface=127.31.239.132
--builtin_ntp_servers=127.31.239.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
W20260812 08:02:32.938717  5965 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:32.938939  5965 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:32.938987  5965 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:32.942636  5965 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:32.942797  5965 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.132
I20260812 08:02:32.946875  5965 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.132:38687
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.31.239.132
--webserver_port=35987
--tserver_master_addrs=127.31.239.190:37915
--never_fsync=true
--heap_profile_path=/tmp/kudu.5965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:32.948117  5965 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:32.949254  5965 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:32.955773  5971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:32.955896  5965 server_base.cc:1061] running on GCE node
W20260812 08:02:32.955761  5972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:32.955773  5975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:32.956353  5965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:32.956988  5965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:32.958226  5965 hybrid_clock.cc:648] HybridClock initialized: now 1786521752958212 us; error 40 us; skew 500 ppm
I20260812 08:02:32.960053  5965 webserver.cc:533] Webserver started at http://127.31.239.132:35987/ using document root <none> and password file <none>
I20260812 08:02:32.960662  5965 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:32.960780  5965 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:32.964448  5965 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.004s	sys 0.000s
I20260812 08:02:32.966508  5981 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:32.967547  5965 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:32.967680  5965 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "147b0e8e9d7543c5aa67a366ea229238"
format_stamp: "Formatted at 2026-08-12 08:02:29 on dist-test-slave-9jjr"
I20260812 08:02:32.968080  5965 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:32.982671  5965 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:32.983407  5965 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:32.983620  5965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:32.984257  5965 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:32.985503  5990 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:02:32.989585  5965 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:02:32.989691  5965 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:02:32.989775  5965 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:02:32.991410  5965 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:02:32.991485  5965 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:32.991816  5990 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Bootstrap starting.
I20260812 08:02:33.003672  5965 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.132:38687
I20260812 08:02:33.003731  6116 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.132:38687 every 8 connection(s)
I20260812 08:02:33.004762  5965 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260812 08:02:33.007879 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 5965
I20260812 08:02:33.008455 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:45057
--local_ip_for_outbound_sockets=127.31.239.130
--tserver_master_addrs=127.31.239.190:37915
--webserver_port=45707
--webserver_interface=127.31.239.130
--builtin_ntp_servers=127.31.239.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
I20260812 08:02:33.010279  5990 log.cc:826] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:33.023625  6117 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37915
I20260812 08:02:33.023914  6117 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:33.024572  6117 heartbeater.cc:507] Master 127.31.239.190:37915 requested a full tablet report, sending...
I20260812 08:02:33.024744  5990 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:33.025159  5990 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Bootstrap complete.
I20260812 08:02:33.026672  5990 ts_tablet_manager.cc:1403] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Time spent bootstrapping tablet: real 0.035s	user 0.028s	sys 0.006s
I20260812 08:02:33.026878  4973 ts_manager.cc:194] Re-registered known tserver with Master: 147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687)
I20260812 08:02:33.027966  4973 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.132:55019
I20260812 08:02:33.029023  5990 raft_consensus.cc:359] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:33.029454  5990 raft_consensus.cc:740] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147b0e8e9d7543c5aa67a366ea229238, State: Initialized, Role: FOLLOWER
I20260812 08:02:33.029919  5990 consensus_queue.cc:260] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 2.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:33.030628  6117 heartbeater.cc:499] Master 127.31.239.190:37915 was elected leader, sending a full tablet report...
I20260812 08:02:33.030779  5990 ts_tablet_manager.cc:1434] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
W20260812 08:02:33.120895  6127 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:33.121170  6127 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:33.121300  6127 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:33.124910  6127 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:33.125104  6127 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:33.129220  6127 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:45057
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=45707
--tserver_master_addrs=127.31.239.190:37915
--never_fsync=true
--heap_profile_path=/tmp/kudu.6127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:33.130467  6127 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:33.131615  6127 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:33.138803  6136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:33.138803  6137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:33.138942  6127 server_base.cc:1061] running on GCE node
W20260812 08:02:33.139122  6140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:33.139678  6127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:33.140323  6127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:33.141523  6127 hybrid_clock.cc:648] HybridClock initialized: now 1786521753141515 us; error 42 us; skew 500 ppm
I20260812 08:02:33.143567  6127 webserver.cc:533] Webserver started at http://127.31.239.130:45707/ using document root <none> and password file <none>
I20260812 08:02:33.144182  6127 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:33.144287  6127 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:33.148233  6127 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260812 08:02:33.150457  6146 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:33.151553  6127 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:33.151696  6127 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "eab02bd9929045c98cf8847fc13be150"
format_stamp: "Formatted at 2026-08-12 08:02:28 on dist-test-slave-9jjr"
I20260812 08:02:33.152133  6127 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:33.168371  6127 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:33.169114  6127 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:33.169327  6127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:33.169931  6127 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:33.171267  6156 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:02:33.174880  6127 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:02:33.174978  6127 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:02:33.175092  6127 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:02:33.176764  6127 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:02:33.176847  6127 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 08:02:33.177187  6156 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Bootstrap starting.
I20260812 08:02:33.190697  6127 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:45057
I20260812 08:02:33.190786  6280 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:45057 every 8 connection(s)
I20260812 08:02:33.191859  6127 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:33.195714  6156 log.cc:826] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:33.196365 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 6127
I20260812 08:02:33.202021  6283 heartbeater.cc:344] Connected to a master server at 127.31.239.190:37915
I20260812 08:02:33.202302  6283 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:33.202809  6283 heartbeater.cc:507] Master 127.31.239.190:37915 requested a full tablet report, sending...
I20260812 08:02:33.204630  4973 ts_manager.cc:194] Re-registered known tserver with Master: eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057)
I20260812 08:02:33.205757  4973 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:59777
I20260812 08:02:33.207427  6156 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=50 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:33.207950  6156 tablet_bootstrap.cc:492] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Bootstrap complete.
I20260812 08:02:33.209556  6156 ts_tablet_manager.cc:1403] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.008s
I20260812 08:02:33.212213  6156 raft_consensus.cc:359] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:33.212646  6156 raft_consensus.cc:740] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eab02bd9929045c98cf8847fc13be150, State: Initialized, Role: FOLLOWER
I20260812 08:02:33.213148  6156 consensus_queue.cc:260] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 } } peers { permanent_uuid: "67a8770af8ec430d98c29597a24e595f" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 44305 } } peers { permanent_uuid: "147b0e8e9d7543c5aa67a366ea229238" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 38687 } } peers { permanent_uuid: "d9fd97ec87df4aa3a9fcabd782129a93" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38309 } } peers { permanent_uuid: "299a5b6829884aba886935181e35f495" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 40159 } }
I20260812 08:02:33.213928  6283 heartbeater.cc:499] Master 127.31.239.190:37915 was elected leader, sending a full tablet report...
I20260812 08:02:33.214227  6156 ts_tablet_manager.cc:1434] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260812 08:02:33.260589  6041 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:33.260668  5107 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:33.262703  5715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:02:33.262818  5405 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:33.274984  6202 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 dce4946d8c5f45658d977e102896a10d | 127.31.239.190:37915 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                               Value                                                                                               |      Tags       |         Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:35093 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 147b0e8e9d7543c5aa67a366ea229238 | 127.31.239.132:38687 | HEALTHY | <none>   |       0        |       0
 299a5b6829884aba886935181e35f495 | 127.31.239.131:40159 | HEALTHY | <none>   |       0        |       0
 67a8770af8ec430d98c29597a24e595f | 127.31.239.133:44305 | HEALTHY | <none>   |       1        |       0
 d9fd97ec87df4aa3a9fcabd782129a93 | 127.31.239.129:38309 | HEALTHY | <none>   |       0        |       0
 eab02bd9929045c98cf8847fc13be150 | 127.31.239.130:45057 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       5

Unusual flags for Tablet Server:
               Flag               |                                                                                             Value                                                                                             |      Tags       |      Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_server_key_size             | 768                                                                                                                                                                                           | experimental    | all 5 server(s) checked
 local_ip_for_outbound_sockets    | 127.31.239.129                                                                                                                                                                                | experimental    | 127.31.239.129:38309
 local_ip_for_outbound_sockets    | 127.31.239.130                                                                                                                                                                                | experimental    | 127.31.239.130:45057
 local_ip_for_outbound_sockets    | 127.31.239.131                                                                                                                                                                                | experimental    | 127.31.239.131:40159
 local_ip_for_outbound_sockets    | 127.31.239.132                                                                                                                                                                                | experimental    | 127.31.239.132:38687
 local_ip_for_outbound_sockets    | 127.31.239.133                                                                                                                                                                                | experimental    | 127.31.239.133:44305
 never_fsync                      | true                                                                                                                                                                                          | unsafe,advanced | all 5 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                             | unsafe,hidden   | all 5 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                          | unsafe          | all 5 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                            | hidden          | all 5 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:38309
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:45057
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:40159
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden          | 127.31.239.132:38687
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden          | 127.31.239.133:44305

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:35093 | all 5 server(s) checked
 time_source         | builtin              | all 5 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 6 server(s) checked

Tablet Summary
Tablet 360d8d2470484289a921033e1ebb6135 of table 'TestTable' is conflicted: 2 replicas' active configs disagree with the leader master's
  eab02bd9929045c98cf8847fc13be150 (127.31.239.130:45057): RUNNING
  67a8770af8ec430d98c29597a24e595f (127.31.239.133:44305): RUNNING [LEADER]
  147b0e8e9d7543c5aa67a366ea229238 (127.31.239.132:38687): RUNNING
  d9fd97ec87df4aa3a9fcabd782129a93 (127.31.239.129:38309): RUNNING
  299a5b6829884aba886935181e35f495 (127.31.239.131:40159): RUNNING
All reported replicas are:
  A = eab02bd9929045c98cf8847fc13be150
  B = 67a8770af8ec430d98c29597a24e595f
  C = 147b0e8e9d7543c5aa67a366ea229238
  D = d9fd97ec87df4aa3a9fcabd782129a93
  E = 299a5b6829884aba886935181e35f495
The consensus matrix is:
 Config source |       Replicas       | Current term | Config index | Committed?
---------------+----------------------+--------------+--------------+------------
 master        | A   B*  C   D   E    |              |              | Yes
 A             | A   B   C   D   E    | 1            | -1           | Yes
 B             | A   B*  C   D   E    | 3            | -1           | Yes
 C             | A   B   C   D   E    | 2            | -1           | Yes
 D             | A   B*  C   D   E    | 3            | -1           | Yes
 E             | A   B*  C   D   E    | 3            | -1           | Yes

The cluster doesn't have any matching system tables
Summary by table
   Name    | RF |       Status       | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+--------------------+---------------+---------+------------+------------------+-------------
 TestTable | 5  | CONSENSUS_MISMATCH | 1             | 0       | 0          | 0                | 1

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 5
 Tables         | 1
 Tablets        | 1
 Replicas       | 5

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

==================
Errors:
==================
Corruption: table consistency check error: 1 out of 1 table(s) are not healthy

FAILED
I20260812 08:02:33.301945 32702 cluster_verifier.cc:83] Check not successful yet, sleeping and retrying: Runtime error: ksck discovered errors
I20260812 08:02:33.359249  6063 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P 147b0e8e9d7543c5aa67a366ea229238 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:02:33.395952  6227 raft_consensus.cc:3060] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 1 FOLLOWER]: Advancing to term 3
I20260812 08:02:33.397953  6227 raft_consensus.cc:1275] T 360d8d2470484289a921033e1ebb6135 P eab02bd9929045c98cf8847fc13be150 [term 3 FOLLOWER]: Refusing update from remote peer 67a8770af8ec430d98c29597a24e595f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20260812 08:02:33.398835  5955 consensus_queue.cc:1050] T 360d8d2470484289a921033e1ebb6135 P 67a8770af8ec430d98c29597a24e595f [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "eab02bd9929045c98cf8847fc13be150" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 08:02:33.403913  6332 mvcc.cc:204] Tried to move back new op lower bound from 7317593099580133376 to 7317593092711002112. Current Snapshot: MvccSnapshot[applied={T|T < 7317593092971151360}]
I20260812 08:02:33.505594  5715 tablet_service.cc:1467] Tablet server has 1 leaders and 0 scanners
I20260812 08:02:33.506284  5405 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:33.509162  5107 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:33.515139  6041 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
I20260812 08:02:33.530669  6202 tablet_service.cc:1467] Tablet server has 0 leaders and 0 scanners
Master Summary
               UUID               |       Address        | Status
----------------------------------+----------------------+---------
 dce4946d8c5f45658d977e102896a10d | 127.31.239.190:37915 | HEALTHY

Unusual flags for Master:
               Flag               |                                                                                               Value                                                                                               |      Tags       |         Master
----------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_ca_key_size                 | 768                                                                                                                                                                                               | experimental    | all 1 server(s) checked
 ipki_server_key_size             | 768                                                                                                                                                                                               | experimental    | all 1 server(s) checked
 never_fsync                      | true                                                                                                                                                                                              | unsafe,advanced | all 1 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                                 | unsafe,hidden   | all 1 server(s) checked
 rpc_reuseport                    | true                                                                                                                                                                                              | experimental    | all 1 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                              | unsafe          | all 1 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                                | hidden          | all 1 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden          | all 1 server(s) checked
 tsk_num_rsa_bits                 | 512                                                                                                                                                                                               | experimental    | all 1 server(s) checked

Flags of checked categories for Master:
        Flag         |        Value         |         Master
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:35093 | all 1 server(s) checked
 time_source         | builtin              | all 1 server(s) checked

Tablet Server Summary
               UUID               |       Address        | Status  | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
 147b0e8e9d7543c5aa67a366ea229238 | 127.31.239.132:38687 | HEALTHY | <none>   |       0        |       0
 299a5b6829884aba886935181e35f495 | 127.31.239.131:40159 | HEALTHY | <none>   |       0        |       0
 67a8770af8ec430d98c29597a24e595f | 127.31.239.133:44305 | HEALTHY | <none>   |       1        |       0
 d9fd97ec87df4aa3a9fcabd782129a93 | 127.31.239.129:38309 | HEALTHY | <none>   |       0        |       0
 eab02bd9929045c98cf8847fc13be150 | 127.31.239.130:45057 | HEALTHY | <none>   |       0        |       0

Tablet Server Location Summary
 Location |  Count
----------+---------
 <none>   |       5

Unusual flags for Tablet Server:
               Flag               |                                                                                             Value                                                                                             |      Tags       |      Tablet Server
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
 ipki_server_key_size             | 768                                                                                                                                                                                           | experimental    | all 5 server(s) checked
 local_ip_for_outbound_sockets    | 127.31.239.129                                                                                                                                                                                | experimental    | 127.31.239.129:38309
 local_ip_for_outbound_sockets    | 127.31.239.130                                                                                                                                                                                | experimental    | 127.31.239.130:45057
 local_ip_for_outbound_sockets    | 127.31.239.131                                                                                                                                                                                | experimental    | 127.31.239.131:40159
 local_ip_for_outbound_sockets    | 127.31.239.132                                                                                                                                                                                | experimental    | 127.31.239.132:38687
 local_ip_for_outbound_sockets    | 127.31.239.133                                                                                                                                                                                | experimental    | 127.31.239.133:44305
 never_fsync                      | true                                                                                                                                                                                          | unsafe,advanced | all 5 server(s) checked
 openssl_security_level_override  | 0                                                                                                                                                                                             | unsafe,hidden   | all 5 server(s) checked
 rpc_server_allow_ephemeral_ports | true                                                                                                                                                                                          | unsafe          | all 5 server(s) checked
 server_dump_info_format          | pb                                                                                                                                                                                            | hidden          | all 5 server(s) checked
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden          | 127.31.239.129:38309
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden          | 127.31.239.130:45057
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden          | 127.31.239.131:40159
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden          | 127.31.239.132:38687
 server_dump_info_path            | /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElection.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden          | 127.31.239.133:44305

Flags of checked categories for Tablet Server:
        Flag         |        Value         |      Tablet Server
---------------------+----------------------+-------------------------
 builtin_ntp_servers | 127.31.239.148:35093 | all 5 server(s) checked
 time_source         | builtin              | all 5 server(s) checked

Version Summary
     Version     |         Servers
-----------------+-------------------------
 1.19.0-SNAPSHOT | all 6 server(s) checked

Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
   Name    | RF | Status  | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------+----+---------+---------------+---------+------------+------------------+-------------
 TestTable | 5  | HEALTHY | 1             | 1       | 0          | 0                | 0

Tablet Replica Count Summary
   Statistic    | Replica Count
----------------+---------------
 Minimum        | 1
 First Quartile | 1
 Median         | 1
 Third Quartile | 1
 Maximum        | 1

Total Count Summary
                | Total Count
----------------+-------------
 Masters        | 1
 Tablet Servers | 5
 Tables         | 1
 Tablets        | 1
 Replicas       | 5

==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set

OK
I20260812 08:02:33.553706 32702 log_verifier.cc:126] Checking tablet 360d8d2470484289a921033e1ebb6135
I20260812 08:02:33.603523 32702 log_verifier.cc:177] Verified matching terms for 18 ops in tablet 360d8d2470484289a921033e1ebb6135
I20260812 08:02:33.940538 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 5039
I20260812 08:02:33.953533 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 6127
I20260812 08:02:33.964511 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 5338
I20260812 08:02:33.974207 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 5965
I20260812 08:02:33.986459 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 5642
I20260812 08:02:33.995688 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 4937
2026-08-12T08:02:33Z chronyd exiting
[       OK ] RaftConsensusElectionITest.AutomaticLeaderElection (5892 ms)
[ RUN      ] RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica
I20260812 08:02:34.028892 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:34.028967 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:34.028985 32702 ts_itest-base.cc:117] 1 tablet servers
I20260812 08:02:34.029001 32702 ts_itest-base.cc:118] 1 replicas per TS
I20260812 08:02:34.029027 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:34Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:34Z Disabled control of system clock
I20260812 08:02:34.038652 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:40073
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:35549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:40073 with env {}
W20260812 08:02:34.144117  6384 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:34.144434  6384 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:34.144518  6384 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:34.148066  6384 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:34.148170  6384 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:34.148216  6384 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:34.148262  6384 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:34.152339  6384 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:40073
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:40073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.6384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:34.153522  6384 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:34.154724  6384 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:34.160610  6392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:34.160601  6390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:34.160732  6384 server_base.cc:1061] running on GCE node
W20260812 08:02:34.160610  6389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:34.161409  6384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:34.162379  6384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:34.163558  6384 hybrid_clock.cc:648] HybridClock initialized: now 1786521754163539 us; error 35 us; skew 500 ppm
I20260812 08:02:34.165354  6384 webserver.cc:533] Webserver started at http://127.31.239.190:36353/ using document root <none> and password file <none>
I20260812 08:02:34.165951  6384 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:34.166006  6384 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:34.166276  6384 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:34.167853  6384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "bf6f93858a654443b205b1a77ade65a7"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.168335  6384 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "bf6f93858a654443b205b1a77ade65a7"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.171767  6384 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:34.173933  6398 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:34.174938  6384 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:34.175061  6384 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "bf6f93858a654443b205b1a77ade65a7"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.175163  6384 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:34.201964  6384 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:34.202852  6384 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:34.203095  6384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:34.211225  6384 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:40073
I20260812 08:02:34.211249  6459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:40073 every 8 connection(s)
I20260812 08:02:34.212350  6384 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:34.214570 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 6384
I20260812 08:02:34.214694 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:34.215516  6460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:34.222306  6460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7: Bootstrap starting.
I20260812 08:02:34.224561  6460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:34.225337  6460 log.cc:826] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:34.227099  6460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7: No bootstrap required, opened a new log
I20260812 08:02:34.229665  6460 raft_consensus.cc:359] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6f93858a654443b205b1a77ade65a7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40073 } }
I20260812 08:02:34.229882  6460 raft_consensus.cc:385] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:34.229967  6460 raft_consensus.cc:740] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf6f93858a654443b205b1a77ade65a7, State: Initialized, Role: FOLLOWER
I20260812 08:02:34.230461  6460 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6f93858a654443b205b1a77ade65a7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40073 } }
I20260812 08:02:34.230609  6460 raft_consensus.cc:399] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:34.230682  6460 raft_consensus.cc:493] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:34.230839  6460 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:34.231676  6460 raft_consensus.cc:515] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6f93858a654443b205b1a77ade65a7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40073 } }
I20260812 08:02:34.232025  6460 leader_election.cc:304] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf6f93858a654443b205b1a77ade65a7; no voters: 
I20260812 08:02:34.232348  6460 leader_election.cc:290] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:34.232471  6466 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:34.232725  6466 raft_consensus.cc:697] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [term 1 LEADER]: Becoming Leader. State: Replica: bf6f93858a654443b205b1a77ade65a7, State: Running, Role: LEADER
I20260812 08:02:34.233021  6466 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6f93858a654443b205b1a77ade65a7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40073 } }
I20260812 08:02:34.233632  6460 sys_catalog.cc:565] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:34.234797  6467 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf6f93858a654443b205b1a77ade65a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6f93858a654443b205b1a77ade65a7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40073 } } }
I20260812 08:02:34.234949  6467 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:34.235397  6477 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:34.235270  6468 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf6f93858a654443b205b1a77ade65a7. Latest consensus state: current_term: 1 leader_uuid: "bf6f93858a654443b205b1a77ade65a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6f93858a654443b205b1a77ade65a7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40073 } } }
I20260812 08:02:34.235890  6468 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:34.238881  6477 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:34.244751  6477 catalog_manager.cc:1383] Generated new cluster ID: 2788f092fc1e4d7c985eeeb34d4ed53a
I20260812 08:02:34.244851  6477 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:34.257513  6477 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:34.258760  6477 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:34.276564  6477 catalog_manager.cc:6092] T 00000000000000000000000000000000 P bf6f93858a654443b205b1a77ade65a7: Generated new TSK 0
I20260812 08:02:34.277257  6477 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:34.281301 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40073
--builtin_ntp_servers=127.31.239.148:35549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_cache_size_limit_mb=10
--consensus_rpc_timeout_ms=50 with env {}
W20260812 08:02:34.393007  6491 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:34.393263  6491 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:34.393311  6491 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:34.396864  6491 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:34.396978  6491 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:34.401084  6491 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=50
--log_cache_size_limit_mb=10
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40073
--never_fsync=true
--heap_profile_path=/tmp/kudu.6491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:34.402315  6491 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:34.403512  6491 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:34.410020  6496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:34.410024  6499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:34.410070  6491 server_base.cc:1061] running on GCE node
W20260812 08:02:34.410354  6497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:34.410823  6491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:34.411382  6491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:34.412563  6491 hybrid_clock.cc:648] HybridClock initialized: now 1786521754412546 us; error 41 us; skew 500 ppm
I20260812 08:02:34.414433  6491 webserver.cc:533] Webserver started at http://127.31.239.129:33497/ using document root <none> and password file <none>
I20260812 08:02:34.415004  6491 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:34.415089  6491 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:34.415311  6491 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:34.416875  6491 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "fd2230bc03b24e38b3ac7b04b1c53b37"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.417372  6491 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "fd2230bc03b24e38b3ac7b04b1c53b37"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.420794  6491 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 08:02:34.423070  6505 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:34.424065  6491 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:34.424201  6491 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "fd2230bc03b24e38b3ac7b04b1c53b37"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.424309  6491 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:34.439620  6491 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:34.440336  6491 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:34.440546  6491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:34.441138  6491 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:34.442198  6491 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:34.442276  6491 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:34.442348  6491 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:34.442399  6491 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:34.452502  6491 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:42851
I20260812 08:02:34.452526  6627 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:42851 every 8 connection(s)
I20260812 08:02:34.453500  6491 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:34.459233 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 6491
I20260812 08:02:34.459367 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:34.462208  6628 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40073
I20260812 08:02:34.462427  6628 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:34.462885  6628 heartbeater.cc:507] Master 127.31.239.190:40073 requested a full tablet report, sending...
I20260812 08:02:34.464241  6417 ts_manager.cc:194] Registered new tserver with Master: fd2230bc03b24e38b3ac7b04b1c53b37 (127.31.239.129:42851)
I20260812 08:02:34.465361  6417 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:46955
I20260812 08:02:34.474071 32702 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260812 08:02:34.483862  6417 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55846:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
I20260812 08:02:34.500856  6555 tablet_service.cc:1511] Processing CreateTablet for tablet 3a12947165d6479d92b8169f231880d8 (DEFAULT_TABLE table=TestTable [id=12fb51a61ae340478626ecf37994d1a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:34.501885  6555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a12947165d6479d92b8169f231880d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:34.507007  6641 tablet_bootstrap.cc:492] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37: Bootstrap starting.
I20260812 08:02:34.509331  6641 tablet_bootstrap.cc:654] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:34.510099  6641 log.cc:826] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:34.512147  6641 tablet_bootstrap.cc:492] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37: No bootstrap required, opened a new log
I20260812 08:02:34.512398  6641 ts_tablet_manager.cc:1403] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37: Time spent bootstrapping tablet: real 0.006s	user 0.000s	sys 0.003s
I20260812 08:02:34.514858  6641 raft_consensus.cc:359] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2230bc03b24e38b3ac7b04b1c53b37" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42851 } }
I20260812 08:02:34.515070  6641 raft_consensus.cc:385] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:34.515162  6641 raft_consensus.cc:740] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd2230bc03b24e38b3ac7b04b1c53b37, State: Initialized, Role: FOLLOWER
I20260812 08:02:34.515583  6641 consensus_queue.cc:260] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2230bc03b24e38b3ac7b04b1c53b37" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42851 } }
I20260812 08:02:34.515731  6641 raft_consensus.cc:399] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:34.515817  6641 raft_consensus.cc:493] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:34.515950  6641 raft_consensus.cc:3060] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:34.516999  6641 raft_consensus.cc:515] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2230bc03b24e38b3ac7b04b1c53b37" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42851 } }
I20260812 08:02:34.517416  6641 leader_election.cc:304] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd2230bc03b24e38b3ac7b04b1c53b37; no voters: 
I20260812 08:02:34.517807  6641 leader_election.cc:290] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:34.518069  6644 raft_consensus.cc:2804] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:34.518520  6628 heartbeater.cc:499] Master 127.31.239.190:40073 was elected leader, sending a full tablet report...
I20260812 08:02:34.518744  6641 ts_tablet_manager.cc:1434] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260812 08:02:34.518373  6644 raft_consensus.cc:697] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [term 1 LEADER]: Becoming Leader. State: Replica: fd2230bc03b24e38b3ac7b04b1c53b37, State: Running, Role: LEADER
I20260812 08:02:34.519106  6644 consensus_queue.cc:237] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2230bc03b24e38b3ac7b04b1c53b37" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42851 } }
I20260812 08:02:34.522838  6417 catalog_manager.cc:5719] T 3a12947165d6479d92b8169f231880d8 P fd2230bc03b24e38b3ac7b04b1c53b37 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd2230bc03b24e38b3ac7b04b1c53b37 (127.31.239.129). New cstate: current_term: 1 leader_uuid: "fd2230bc03b24e38b3ac7b04b1c53b37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd2230bc03b24e38b3ac7b04b1c53b37" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42851 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:34.537604 32702 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260812 08:02:34.539139 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver fd2230bc03b24e38b3ac7b04b1c53b37 to finish bootstrapping
I20260812 08:02:34.549646 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 6491
I20260812 08:02:34.558665 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 6384
2026-08-12T08:02:34Z chronyd exiting
[       OK ] RaftConsensusElectionITest.AutomaticLeaderElectionOneReplica (555 ms)
[ RUN      ] RaftConsensusElectionITest.LeaderStepDown
I20260812 08:02:34.583940 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:34.583997 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:34.584008 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:02:34.584019 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:02:34.584029 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:34Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:34Z Disabled control of system clock
I20260812 08:02:34.594215 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:33765
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:42057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:33765
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:02:34.704937  6661 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:34.705253  6661 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:34.705345  6661 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:34.708989  6661 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:34.709090  6661 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:34.709127  6661 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:34.709178  6661 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:34.713320  6661 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:42057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:33765
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:33765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.6661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:34.714592  6661 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:34.715809  6661 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:34.721544  6666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:34.721567  6667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:34.721638  6669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:34.721838  6661 server_base.cc:1061] running on GCE node
I20260812 08:02:34.722574  6661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:34.723551  6661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:34.724745  6661 hybrid_clock.cc:648] HybridClock initialized: now 1786521754724720 us; error 42 us; skew 500 ppm
I20260812 08:02:34.726693  6661 webserver.cc:533] Webserver started at http://127.31.239.190:39663/ using document root <none> and password file <none>
I20260812 08:02:34.727293  6661 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:34.727378  6661 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:34.727609  6661 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:34.729209  6661 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "9495a450e02b4d25a86925f8951998e2"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.729729  6661 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "9495a450e02b4d25a86925f8951998e2"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.733898  6661 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:02:34.736413  6677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:34.737536  6661 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:34.737699  6661 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "9495a450e02b4d25a86925f8951998e2"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.737816  6661 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:34.751698  6661 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:34.752468  6661 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:34.752682  6661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:34.761343  6661 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:33765
I20260812 08:02:34.761361  6737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:33765 every 8 connection(s)
I20260812 08:02:34.762516  6661 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:34.765610  6738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:34.770460 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 6661
I20260812 08:02:34.770627 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:34.771010  6738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2: Bootstrap starting.
I20260812 08:02:34.773656  6738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:34.774523  6738 log.cc:826] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:34.776265  6738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2: No bootstrap required, opened a new log
I20260812 08:02:34.779142  6738 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9495a450e02b4d25a86925f8951998e2" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 33765 } }
I20260812 08:02:34.779392  6738 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:34.779480  6738 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9495a450e02b4d25a86925f8951998e2, State: Initialized, Role: FOLLOWER
I20260812 08:02:34.780045  6738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9495a450e02b4d25a86925f8951998e2" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 33765 } }
I20260812 08:02:34.780232  6738 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:34.780314  6738 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:34.780445  6738 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:34.781425  6738 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9495a450e02b4d25a86925f8951998e2" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 33765 } }
I20260812 08:02:34.781790  6738 leader_election.cc:304] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9495a450e02b4d25a86925f8951998e2; no voters: 
I20260812 08:02:34.782114  6738 leader_election.cc:290] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:34.782348  6744 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:34.782599  6744 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9495a450e02b4d25a86925f8951998e2, State: Running, Role: LEADER
I20260812 08:02:34.782913  6744 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9495a450e02b4d25a86925f8951998e2" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 33765 } }
I20260812 08:02:34.783480  6738 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:34.784893  6745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9495a450e02b4d25a86925f8951998e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9495a450e02b4d25a86925f8951998e2" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 33765 } } }
I20260812 08:02:34.784902  6746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9495a450e02b4d25a86925f8951998e2. Latest consensus state: current_term: 1 leader_uuid: "9495a450e02b4d25a86925f8951998e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9495a450e02b4d25a86925f8951998e2" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 33765 } } }
I20260812 08:02:34.785041  6745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:34.785050  6746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:34.785851  6754 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:34.788499  6754 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:34.794088  6754 catalog_manager.cc:1383] Generated new cluster ID: c2165014c036435397056e1ebdaadee0
I20260812 08:02:34.794238  6754 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:34.806110  6754 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:34.806978  6754 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:34.813481  6754 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 9495a450e02b4d25a86925f8951998e2: Generated new TSK 0
I20260812 08:02:34.814184  6754 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:34.826562 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:33765
--builtin_ntp_servers=127.31.239.148:42057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:02:34.937151  6764 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:34.937463  6764 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:34.937533  6764 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:34.937635  6764 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:34.941188  6764 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:34.941380  6764 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:34.945519  6764 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:42057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:33765
--never_fsync=true
--heap_profile_path=/tmp/kudu.6764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:34.946760  6764 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:34.947975  6764 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:34.954970  6771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:34.954970  6773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:34.954970  6770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:34.955531  6764 server_base.cc:1061] running on GCE node
I20260812 08:02:34.955948  6764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:34.956508  6764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:34.957671  6764 hybrid_clock.cc:648] HybridClock initialized: now 1786521754957656 us; error 29 us; skew 500 ppm
I20260812 08:02:34.959643  6764 webserver.cc:533] Webserver started at http://127.31.239.129:34881/ using document root <none> and password file <none>
I20260812 08:02:34.960243  6764 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:34.960300  6764 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:34.960515  6764 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:34.962095  6764 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "696c353b480e430b8a82a9de6e504064"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.962692  6764 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "696c353b480e430b8a82a9de6e504064"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.966251  6764 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:34.968508  6779 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:34.969449  6764 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:34.969575  6764 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "696c353b480e430b8a82a9de6e504064"
format_stamp: "Formatted at 2026-08-12 08:02:34 on dist-test-slave-9jjr"
I20260812 08:02:34.969689  6764 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:34.978865  6764 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:34.979555  6764 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:34.979772  6764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:34.980372  6764 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:34.981393  6764 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:34.981444  6764 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:34.981484  6764 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:34.981535  6764 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:34.991674  6764 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:44061
I20260812 08:02:34.991699  6911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:44061 every 8 connection(s)
I20260812 08:02:34.992784  6764 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:34.993844 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 6764
I20260812 08:02:34.993979 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:34.996541 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:33765
--builtin_ntp_servers=127.31.239.148:42057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:02:35.003707  6912 heartbeater.cc:344] Connected to a master server at 127.31.239.190:33765
I20260812 08:02:35.004024  6912 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:35.004726  6912 heartbeater.cc:507] Master 127.31.239.190:33765 requested a full tablet report, sending...
I20260812 08:02:35.006368  6696 ts_manager.cc:194] Registered new tserver with Master: 696c353b480e430b8a82a9de6e504064 (127.31.239.129:44061)
I20260812 08:02:35.007670  6696 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:41807
W20260812 08:02:35.108304  6915 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:35.108632  6915 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:35.108693  6915 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:35.108781  6915 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:35.112515  6915 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:35.112727  6915 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:35.116780  6915 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:42057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:33765
--never_fsync=true
--heap_profile_path=/tmp/kudu.6915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:35.117995  6915 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:35.119194  6915 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:35.126197  6921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:35.126392  6915 server_base.cc:1061] running on GCE node
W20260812 08:02:35.126232  6922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:35.126277  6924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:35.126906  6915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:35.127560  6915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:35.128759  6915 hybrid_clock.cc:648] HybridClock initialized: now 1786521755128733 us; error 46 us; skew 500 ppm
I20260812 08:02:35.130762  6915 webserver.cc:533] Webserver started at http://127.31.239.130:43919/ using document root <none> and password file <none>
I20260812 08:02:35.131366  6915 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:35.131455  6915 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:35.131685  6915 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:35.133311  6915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "d36a5e6a80034478ac4a2b8cbea12b86"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.133904  6915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "d36a5e6a80034478ac4a2b8cbea12b86"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.137399  6915 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:35.139758  6930 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.140817  6915 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:35.140960  6915 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "d36a5e6a80034478ac4a2b8cbea12b86"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.141073  6915 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:35.154367  6915 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:35.155143  6915 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:35.155354  6915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:35.155951  6915 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:35.157004  6915 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:35.157080  6915 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.157153  6915 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:35.157197  6915 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.167855  6915 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:34347
I20260812 08:02:35.167881  7055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:34347 every 8 connection(s)
I20260812 08:02:35.169116  6915 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:35.174712 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 6915
I20260812 08:02:35.174847 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:02:35.177507 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:33765
--builtin_ntp_servers=127.31.239.148:42057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:02:35.179224  7056 heartbeater.cc:344] Connected to a master server at 127.31.239.190:33765
I20260812 08:02:35.179497  7056 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:35.180048  7056 heartbeater.cc:507] Master 127.31.239.190:33765 requested a full tablet report, sending...
I20260812 08:02:35.181142  6696 ts_manager.cc:194] Registered new tserver with Master: d36a5e6a80034478ac4a2b8cbea12b86 (127.31.239.130:34347)
I20260812 08:02:35.181802  6696 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:45683
W20260812 08:02:35.288451  7059 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:35.288758  7059 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:35.288827  7059 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:35.288909  7059 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:35.292438  7059 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:35.292615  7059 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:02:35.296708  7059 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:42057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:33765
--never_fsync=true
--heap_profile_path=/tmp/kudu.7059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:35.297883  7059 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:35.299103  7059 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:35.305997  7067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:35.305982  7059 server_base.cc:1061] running on GCE node
W20260812 08:02:35.305949  7064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:35.305948  7065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:35.306770  7059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:35.307413  7059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:35.308619  7059 hybrid_clock.cc:648] HybridClock initialized: now 1786521755308604 us; error 33 us; skew 500 ppm
I20260812 08:02:35.310716  7059 webserver.cc:533] Webserver started at http://127.31.239.131:36449/ using document root <none> and password file <none>
I20260812 08:02:35.311339  7059 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:35.311434  7059 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:35.311677  7059 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:35.313326  7059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.313843  7059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.317672  7059 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:35.320240  7073 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.321347  7059 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:35.321511  7059 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.321635  7059 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:35.339934  7059 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:35.340715  7059 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:35.340934  7059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:35.341563  7059 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:35.342864  7059 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:35.342934  7059 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.343008  7059 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:35.343065  7059 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.353026  7059 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:41327
I20260812 08:02:35.353082  7198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:41327 every 8 connection(s)
I20260812 08:02:35.354111  7059 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:02:35.355546 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 7059
I20260812 08:02:35.355667 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.LeaderStepDown.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:02:35.363144  7199 heartbeater.cc:344] Connected to a master server at 127.31.239.190:33765
I20260812 08:02:35.363413  7199 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:35.363919  7199 heartbeater.cc:507] Master 127.31.239.190:33765 requested a full tablet report, sending...
I20260812 08:02:35.364951  6696 ts_manager.cc:194] Registered new tserver with Master: ae4ef129ab0a4a58b02cbf51ee6fb7d6 (127.31.239.131:41327)
I20260812 08:02:35.365531  6696 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:49443
I20260812 08:02:35.370361 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:35.380044  6696 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41512:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
W20260812 08:02:35.382553  6696 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:35.400473  6833 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4b8f8631d040fb911207d5e7f6f3d6 (DEFAULT_TABLE table=TestTable [id=ee82a8bd0b934d0b853b0763cee9e01e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:35.401003  6985 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4b8f8631d040fb911207d5e7f6f3d6 (DEFAULT_TABLE table=TestTable [id=ee82a8bd0b934d0b853b0763cee9e01e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:35.401500  6833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4b8f8631d040fb911207d5e7f6f3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:35.401280  7125 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4b8f8631d040fb911207d5e7f6f3d6 (DEFAULT_TABLE table=TestTable [id=ee82a8bd0b934d0b853b0763cee9e01e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:35.401976  6985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4b8f8631d040fb911207d5e7f6f3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:35.402108  7125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4b8f8631d040fb911207d5e7f6f3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:35.407030  7218 tablet_bootstrap.cc:492] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064: Bootstrap starting.
I20260812 08:02:35.408475  7219 tablet_bootstrap.cc:492] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6: Bootstrap starting.
I20260812 08:02:35.408475  7220 tablet_bootstrap.cc:492] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86: Bootstrap starting.
I20260812 08:02:35.409790  7218 tablet_bootstrap.cc:654] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:35.410686  7218 log.cc:826] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:35.410745  7220 tablet_bootstrap.cc:654] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:35.410748  7219 tablet_bootstrap.cc:654] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:35.411551  7220 log.cc:826] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:35.411551  7219 log.cc:826] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:35.412469  7218 tablet_bootstrap.cc:492] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064: No bootstrap required, opened a new log
I20260812 08:02:35.412684  7218 ts_tablet_manager.cc:1403] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:35.413240  7220 tablet_bootstrap.cc:492] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86: No bootstrap required, opened a new log
I20260812 08:02:35.413237  7219 tablet_bootstrap.cc:492] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6: No bootstrap required, opened a new log
I20260812 08:02:35.413425  7219 ts_tablet_manager.cc:1403] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:35.413425  7220 ts_tablet_manager.cc:1403] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:35.415669  7218 raft_consensus.cc:359] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.415927  7218 raft_consensus.cc:740] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 696c353b480e430b8a82a9de6e504064, State: Initialized, Role: FOLLOWER
I20260812 08:02:35.416291  7218 consensus_queue.cc:260] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.416555  7220 raft_consensus.cc:359] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.416555  7219 raft_consensus.cc:359] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.416797  7220 raft_consensus.cc:740] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36a5e6a80034478ac4a2b8cbea12b86, State: Initialized, Role: FOLLOWER
I20260812 08:02:35.416805  7219 raft_consensus.cc:740] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4ef129ab0a4a58b02cbf51ee6fb7d6, State: Initialized, Role: FOLLOWER
I20260812 08:02:35.417131  6912 heartbeater.cc:499] Master 127.31.239.190:33765 was elected leader, sending a full tablet report...
I20260812 08:02:35.417115  7219 consensus_queue.cc:260] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.417115  7220 consensus_queue.cc:260] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.417997  7219 ts_tablet_manager.cc:1434] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:35.418052  7056 heartbeater.cc:499] Master 127.31.239.190:33765 was elected leader, sending a full tablet report...
I20260812 08:02:35.418282  7199 heartbeater.cc:499] Master 127.31.239.190:33765 was elected leader, sending a full tablet report...
I20260812 08:02:35.418560  7218 ts_tablet_manager.cc:1434] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 08:02:35.418862  7220 ts_tablet_manager.cc:1434] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
W20260812 08:02:35.420027  7057 tablet.cc:2406] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:35.426362 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:35.427868 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 696c353b480e430b8a82a9de6e504064 to finish bootstrapping
I20260812 08:02:35.434057 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver d36a5e6a80034478ac4a2b8cbea12b86 to finish bootstrapping
I20260812 08:02:35.439841 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver ae4ef129ab0a4a58b02cbf51ee6fb7d6 to finish bootstrapping
I20260812 08:02:35.450433  7006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a4b8f8631d040fb911207d5e7f6f3d6"
dest_uuid: "d36a5e6a80034478ac4a2b8cbea12b86"
 from {username='slave'} at 127.0.0.1:51930
I20260812 08:02:35.450695  7006 raft_consensus.cc:493] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:35.450837  7006 raft_consensus.cc:3060] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:35.451872  7006 raft_consensus.cc:515] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.452986  7006 leader_election.cc:290] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [CANDIDATE]: Term 1 election: Requested vote from peers ae4ef129ab0a4a58b02cbf51ee6fb7d6 (127.31.239.131:41327), 696c353b480e430b8a82a9de6e504064 (127.31.239.129:44061)
I20260812 08:02:35.457744  7149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4b8f8631d040fb911207d5e7f6f3d6" candidate_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6"
I20260812 08:02:35.457814  6857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4b8f8631d040fb911207d5e7f6f3d6" candidate_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "696c353b480e430b8a82a9de6e504064"
I20260812 08:02:35.458006  7149 raft_consensus.cc:3060] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:35.458031  6857 raft_consensus.cc:3060] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:35.459136  7149 raft_consensus.cc:2468] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36a5e6a80034478ac4a2b8cbea12b86 in term 1.
I20260812 08:02:35.459143  6857 raft_consensus.cc:2468] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d36a5e6a80034478ac4a2b8cbea12b86 in term 1.
I20260812 08:02:35.459707  6933 leader_election.cc:304] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 696c353b480e430b8a82a9de6e504064, ae4ef129ab0a4a58b02cbf51ee6fb7d6, d36a5e6a80034478ac4a2b8cbea12b86; no voters: 
I20260812 08:02:35.460085  7225 raft_consensus.cc:2804] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:35.460354  7225 raft_consensus.cc:697] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 1 LEADER]: Becoming Leader. State: Replica: d36a5e6a80034478ac4a2b8cbea12b86, State: Running, Role: LEADER
I20260812 08:02:35.460695  7225 consensus_queue.cc:237] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.464727  6694 catalog_manager.cc:5719] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 reported cstate change: term changed from 0 to 1, leader changed from <none> to d36a5e6a80034478ac4a2b8cbea12b86 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:35.470780  6857 raft_consensus.cc:1275] T 8a4b8f8631d040fb911207d5e7f6f3d6 P 696c353b480e430b8a82a9de6e504064 [term 1 FOLLOWER]: Refusing update from remote peer d36a5e6a80034478ac4a2b8cbea12b86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:35.470803  7149 raft_consensus.cc:1275] T 8a4b8f8631d040fb911207d5e7f6f3d6 P ae4ef129ab0a4a58b02cbf51ee6fb7d6 [term 1 FOLLOWER]: Refusing update from remote peer d36a5e6a80034478ac4a2b8cbea12b86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:35.471503  7230 consensus_queue.cc:1048] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:35.471689  7225 consensus_queue.cc:1048] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:35.483186  7233 mvcc.cc:204] Tried to move back new op lower bound from 7317593110401396736 to 7317593110371094528. Current Snapshot: MvccSnapshot[applied={T|T < 7317593110401396736}]
I20260812 08:02:35.492229  7006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4b8f8631d040fb911207d5e7f6f3d6"
dest_uuid: "d36a5e6a80034478ac4a2b8cbea12b86"
 from {username='slave'} at 127.0.0.1:51930
I20260812 08:02:35.492489  7006 raft_consensus.cc:591] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 1 LEADER]: Received request to step down
I20260812 08:02:35.492573  7006 raft_consensus.cc:3055] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:35.492630  7006 raft_consensus.cc:740] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d36a5e6a80034478ac4a2b8cbea12b86, State: Running, Role: LEADER
I20260812 08:02:35.492798  7006 consensus_queue.cc:260] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d36a5e6a80034478ac4a2b8cbea12b86" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 34347 } } peers { permanent_uuid: "ae4ef129ab0a4a58b02cbf51ee6fb7d6" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 41327 } } peers { permanent_uuid: "696c353b480e430b8a82a9de6e504064" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 44061 } }
I20260812 08:02:35.493117  7006 raft_consensus.cc:3060] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:35.494961  7006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4b8f8631d040fb911207d5e7f6f3d6"
dest_uuid: "d36a5e6a80034478ac4a2b8cbea12b86"
 from {username='slave'} at 127.0.0.1:51930
I20260812 08:02:35.495187  7006 raft_consensus.cc:584] T 8a4b8f8631d040fb911207d5e7f6f3d6 P d36a5e6a80034478ac4a2b8cbea12b86 [term 2 FOLLOWER]: Rejecting request to step down while not leader
W20260812 08:02:35.496791  6960 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51930: Illegal state: replica d36a5e6a80034478ac4a2b8cbea12b86 is not leader of this config: current role FOLLOWER
I20260812 08:02:35.497758 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 6764
I20260812 08:02:35.508711 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 6915
I20260812 08:02:35.518502 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 7059
I20260812 08:02:35.528014 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 6661
2026-08-12T08:02:35Z chronyd exiting
[       OK ] RaftConsensusElectionITest.LeaderStepDown (970 ms)
[ RUN      ] RaftConsensusElectionITest.StepDownWithSlowFollower
I20260812 08:02:35.555105 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:35.555179 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:35.555199 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:02:35.555219 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:02:35.555245 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:35Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:35Z Disabled control of system clock
I20260812 08:02:35.564900 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:36997
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:36997
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:02:35.672413  7251 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:35.672717  7251 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:35.672796  7251 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:35.676317  7251 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:35.676437  7251 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:35.676477  7251 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:35.676517  7251 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:35.680892  7251 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:36997
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:36997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:35.682252  7251 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:35.683398  7251 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:35.689216  7258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:35.689260  7263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:35.689298  7261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:35.689662  7251 server_base.cc:1061] running on GCE node
I20260812 08:02:35.690321  7251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:35.691323  7251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:35.692546  7251 hybrid_clock.cc:648] HybridClock initialized: now 1786521755692546 us; error 42 us; skew 500 ppm
I20260812 08:02:35.694571  7251 webserver.cc:533] Webserver started at http://127.31.239.190:42689/ using document root <none> and password file <none>
I20260812 08:02:35.695168  7251 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:35.695255  7251 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:35.695495  7251 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:35.697072  7251 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "a17c3e7c244241feab58fa670cc5d594"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.697566  7251 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "a17c3e7c244241feab58fa670cc5d594"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.701122  7251 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:02:35.703541  7269 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.704841  7251 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:35.704990  7251 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "a17c3e7c244241feab58fa670cc5d594"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.705106  7251 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:35.731299  7251 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:35.732049  7251 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:35.732272  7251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:35.740695  7325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:36997 every 8 connection(s)
I20260812 08:02:35.740706  7251 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:36997
I20260812 08:02:35.741871  7251 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:35.744927  7326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:35.750031  7326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594: Bootstrap starting.
I20260812 08:02:35.751099 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 7251
I20260812 08:02:35.751217 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:35.752844  7326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:35.753623  7326 log.cc:826] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:35.755803  7326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594: No bootstrap required, opened a new log
I20260812 08:02:35.759235  7326 raft_consensus.cc:359] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a17c3e7c244241feab58fa670cc5d594" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36997 } }
I20260812 08:02:35.759471  7326 raft_consensus.cc:385] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:35.759558  7326 raft_consensus.cc:740] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a17c3e7c244241feab58fa670cc5d594, State: Initialized, Role: FOLLOWER
I20260812 08:02:35.760067  7326 consensus_queue.cc:260] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a17c3e7c244241feab58fa670cc5d594" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36997 } }
I20260812 08:02:35.760239  7326 raft_consensus.cc:399] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:35.760311  7326 raft_consensus.cc:493] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:35.760424  7326 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:35.761569  7326 raft_consensus.cc:515] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a17c3e7c244241feab58fa670cc5d594" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36997 } }
I20260812 08:02:35.761919  7326 leader_election.cc:304] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a17c3e7c244241feab58fa670cc5d594; no voters: 
I20260812 08:02:35.762274  7326 leader_election.cc:290] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:35.762399  7332 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:35.762660  7332 raft_consensus.cc:697] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [term 1 LEADER]: Becoming Leader. State: Replica: a17c3e7c244241feab58fa670cc5d594, State: Running, Role: LEADER
I20260812 08:02:35.762972  7332 consensus_queue.cc:237] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a17c3e7c244241feab58fa670cc5d594" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36997 } }
I20260812 08:02:35.763506  7326 sys_catalog.cc:565] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:35.764650  7334 sys_catalog.cc:455] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a17c3e7c244241feab58fa670cc5d594. Latest consensus state: current_term: 1 leader_uuid: "a17c3e7c244241feab58fa670cc5d594" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a17c3e7c244241feab58fa670cc5d594" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36997 } } }
I20260812 08:02:35.764794  7334 sys_catalog.cc:458] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:35.765179  7341 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:35.765261  7333 sys_catalog.cc:455] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a17c3e7c244241feab58fa670cc5d594" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a17c3e7c244241feab58fa670cc5d594" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36997 } } }
I20260812 08:02:35.765374  7333 sys_catalog.cc:458] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:35.768416  7341 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:35.773974  7341 catalog_manager.cc:1383] Generated new cluster ID: 5e35aa1edc7c4339abce06a3ec5bfdc1
I20260812 08:02:35.774066  7341 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:35.793254  7341 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:35.794268  7341 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:35.806420  7341 catalog_manager.cc:6092] T 00000000000000000000000000000000 P a17c3e7c244241feab58fa670cc5d594: Generated new TSK 0
I20260812 08:02:35.807161  7341 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:35.820430 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:36997
--builtin_ntp_servers=127.31.239.148:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=15000 with env {}
W20260812 08:02:35.935474  7351 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:35.935791  7351 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:35.935864  7351 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:35.935971  7351 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:35.939736  7351 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:35.939953  7351 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:35.944268  7351 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=15000
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:36997
--never_fsync=true
--heap_profile_path=/tmp/kudu.7351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:35.945552  7351 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:35.946928  7351 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:35.954339  7359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:35.954377  7351 server_base.cc:1061] running on GCE node
W20260812 08:02:35.954293  7357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:35.954300  7356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:35.955099  7351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:35.955763  7351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:35.956990  7351 hybrid_clock.cc:648] HybridClock initialized: now 1786521755956970 us; error 45 us; skew 500 ppm
I20260812 08:02:35.959398  7351 webserver.cc:533] Webserver started at http://127.31.239.129:44759/ using document root <none> and password file <none>
I20260812 08:02:35.960115  7351 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:35.960220  7351 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:35.960484  7351 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:35.962437  7351 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "68d9173ead9140aeaec3b5fdb62fa014"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.963018  7351 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "68d9173ead9140aeaec3b5fdb62fa014"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.967247  7351 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260812 08:02:35.969872  7365 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.971073  7351 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:35.971231  7351 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "68d9173ead9140aeaec3b5fdb62fa014"
format_stamp: "Formatted at 2026-08-12 08:02:35 on dist-test-slave-9jjr"
I20260812 08:02:35.971366  7351 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:35.989663  7351 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:35.990497  7351 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:35.990751  7351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:35.991408  7351 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:35.992559  7351 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:35.992651  7351 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:35.992741  7351 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:35.992794  7351 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:36.004024  7351 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:45647
I20260812 08:02:36.004050  7494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:45647 every 8 connection(s)
I20260812 08:02:36.005110  7351 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:36.007978 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 7351
I20260812 08:02:36.008111 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:36.010679 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:36997
--builtin_ntp_servers=127.31.239.148:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=15000 with env {}
I20260812 08:02:36.015434  7495 heartbeater.cc:344] Connected to a master server at 127.31.239.190:36997
I20260812 08:02:36.015743  7495 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:36.016336  7495 heartbeater.cc:507] Master 127.31.239.190:36997 requested a full tablet report, sending...
I20260812 08:02:36.018280  7285 ts_manager.cc:194] Registered new tserver with Master: 68d9173ead9140aeaec3b5fdb62fa014 (127.31.239.129:45647)
I20260812 08:02:36.020134  7285 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:44865
W20260812 08:02:36.126401  7498 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:36.126677  7498 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:36.126701  7498 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:36.126749  7498 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:36.130694  7498 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:36.130843  7498 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:36.136487  7498 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=15000
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:36997
--never_fsync=true
--heap_profile_path=/tmp/kudu.7498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:36.137789  7498 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:36.138973  7498 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:36.145864  7504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:36.145834  7503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:36.145809  7506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:36.146255  7498 server_base.cc:1061] running on GCE node
I20260812 08:02:36.146715  7498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:36.147409  7498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:36.148664  7498 hybrid_clock.cc:648] HybridClock initialized: now 1786521756148642 us; error 40 us; skew 500 ppm
I20260812 08:02:36.150913  7498 webserver.cc:533] Webserver started at http://127.31.239.130:39811/ using document root <none> and password file <none>
I20260812 08:02:36.151582  7498 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:36.151683  7498 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:36.151921  7498 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:36.153757  7498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "474904b9cb564e4c9e68c67ea37d6fdf"
format_stamp: "Formatted at 2026-08-12 08:02:36 on dist-test-slave-9jjr"
I20260812 08:02:36.154348  7498 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "474904b9cb564e4c9e68c67ea37d6fdf"
format_stamp: "Formatted at 2026-08-12 08:02:36 on dist-test-slave-9jjr"
I20260812 08:02:36.158259  7498 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260812 08:02:36.160997  7513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:36.162326  7498 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260812 08:02:36.162488  7498 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "474904b9cb564e4c9e68c67ea37d6fdf"
format_stamp: "Formatted at 2026-08-12 08:02:36 on dist-test-slave-9jjr"
I20260812 08:02:36.162616  7498 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:36.179811  7498 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:36.180583  7498 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:36.180815  7498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:36.181457  7498 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:36.182567  7498 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:36.182650  7498 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:36.182724  7498 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:36.182772  7498 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:36.193334  7498 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:33503
I20260812 08:02:36.193408  7634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:33503 every 8 connection(s)
I20260812 08:02:36.194407  7498 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:36.198766 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 7498
I20260812 08:02:36.198942 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:02:36.201324 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:36997
--builtin_ntp_servers=127.31.239.148:34165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--consensus_rpc_timeout_ms=15000 with env {}
I20260812 08:02:36.204074  7635 heartbeater.cc:344] Connected to a master server at 127.31.239.190:36997
I20260812 08:02:36.204348  7635 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:36.204913  7635 heartbeater.cc:507] Master 127.31.239.190:36997 requested a full tablet report, sending...
I20260812 08:02:36.206168  7285 ts_manager.cc:194] Registered new tserver with Master: 474904b9cb564e4c9e68c67ea37d6fdf (127.31.239.130:33503)
I20260812 08:02:36.206797  7285 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:39515
W20260812 08:02:36.315075  7638 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:36.315339  7638 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:36.315387  7638 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:36.315479  7638 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:36.319222  7638 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:36.319380  7638 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:02:36.323643  7638 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:34165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_rpc_timeout_ms=15000
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:36997
--never_fsync=true
--heap_profile_path=/tmp/kudu.7638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:36.324877  7638 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:36.326087  7638 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:36.333304  7644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:36.333397  7638 server_base.cc:1061] running on GCE node
W20260812 08:02:36.333307  7645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:36.333307  7649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:36.334010  7638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:36.334666  7638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:36.337975  7638 hybrid_clock.cc:648] HybridClock initialized: now 1786521756337938 us; error 44 us; skew 500 ppm
I20260812 08:02:36.340083  7638 webserver.cc:533] Webserver started at http://127.31.239.131:45017/ using document root <none> and password file <none>
I20260812 08:02:36.340708  7638 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:36.340797  7638 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:36.341028  7638 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:36.342730  7638 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "b23162338c674e5eb1f510b5020ee207"
format_stamp: "Formatted at 2026-08-12 08:02:36 on dist-test-slave-9jjr"
I20260812 08:02:36.343258  7638 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "b23162338c674e5eb1f510b5020ee207"
format_stamp: "Formatted at 2026-08-12 08:02:36 on dist-test-slave-9jjr"
I20260812 08:02:36.347218  7638 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260812 08:02:36.349691  7655 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:36.350862  7638 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:36.351001  7638 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "b23162338c674e5eb1f510b5020ee207"
format_stamp: "Formatted at 2026-08-12 08:02:36 on dist-test-slave-9jjr"
I20260812 08:02:36.351112  7638 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:36.370558  7638 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:36.371357  7638 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:36.371577  7638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:36.372205  7638 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:36.373279  7638 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:36.373369  7638 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:36.373445  7638 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:36.373478  7638 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:36.383791  7638 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:45757
I20260812 08:02:36.383821  7787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:45757 every 8 connection(s)
I20260812 08:02:36.384820  7638 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:02:36.389128 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 7638
I20260812 08:02:36.389245 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.StepDownWithSlowFollower.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:02:36.394003  7788 heartbeater.cc:344] Connected to a master server at 127.31.239.190:36997
I20260812 08:02:36.394308  7788 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:36.394815  7788 heartbeater.cc:507] Master 127.31.239.190:36997 requested a full tablet report, sending...
I20260812 08:02:36.395807  7285 ts_manager.cc:194] Registered new tserver with Master: b23162338c674e5eb1f510b5020ee207 (127.31.239.131:45757)
I20260812 08:02:36.396325  7285 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:55827
I20260812 08:02:36.404378 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:36.414387  7285 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43900:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
W20260812 08:02:36.416811  7285 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:36.435428  7565 tablet_service.cc:1511] Processing CreateTablet for tablet def3a8f85cb944fab30983b57b1b89cc (DEFAULT_TABLE table=TestTable [id=7b025f91ae104897b0cacf8921a65d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:36.435431  7421 tablet_service.cc:1511] Processing CreateTablet for tablet def3a8f85cb944fab30983b57b1b89cc (DEFAULT_TABLE table=TestTable [id=7b025f91ae104897b0cacf8921a65d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:36.435437  7713 tablet_service.cc:1511] Processing CreateTablet for tablet def3a8f85cb944fab30983b57b1b89cc (DEFAULT_TABLE table=TestTable [id=7b025f91ae104897b0cacf8921a65d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:36.436417  7565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def3a8f85cb944fab30983b57b1b89cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:36.436426  7713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def3a8f85cb944fab30983b57b1b89cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:36.436426  7421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def3a8f85cb944fab30983b57b1b89cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:36.441905  7807 tablet_bootstrap.cc:492] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf: Bootstrap starting.
I20260812 08:02:36.443473  7808 tablet_bootstrap.cc:492] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014: Bootstrap starting.
I20260812 08:02:36.443951  7809 tablet_bootstrap.cc:492] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207: Bootstrap starting.
I20260812 08:02:36.445209  7807 tablet_bootstrap.cc:654] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:36.446161  7807 log.cc:826] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:36.446228  7809 tablet_bootstrap.cc:654] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:36.447013  7809 log.cc:826] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:36.448284  7807 tablet_bootstrap.cc:492] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf: No bootstrap required, opened a new log
I20260812 08:02:36.448479  7808 tablet_bootstrap.cc:654] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:36.448498  7807 ts_tablet_manager.cc:1403] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf: Time spent bootstrapping tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 08:02:36.448944  7809 tablet_bootstrap.cc:492] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207: No bootstrap required, opened a new log
I20260812 08:02:36.449188  7809 ts_tablet_manager.cc:1403] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.005s
I20260812 08:02:36.449309  7808 log.cc:826] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:36.451020  7808 tablet_bootstrap.cc:492] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014: No bootstrap required, opened a new log
I20260812 08:02:36.451241  7808 ts_tablet_manager.cc:1403] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014: Time spent bootstrapping tablet: real 0.008s	user 0.004s	sys 0.000s
I20260812 08:02:36.452401  7809 raft_consensus.cc:359] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
I20260812 08:02:36.452404  7807 raft_consensus.cc:359] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
I20260812 08:02:36.452656  7809 raft_consensus.cc:740] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b23162338c674e5eb1f510b5020ee207, State: Initialized, Role: FOLLOWER
I20260812 08:02:36.452656  7807 raft_consensus.cc:740] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 474904b9cb564e4c9e68c67ea37d6fdf, State: Initialized, Role: FOLLOWER
I20260812 08:02:36.453007  7809 consensus_queue.cc:260] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
I20260812 08:02:36.453007  7807 consensus_queue.cc:260] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
I20260812 08:02:36.453982  7809 ts_tablet_manager.cc:1434] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:36.453982  7807 ts_tablet_manager.cc:1434] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260812 08:02:36.454078  7788 heartbeater.cc:499] Master 127.31.239.190:36997 was elected leader, sending a full tablet report...
I20260812 08:02:36.453984  7808 raft_consensus.cc:359] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
I20260812 08:02:36.454237  7808 raft_consensus.cc:740] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68d9173ead9140aeaec3b5fdb62fa014, State: Initialized, Role: FOLLOWER
I20260812 08:02:36.454445  7635 heartbeater.cc:499] Master 127.31.239.190:36997 was elected leader, sending a full tablet report...
I20260812 08:02:36.454551  7808 consensus_queue.cc:260] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
I20260812 08:02:36.455435  7808 ts_tablet_manager.cc:1434] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:36.455627  7495 heartbeater.cc:499] Master 127.31.239.190:36997 was elected leader, sending a full tablet report...
I20260812 08:02:36.470194 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:36.471832 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 68d9173ead9140aeaec3b5fdb62fa014 to finish bootstrapping
I20260812 08:02:36.478277 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 474904b9cb564e4c9e68c67ea37d6fdf to finish bootstrapping
I20260812 08:02:36.484477 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver b23162338c674e5eb1f510b5020ee207 to finish bootstrapping
I20260812 08:02:36.495316  7442 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "def3a8f85cb944fab30983b57b1b89cc"
dest_uuid: "68d9173ead9140aeaec3b5fdb62fa014"
 from {username='slave'} at 127.0.0.1:58776
I20260812 08:02:36.495854  7442 raft_consensus.cc:493] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:36.495954  7442 raft_consensus.cc:3060] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:36.496915  7442 raft_consensus.cc:515] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
I20260812 08:02:36.498003  7442 leader_election.cc:290] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [CANDIDATE]: Term 1 election: Requested vote from peers 474904b9cb564e4c9e68c67ea37d6fdf (127.31.239.130:33503), b23162338c674e5eb1f510b5020ee207 (127.31.239.131:45757)
I20260812 08:02:36.502540  7586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3a8f85cb944fab30983b57b1b89cc" candidate_uuid: "68d9173ead9140aeaec3b5fdb62fa014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "474904b9cb564e4c9e68c67ea37d6fdf"
I20260812 08:02:36.502622  7735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def3a8f85cb944fab30983b57b1b89cc" candidate_uuid: "68d9173ead9140aeaec3b5fdb62fa014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b23162338c674e5eb1f510b5020ee207"
I20260812 08:02:36.502825  7735 raft_consensus.cc:3060] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:36.502825  7586 raft_consensus.cc:3060] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:36.504102  7735 raft_consensus.cc:2468] T def3a8f85cb944fab30983b57b1b89cc P b23162338c674e5eb1f510b5020ee207 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68d9173ead9140aeaec3b5fdb62fa014 in term 1.
I20260812 08:02:36.504101  7586 raft_consensus.cc:2468] T def3a8f85cb944fab30983b57b1b89cc P 474904b9cb564e4c9e68c67ea37d6fdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68d9173ead9140aeaec3b5fdb62fa014 in term 1.
I20260812 08:02:36.504712  7366 leader_election.cc:304] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68d9173ead9140aeaec3b5fdb62fa014, b23162338c674e5eb1f510b5020ee207; no voters: 
I20260812 08:02:36.505080  7816 raft_consensus.cc:2804] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:36.505342  7816 raft_consensus.cc:697] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 1 LEADER]: Becoming Leader. State: Replica: 68d9173ead9140aeaec3b5fdb62fa014, State: Running, Role: LEADER
I20260812 08:02:36.505702  7816 consensus_queue.cc:237] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
W20260812 08:02:36.506287  7496 tablet.cc:2406] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:36.509529  7284 catalog_manager.cc:5719] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68d9173ead9140aeaec3b5fdb62fa014 (127.31.239.129). New cstate: current_term: 1 leader_uuid: "68d9173ead9140aeaec3b5fdb62fa014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:37.533392  7442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "def3a8f85cb944fab30983b57b1b89cc"
dest_uuid: "68d9173ead9140aeaec3b5fdb62fa014"
 from {username='slave'} at 127.0.0.1:58776
I20260812 08:02:37.533749  7442 raft_consensus.cc:591] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 1 LEADER]: Received request to step down
I20260812 08:02:37.533826  7442 raft_consensus.cc:3055] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:37.533855  7442 raft_consensus.cc:740] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68d9173ead9140aeaec3b5fdb62fa014, State: Running, Role: LEADER
I20260812 08:02:37.534024  7442 consensus_queue.cc:260] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "474904b9cb564e4c9e68c67ea37d6fdf" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 33503 } } peers { permanent_uuid: "b23162338c674e5eb1f510b5020ee207" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 45757 } } peers { permanent_uuid: "68d9173ead9140aeaec3b5fdb62fa014" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 45647 } }
I20260812 08:02:37.534262  7442 raft_consensus.cc:3060] T def3a8f85cb944fab30983b57b1b89cc P 68d9173ead9140aeaec3b5fdb62fa014 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:37.535262 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 7351
I20260812 08:02:37.545657 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 7498
I20260812 08:02:37.554755 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 7638
I20260812 08:02:37.563371 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 7251
2026-08-12T08:02:37Z chronyd exiting
[       OK ] RaftConsensusElectionITest.StepDownWithSlowFollower (2034 ms)
[ RUN      ] RaftConsensusElectionITest.ElectPendingVoter
I20260812 08:02:37.589448 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:37.589499 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:37.589511 32702 ts_itest-base.cc:117] 5 tablet servers
I20260812 08:02:37.589521 32702 ts_itest-base.cc:118] 5 replicas per TS
I20260812 08:02:37.589532 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:37Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:37Z Disabled control of system clock
I20260812 08:02:37.599483 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:43207
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:41735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:43207
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:02:37.709674  7833 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:37.709978  7833 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:37.710062  7833 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:37.713579  7833 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:37.713701  7833 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:37.713740  7833 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:37.713781  7833 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:37.718250  7833 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:43207
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:43207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:37.719501  7833 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:37.720705  7833 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:37.726878  7838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:37.726869  7842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:37.727070  7833 server_base.cc:1061] running on GCE node
W20260812 08:02:37.726869  7839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:37.727804  7833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:37.728724  7833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:37.729907  7833 hybrid_clock.cc:648] HybridClock initialized: now 1786521757729889 us; error 32 us; skew 500 ppm
I20260812 08:02:37.732093  7833 webserver.cc:533] Webserver started at http://127.31.239.190:45271/ using document root <none> and password file <none>
I20260812 08:02:37.732733  7833 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:37.732797  7833 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:37.733009  7833 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:37.734740  7833 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "c57ed37aed8242fc884d71d8f71d78d7"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-9jjr"
I20260812 08:02:37.735298  7833 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "c57ed37aed8242fc884d71d8f71d78d7"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-9jjr"
I20260812 08:02:37.738886  7833 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:37.741387  7851 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:37.742619  7833 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:37.742765  7833 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "c57ed37aed8242fc884d71d8f71d78d7"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-9jjr"
I20260812 08:02:37.742875  7833 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:37.757272  7833 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:37.757993  7833 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:37.758261  7833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:37.766688  7833 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:43207
I20260812 08:02:37.766688  7912 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:43207 every 8 connection(s)
I20260812 08:02:37.768049  7833 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:37.771260  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:37.775944 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 7833
I20260812 08:02:37.776082 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:37.776889  7913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7: Bootstrap starting.
I20260812 08:02:37.779389  7913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:37.780460  7913 log.cc:826] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:37.782661  7913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7: No bootstrap required, opened a new log
I20260812 08:02:37.785626  7913 raft_consensus.cc:359] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57ed37aed8242fc884d71d8f71d78d7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 43207 } }
I20260812 08:02:37.785832  7913 raft_consensus.cc:385] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:37.785869  7913 raft_consensus.cc:740] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c57ed37aed8242fc884d71d8f71d78d7, State: Initialized, Role: FOLLOWER
I20260812 08:02:37.786434  7913 consensus_queue.cc:260] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57ed37aed8242fc884d71d8f71d78d7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 43207 } }
I20260812 08:02:37.786607  7913 raft_consensus.cc:399] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:37.786700  7913 raft_consensus.cc:493] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:37.786837  7913 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:37.787715  7913 raft_consensus.cc:515] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57ed37aed8242fc884d71d8f71d78d7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 43207 } }
I20260812 08:02:37.788096  7913 leader_election.cc:304] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c57ed37aed8242fc884d71d8f71d78d7; no voters: 
I20260812 08:02:37.788445  7913 leader_election.cc:290] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:37.788600  7918 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:37.789341  7918 raft_consensus.cc:697] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [term 1 LEADER]: Becoming Leader. State: Replica: c57ed37aed8242fc884d71d8f71d78d7, State: Running, Role: LEADER
I20260812 08:02:37.789731  7913 sys_catalog.cc:565] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:37.789844  7918 consensus_queue.cc:237] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57ed37aed8242fc884d71d8f71d78d7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 43207 } }
I20260812 08:02:37.791684  7920 sys_catalog.cc:455] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c57ed37aed8242fc884d71d8f71d78d7. Latest consensus state: current_term: 1 leader_uuid: "c57ed37aed8242fc884d71d8f71d78d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57ed37aed8242fc884d71d8f71d78d7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 43207 } } }
I20260812 08:02:37.791718  7919 sys_catalog.cc:455] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c57ed37aed8242fc884d71d8f71d78d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c57ed37aed8242fc884d71d8f71d78d7" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 43207 } } }
I20260812 08:02:37.791849  7919 sys_catalog.cc:458] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:37.791849  7920 sys_catalog.cc:458] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:37.792994  7932 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:37.795852  7932 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:37.801522  7932 catalog_manager.cc:1383] Generated new cluster ID: e4bec66f4c6e4819aa5e69d736c490f4
I20260812 08:02:37.801620  7932 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:37.811764  7932 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:37.812983  7932 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:37.824177  7932 catalog_manager.cc:6092] T 00000000000000000000000000000000 P c57ed37aed8242fc884d71d8f71d78d7: Generated new TSK 0
I20260812 08:02:37.825031  7932 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:37.836544 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--builtin_ntp_servers=127.31.239.148:41735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:02:37.949503  7939 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:37.949743  7939 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:37.949764  7939 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:37.949854  7939 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:37.953425  7939 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:37.953542  7939 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:37.957576  7939 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--never_fsync=true
--heap_profile_path=/tmp/kudu.7939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:37.958822  7939 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:37.960034  7939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:37.966766  7946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:37.966764  7947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:37.966766  7949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:37.967124  7939 server_base.cc:1061] running on GCE node
I20260812 08:02:37.967567  7939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:37.968230  7939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:37.969436  7939 hybrid_clock.cc:648] HybridClock initialized: now 1786521757969426 us; error 31 us; skew 500 ppm
I20260812 08:02:37.971504  7939 webserver.cc:533] Webserver started at http://127.31.239.129:44409/ using document root <none> and password file <none>
I20260812 08:02:37.972114  7939 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:37.972211  7939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:37.972446  7939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:37.974248  7939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "50d0634a93164b219b1a26c0fe866fee"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-9jjr"
I20260812 08:02:37.974773  7939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "50d0634a93164b219b1a26c0fe866fee"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-9jjr"
I20260812 08:02:37.978437  7939 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:37.980855  7956 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:37.981940  7939 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:37.982082  7939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "50d0634a93164b219b1a26c0fe866fee"
format_stamp: "Formatted at 2026-08-12 08:02:37 on dist-test-slave-9jjr"
I20260812 08:02:37.982280  7939 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:37.992461  7939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:37.993126  7939 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:37.993359  7939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:37.994004  7939 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:37.995060  7939 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:37.995108  7939 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:37.995149  7939 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:37.995165  7939 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.005525  7939 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:46371
I20260812 08:02:38.005550  8090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:46371 every 8 connection(s)
I20260812 08:02:38.006702  7939 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:38.014003 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 7939
I20260812 08:02:38.014182 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:38.016647  8091 heartbeater.cc:344] Connected to a master server at 127.31.239.190:43207
I20260812 08:02:38.016937  8091 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.017072 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--builtin_ntp_servers=127.31.239.148:41735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:02:38.017562  8091 heartbeater.cc:507] Master 127.31.239.190:43207 requested a full tablet report, sending...
I20260812 08:02:38.019328  7875 ts_manager.cc:194] Registered new tserver with Master: 50d0634a93164b219b1a26c0fe866fee (127.31.239.129:46371)
I20260812 08:02:38.021123  7875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:39917
W20260812 08:02:38.139048  8095 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:38.139413  8095 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:38.139464  8095 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:38.139549  8095 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:38.144876  8095 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:38.145089  8095 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:38.150310  8095 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--never_fsync=true
--heap_profile_path=/tmp/kudu.8095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:38.152274  8095 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:38.153875  8095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:38.162374  8104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.162576  8095 server_base.cc:1061] running on GCE node
W20260812 08:02:38.162374  8107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.162374  8102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.163154  8095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:38.163738  8095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:38.164952  8095 hybrid_clock.cc:648] HybridClock initialized: now 1786521758164925 us; error 48 us; skew 500 ppm
I20260812 08:02:38.167191  8095 webserver.cc:533] Webserver started at http://127.31.239.130:45665/ using document root <none> and password file <none>
I20260812 08:02:38.167798  8095 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:38.167886  8095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:38.168092  8095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:38.169674  8095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "6abe9e66218746fc8ef2d4531e2f97f0"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.170233  8095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "6abe9e66218746fc8ef2d4531e2f97f0"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.173707  8095 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:02:38.176333  8114 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.177399  8095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:38.177548  8095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "6abe9e66218746fc8ef2d4531e2f97f0"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.177670  8095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:38.187884  8095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:38.188632  8095 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:38.188850  8095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:38.189471  8095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:38.190775  8095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:38.190847  8095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.190923  8095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:38.190964  8095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.201185  8095 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:37031
I20260812 08:02:38.201210  8246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:37031 every 8 connection(s)
I20260812 08:02:38.202360  8095 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:38.205155 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 8095
I20260812 08:02:38.205297 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:02:38.208389 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--builtin_ntp_servers=127.31.239.148:41735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:02:38.212404  8247 heartbeater.cc:344] Connected to a master server at 127.31.239.190:43207
I20260812 08:02:38.212713  8247 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.213441  8247 heartbeater.cc:507] Master 127.31.239.190:43207 requested a full tablet report, sending...
I20260812 08:02:38.214819  7875 ts_manager.cc:194] Registered new tserver with Master: 6abe9e66218746fc8ef2d4531e2f97f0 (127.31.239.130:37031)
I20260812 08:02:38.215448  7875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:57831
W20260812 08:02:38.320585  8250 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:38.320847  8250 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:38.320868  8250 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:38.320967  8250 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:38.324687  8250 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:38.324813  8250 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:02:38.329083  8250 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--never_fsync=true
--heap_profile_path=/tmp/kudu.8250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:38.330415  8250 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:38.331576  8250 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:38.338409  8257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.338480  8250 server_base.cc:1061] running on GCE node
W20260812 08:02:38.338428  8256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.338418  8259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.339193  8250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:38.339818  8250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:38.340998  8250 hybrid_clock.cc:648] HybridClock initialized: now 1786521758340983 us; error 32 us; skew 500 ppm
I20260812 08:02:38.342947  8250 webserver.cc:533] Webserver started at http://127.31.239.131:46173/ using document root <none> and password file <none>
I20260812 08:02:38.343564  8250 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:38.343650  8250 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:38.343879  8250 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:38.345492  8250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "367fc6cd2fc3430f812c5eb7383ac742"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.346021  8250 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "367fc6cd2fc3430f812c5eb7383ac742"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.349586  8250 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:38.351987  8269 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.353153  8250 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:38.353291  8250 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "367fc6cd2fc3430f812c5eb7383ac742"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.353401  8250 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:38.375344  8250 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:38.376075  8250 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:38.376289  8250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:38.376899  8250 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:38.377972  8250 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:38.378046  8250 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.378115  8250 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:38.378185  8250 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260812 08:02:38.388597  8250 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:38191
I20260812 08:02:38.388676  8396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:38191 every 8 connection(s)
I20260812 08:02:38.389669  8250 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:02:38.396587 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 8250
I20260812 08:02:38.396746 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:02:38.398631  8397 heartbeater.cc:344] Connected to a master server at 127.31.239.190:43207
I20260812 08:02:38.398922  8397 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.399389 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.132:0
--local_ip_for_outbound_sockets=127.31.239.132
--webserver_interface=127.31.239.132
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--builtin_ntp_servers=127.31.239.148:41735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:02:38.399477  8397 heartbeater.cc:507] Master 127.31.239.190:43207 requested a full tablet report, sending...
I20260812 08:02:38.400683  7875 ts_manager.cc:194] Registered new tserver with Master: 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131:38191)
I20260812 08:02:38.401273  7875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:58795
W20260812 08:02:38.509744  8401 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:38.509999  8401 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:38.510020  8401 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:38.510061  8401 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:38.513466  8401 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:38.513587  8401 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.132
I20260812 08:02:38.517680  8401 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.31.239.132
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--never_fsync=true
--heap_profile_path=/tmp/kudu.8401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.132

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:38.518862  8401 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:38.519991  8401 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:38.527454  8409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.527520  8407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.527484  8406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.528059  8401 server_base.cc:1061] running on GCE node
I20260812 08:02:38.528548  8401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:38.529277  8401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:38.530474  8401 hybrid_clock.cc:648] HybridClock initialized: now 1786521758530448 us; error 40 us; skew 500 ppm
I20260812 08:02:38.532897  8401 webserver.cc:533] Webserver started at http://127.31.239.132:33339/ using document root <none> and password file <none>
I20260812 08:02:38.533550  8401 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:38.533643  8401 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:38.533874  8401 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:38.536039  8401 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "63886079289b42c1a995ffbc1cd3196c"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.536641  8401 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "63886079289b42c1a995ffbc1cd3196c"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.540519  8401 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:38.543546  8415 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.545118  8401 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:38.545270  8401 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "63886079289b42c1a995ffbc1cd3196c"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.545416  8401 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:38.559481  8401 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:38.560235  8401 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:38.560453  8401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:38.561117  8401 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:38.562304  8401 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:38.562361  8401 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.562403  8401 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:38.562458  8401 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.572791  8401 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.132:37061
I20260812 08:02:38.572868  8550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.132:37061 every 8 connection(s)
I20260812 08:02:38.573881  8401 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20260812 08:02:38.577486 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 8401
I20260812 08:02:38.577638 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20260812 08:02:38.580336 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.133:0
--local_ip_for_outbound_sockets=127.31.239.133
--webserver_interface=127.31.239.133
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--builtin_ntp_servers=127.31.239.148:41735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:02:38.584636  8551 heartbeater.cc:344] Connected to a master server at 127.31.239.190:43207
I20260812 08:02:38.584946  8551 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.585604  8551 heartbeater.cc:507] Master 127.31.239.190:43207 requested a full tablet report, sending...
I20260812 08:02:38.586972  7875 ts_manager.cc:194] Registered new tserver with Master: 63886079289b42c1a995ffbc1cd3196c (127.31.239.132:37061)
I20260812 08:02:38.587698  7875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.132:33207
W20260812 08:02:38.697134  8554 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:38.697438  8554 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:38.697510  8554 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:38.697589  8554 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:38.701205  8554 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:38.701404  8554 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.133
I20260812 08:02:38.705621  8554 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:41735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.31.239.133
--webserver_port=0
--tserver_master_addrs=127.31.239.190:43207
--never_fsync=true
--heap_profile_path=/tmp/kudu.8554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.133

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:38.706938  8554 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:38.708153  8554 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:38.715078  8560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.715078  8562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:38.715128  8559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:38.715482  8554 server_base.cc:1061] running on GCE node
I20260812 08:02:38.715958  8554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:38.716619  8554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:38.717855  8554 hybrid_clock.cc:648] HybridClock initialized: now 1786521758717826 us; error 48 us; skew 500 ppm
I20260812 08:02:38.720084  8554 webserver.cc:533] Webserver started at http://127.31.239.133:38467/ using document root <none> and password file <none>
I20260812 08:02:38.720749  8554 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:38.720865  8554 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:38.721084  8554 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:38.722930  8554 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "9e0639ccbaf2451dab5028d002c0d3fc"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.723505  8554 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "9e0639ccbaf2451dab5028d002c0d3fc"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.728032  8554 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:38.730921  8571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.732206  8554 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:38.732384  8554 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "9e0639ccbaf2451dab5028d002c0d3fc"
format_stamp: "Formatted at 2026-08-12 08:02:38 on dist-test-slave-9jjr"
I20260812 08:02:38.732519  8554 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:38.752876  8554 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:38.753665  8554 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:38.753907  8554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:38.754594  8554 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:38.755824  8554 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:38.755904  8554 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.755980  8554 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:38.756038  8554 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:38.766708  8554 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.133:36773
I20260812 08:02:38.766814  8701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.133:36773 every 8 connection(s)
I20260812 08:02:38.767846  8554 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20260812 08:02:38.768707 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 8554
I20260812 08:02:38.768837 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.ElectPendingVoter.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20260812 08:02:38.777486  8702 heartbeater.cc:344] Connected to a master server at 127.31.239.190:43207
I20260812 08:02:38.777788  8702 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:38.778438  8702 heartbeater.cc:507] Master 127.31.239.190:43207 requested a full tablet report, sending...
I20260812 08:02:38.779549  7875 ts_manager.cc:194] Registered new tserver with Master: 9e0639ccbaf2451dab5028d002c0d3fc (127.31.239.133:36773)
I20260812 08:02:38.780104  7875 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.133:43557
I20260812 08:02:38.783838 32702 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260812 08:02:38.794837  7875 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49382:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
W20260812 08:02:38.797406  7875 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers.
I20260812 08:02:38.816890  8627 tablet_service.cc:1511] Processing CreateTablet for tablet e88e8870cf944d04ae545b794637b1a4 (DEFAULT_TABLE table=TestTable [id=5f38476880b04b4a88b44ec29adc68d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:38.817191  8321 tablet_service.cc:1511] Processing CreateTablet for tablet e88e8870cf944d04ae545b794637b1a4 (DEFAULT_TABLE table=TestTable [id=5f38476880b04b4a88b44ec29adc68d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:38.818008  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88e8870cf944d04ae545b794637b1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:38.818008  8627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88e8870cf944d04ae545b794637b1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:38.820155  8013 tablet_service.cc:1511] Processing CreateTablet for tablet e88e8870cf944d04ae545b794637b1a4 (DEFAULT_TABLE table=TestTable [id=5f38476880b04b4a88b44ec29adc68d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:38.820780  8472 tablet_service.cc:1511] Processing CreateTablet for tablet e88e8870cf944d04ae545b794637b1a4 (DEFAULT_TABLE table=TestTable [id=5f38476880b04b4a88b44ec29adc68d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:38.821323  8013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88e8870cf944d04ae545b794637b1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:38.821702  8472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88e8870cf944d04ae545b794637b1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:38.822487  8169 tablet_service.cc:1511] Processing CreateTablet for tablet e88e8870cf944d04ae545b794637b1a4 (DEFAULT_TABLE table=TestTable [id=5f38476880b04b4a88b44ec29adc68d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:38.823413  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e88e8870cf944d04ae545b794637b1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:38.826072  8724 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742: Bootstrap starting.
I20260812 08:02:38.828310  8725 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c: Bootstrap starting.
I20260812 08:02:38.829361  8724 tablet_bootstrap.cc:654] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:38.830359  8724 log.cc:826] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:38.830993  8725 tablet_bootstrap.cc:654] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:38.831907  8725 log.cc:826] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:38.831923  8726 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee: Bootstrap starting.
I20260812 08:02:38.832840  8724 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742: No bootstrap required, opened a new log
I20260812 08:02:38.833110  8724 ts_tablet_manager.cc:1403] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742: Time spent bootstrapping tablet: real 0.007s	user 0.006s	sys 0.000s
I20260812 08:02:38.833652  8725 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c: No bootstrap required, opened a new log
I20260812 08:02:38.833895  8725 ts_tablet_manager.cc:1403] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:38.834256  8726 tablet_bootstrap.cc:654] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:38.835132  8726 log.cc:826] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:38.835790  8728 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0: Bootstrap starting.
I20260812 08:02:38.835844  8730 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc: Bootstrap starting.
I20260812 08:02:38.836503  8724 raft_consensus.cc:359] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.836814  8724 raft_consensus.cc:740] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367fc6cd2fc3430f812c5eb7383ac742, State: Initialized, Role: FOLLOWER
I20260812 08:02:38.837201  8724 consensus_queue.cc:260] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.838215  8724 ts_tablet_manager.cc:1434] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:38.838233  8730 tablet_bootstrap.cc:654] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:38.838289  8725 raft_consensus.cc:359] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.838598  8725 raft_consensus.cc:740] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63886079289b42c1a995ffbc1cd3196c, State: Initialized, Role: FOLLOWER
I20260812 08:02:38.838660  8397 heartbeater.cc:499] Master 127.31.239.190:43207 was elected leader, sending a full tablet report...
I20260812 08:02:38.838961  8725 consensus_queue.cc:260] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.839043  8730 log.cc:826] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:38.839355  8728 tablet_bootstrap.cc:654] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:38.840051  8725 ts_tablet_manager.cc:1434] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:38.840098  8551 heartbeater.cc:499] Master 127.31.239.190:43207 was elected leader, sending a full tablet report...
I20260812 08:02:38.840442  8728 log.cc:826] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:38.842334  8730 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc: No bootstrap required, opened a new log
I20260812 08:02:38.842577  8730 ts_tablet_manager.cc:1403] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc: Time spent bootstrapping tablet: real 0.007s	user 0.002s	sys 0.003s
I20260812 08:02:38.842782  8726 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee: No bootstrap required, opened a new log
I20260812 08:02:38.842959  8728 tablet_bootstrap.cc:492] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0: No bootstrap required, opened a new log
I20260812 08:02:38.842993  8726 ts_tablet_manager.cc:1403] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee: Time spent bootstrapping tablet: real 0.011s	user 0.000s	sys 0.004s
I20260812 08:02:38.843271  8728 ts_tablet_manager.cc:1403] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0: Time spent bootstrapping tablet: real 0.008s	user 0.001s	sys 0.004s
I20260812 08:02:38.846053  8730 raft_consensus.cc:359] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.846390  8730 raft_consensus.cc:740] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e0639ccbaf2451dab5028d002c0d3fc, State: Initialized, Role: FOLLOWER
I20260812 08:02:38.846758  8730 consensus_queue.cc:260] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.846760  8726 raft_consensus.cc:359] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.846992  8726 raft_consensus.cc:740] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d0634a93164b219b1a26c0fe866fee, State: Initialized, Role: FOLLOWER
I20260812 08:02:38.846763  8728 raft_consensus.cc:359] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.847241  8728 raft_consensus.cc:740] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6abe9e66218746fc8ef2d4531e2f97f0, State: Initialized, Role: FOLLOWER
I20260812 08:02:38.847322  8726 consensus_queue.cc:260] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.847625  8728 consensus_queue.cc:260] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.847831  8730 ts_tablet_manager.cc:1434] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260812 08:02:38.848207  8726 ts_tablet_manager.cc:1434] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.005s
I20260812 08:02:38.848201  8702 heartbeater.cc:499] Master 127.31.239.190:43207 was elected leader, sending a full tablet report...
I20260812 08:02:38.848538  8091 heartbeater.cc:499] Master 127.31.239.190:43207 was elected leader, sending a full tablet report...
I20260812 08:02:38.850729  8728 ts_tablet_manager.cc:1434] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 08:02:38.851178  8247 heartbeater.cc:499] Master 127.31.239.190:43207 was elected leader, sending a full tablet report...
I20260812 08:02:38.852591 32702 external_mini_cluster.cc:955] 5 TS(s) registered with all masters
I20260812 08:02:38.854430 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 50d0634a93164b219b1a26c0fe866fee to finish bootstrapping
I20260812 08:02:38.860376 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 6abe9e66218746fc8ef2d4531e2f97f0 to finish bootstrapping
I20260812 08:02:38.867705 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 367fc6cd2fc3430f812c5eb7383ac742 to finish bootstrapping
I20260812 08:02:38.874837 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 63886079289b42c1a995ffbc1cd3196c to finish bootstrapping
I20260812 08:02:38.880890 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 9e0639ccbaf2451dab5028d002c0d3fc to finish bootstrapping
W20260812 08:02:38.891108  8399 tablet.cc:2406] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:38.894349  8192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4"
dest_uuid: "6abe9e66218746fc8ef2d4531e2f97f0"
 from {username='slave'} at 127.0.0.1:38464
I20260812 08:02:38.894652  8192 raft_consensus.cc:493] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:38.894793  8192 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:38.895865  8192 raft_consensus.cc:515] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.897225  8192 leader_election.cc:290] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [CANDIDATE]: Term 1 election: Requested vote from peers 63886079289b42c1a995ffbc1cd3196c (127.31.239.132:37061), 9e0639ccbaf2451dab5028d002c0d3fc (127.31.239.133:36773), 50d0634a93164b219b1a26c0fe866fee (127.31.239.129:46371), 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131:38191)
I20260812 08:02:38.902881  8343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4" candidate_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "367fc6cd2fc3430f812c5eb7383ac742"
I20260812 08:02:38.903198  8343 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:38.903645  8495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4" candidate_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "63886079289b42c1a995ffbc1cd3196c"
I20260812 08:02:38.903863  8495 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:38.903838  8038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4" candidate_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "50d0634a93164b219b1a26c0fe866fee"
I20260812 08:02:38.903863  8651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4" candidate_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9e0639ccbaf2451dab5028d002c0d3fc"
I20260812 08:02:38.904067  8651 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:38.904075  8038 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:38.905124  8343 raft_consensus.cc:2468] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6abe9e66218746fc8ef2d4531e2f97f0 in term 1.
I20260812 08:02:38.905146  8495 raft_consensus.cc:2468] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6abe9e66218746fc8ef2d4531e2f97f0 in term 1.
I20260812 08:02:38.905164  8651 raft_consensus.cc:2468] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6abe9e66218746fc8ef2d4531e2f97f0 in term 1.
I20260812 08:02:38.905340  8038 raft_consensus.cc:2468] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6abe9e66218746fc8ef2d4531e2f97f0 in term 1.
I20260812 08:02:38.905728  8115 leader_election.cc:304] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 367fc6cd2fc3430f812c5eb7383ac742, 6abe9e66218746fc8ef2d4531e2f97f0, 9e0639ccbaf2451dab5028d002c0d3fc; no voters: 
I20260812 08:02:38.906096  8741 raft_consensus.cc:2804] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:38.906457  8741 raft_consensus.cc:697] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 1 LEADER]: Becoming Leader. State: Replica: 6abe9e66218746fc8ef2d4531e2f97f0, State: Running, Role: LEADER
I20260812 08:02:38.906803  8741 consensus_queue.cc:237] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:38.910805  7874 catalog_manager.cc:5719] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6abe9e66218746fc8ef2d4531e2f97f0 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } health_report { overall_health: HEALTHY } } }
W20260812 08:02:38.953925  8248 tablet.cc:2406] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:39.008693  8092 tablet.cc:2406] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:39.019038  8704 tablet.cc:2406] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:39.075160  8552 tablet.cc:2406] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:39.308475  8741 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:39.383358  8741 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:39.389520 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 7833
I20260812 08:02:39.393404  8756 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:39.399708  8756 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 08:02:39.405920  8573 connection.cc:573] client connection to 127.31.239.190:43207 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.406390  8702 heartbeater.cc:646] Failed to heartbeat to 127.31.239.190:43207 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.406777  8417 connection.cc:573] client connection to 127.31.239.190:43207 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.406857  8271 connection.cc:573] client connection to 127.31.239.190:43207 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.406896  7958 connection.cc:573] client connection to 127.31.239.190:43207 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.407091  8551 heartbeater.cc:646] Failed to heartbeat to 127.31.239.190:43207 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.407182  8091 heartbeater.cc:646] Failed to heartbeat to 127.31.239.190:43207 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.407220  8397 heartbeater.cc:646] Failed to heartbeat to 127.31.239.190:43207 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.407425  8116 connection.cc:573] client connection to 127.31.239.190:43207 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:02:39.407758  8247 heartbeater.cc:646] Failed to heartbeat to 127.31.239.190:43207 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:02:39.407963 32702 raft_consensus_election-itest.cc:669] Removing tserver with uuid 367fc6cd2fc3430f812c5eb7383ac742
W20260812 08:02:39.408898  8767 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:02:39.406954 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.31.239.190:43207 (local address 127.31.239.133:48327)
0812 08:02:39.408018 (+  1064us) negotiation.cc:107] Waiting for socket to connect
0812 08:02:39.408086 (+    68us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.31.239.190:43207: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":962,"thread_start_us":85,"threads_started":1}
I20260812 08:02:39.409468  8192 consensus_queue.cc:237] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }
I20260812 08:02:39.411064  8038 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 1 FOLLOWER]: Refusing update from remote peer 6abe9e66218746fc8ef2d4531e2f97f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:39.411073  8495 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 1 FOLLOWER]: Refusing update from remote peer 6abe9e66218746fc8ef2d4531e2f97f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:39.411540  8651 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 1 FOLLOWER]: Refusing update from remote peer 6abe9e66218746fc8ef2d4531e2f97f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:39.411580  8758 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:02:39.411788  8741 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:02:39.411978  8756 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:02:39.413868  8741 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } }
I20260812 08:02:39.414407  8495 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } }
I20260812 08:02:39.414642  8651 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } }
I20260812 08:02:39.416419  8038 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } }
I20260812 08:02:39.432533 32702 raft_consensus_election-itest.cc:679] Pausing 3 replicas...
I20260812 08:02:39.465103 32702 raft_consensus_election-itest.cc:687] Adding back Peer 367fc6cd2fc3430f812c5eb7383ac742 and expecting timeout...
I20260812 08:02:39.466758  8192 consensus_queue.cc:237] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } }
I20260812 08:02:39.468832  8343 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 1 FOLLOWER]: Refusing update from remote peer 6abe9e66218746fc8ef2d4531e2f97f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 08:02:39.469537  8756 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:02:39.471521  8343 raft_consensus.cc:872] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }.
  Pending config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }: 
  New config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } }
W20260812 08:02:39.471740  8343 raft_consensus.cc:1579] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 3' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }.
  Pending config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } }: 
  New config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } }
I20260812 08:02:39.472209  8343 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.2: config changed from index -1 to 2, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) evicted. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } }
I20260812 08:02:39.475217  8343 raft_consensus.cc:1481] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
I20260812 08:02:39.566365 32702 raft_consensus_election-itest.cc:691] Timeout achieved.
I20260812 08:02:39.572605 32702 raft_consensus_election-itest.cc:702] Forcing Peer 6abe9e66218746fc8ef2d4531e2f97f0 to step down...
I20260812 08:02:39.573297  8192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4"
dest_uuid: "6abe9e66218746fc8ef2d4531e2f97f0"
 from {username='slave'} at 127.0.0.1:38464
I20260812 08:02:39.573522  8192 raft_consensus.cc:591] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 1 LEADER]: Received request to step down
I20260812 08:02:39.573603  8192 raft_consensus.cc:3055] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:39.573657  8192 raft_consensus.cc:740] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6abe9e66218746fc8ef2d4531e2f97f0, State: Running, Role: LEADER
I20260812 08:02:39.573861  8192 consensus_queue.cc:260] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } }
I20260812 08:02:39.574062  8192 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:39.574544 32702 raft_consensus_election-itest.cc:708] Resuming Peer 63886079289b42c1a995ffbc1cd3196c ...
I20260812 08:02:39.575176 32702 raft_consensus_election-itest.cc:713] Trying to elect Peer 367fc6cd2fc3430f812c5eb7383ac742 ...
I20260812 08:02:39.575821  8343 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4"
dest_uuid: "367fc6cd2fc3430f812c5eb7383ac742"
 from {username='slave'} at 127.0.0.1:49740
I20260812 08:02:39.575944  8495 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 1 FOLLOWER]: Refusing update from remote peer 6abe9e66218746fc8ef2d4531e2f97f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 08:02:39.576040  8343 raft_consensus.cc:493] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:39.576658  8343 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:39.577610  8343 raft_consensus.cc:515] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } }
I20260812 08:02:39.579084  8343 leader_election.cc:290] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [CANDIDATE]: Term 2 election: Requested vote from peers 63886079289b42c1a995ffbc1cd3196c (127.31.239.132:37061), 9e0639ccbaf2451dab5028d002c0d3fc (127.31.239.133:36773), 50d0634a93164b219b1a26c0fe866fee (127.31.239.129:46371), 6abe9e66218746fc8ef2d4531e2f97f0 (127.31.239.130:37031)
I20260812 08:02:39.582708 32702 cluster_itest_util.cc:258] Not converged past 4 yet: 1.2 1.3 1.3
I20260812 08:02:39.584494  8495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4" candidate_uuid: "367fc6cd2fc3430f812c5eb7383ac742" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "63886079289b42c1a995ffbc1cd3196c"
I20260812 08:02:39.584674  8495 raft_consensus.cc:1813] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 1 FOLLOWER]: Handling vote request from an unknown peer 367fc6cd2fc3430f812c5eb7383ac742
I20260812 08:02:39.584748  8495 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:39.585757  8495 raft_consensus.cc:2468] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367fc6cd2fc3430f812c5eb7383ac742 in term 2.
I20260812 08:02:39.587263  8192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4" candidate_uuid: "367fc6cd2fc3430f812c5eb7383ac742" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "6abe9e66218746fc8ef2d4531e2f97f0"
I20260812 08:02:39.588321  8192 raft_consensus.cc:2468] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367fc6cd2fc3430f812c5eb7383ac742 in term 2.
I20260812 08:02:39.588732  8273 leader_election.cc:304] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 367fc6cd2fc3430f812c5eb7383ac742, 63886079289b42c1a995ffbc1cd3196c, 6abe9e66218746fc8ef2d4531e2f97f0; no voters: 
I20260812 08:02:39.589026  8753 raft_consensus.cc:2804] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:39.589355  8753 raft_consensus.cc:697] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 2 LEADER]: Becoming Leader. State: Replica: 367fc6cd2fc3430f812c5eb7383ac742, State: Running, Role: LEADER
I20260812 08:02:39.589751  8753 consensus_queue.cc:237] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } }
I20260812 08:02:39.686517 32702 cluster_itest_util.cc:258] Not converged past 4 yet: 1.2 1.3 2.4
I20260812 08:02:39.889948 32702 cluster_itest_util.cc:258] Not converged past 4 yet: 1.2 1.3 2.4
W20260812 08:02:40.046351  8116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:40.075806  8116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:40.156160  8192 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 2 FOLLOWER]: Refusing update from remote peer 367fc6cd2fc3430f812c5eb7383ac742: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 08:02:40.157135  8753 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:02:40.193636 32702 cluster_itest_util.cc:258] Not converged past 4 yet: 1.2 2.4 2.4
I20260812 08:02:40.214900  8495 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 2 FOLLOWER]: Refusing update from remote peer 367fc6cd2fc3430f812c5eb7383ac742: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 08:02:40.215536  8753 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:02:40.218441  8788 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [term 2 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } } }
I20260812 08:02:40.218874  8495 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 63886079289b42c1a995ffbc1cd3196c [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } } }
I20260812 08:02:40.221268  8192 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 6abe9e66218746fc8ef2d4531e2f97f0 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } } }
W20260812 08:02:40.222826  8192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38464 (request call id 47) took 756 ms (client timeout 100 ms). Trace:
W20260812 08:02:40.222921  8192 rpcz_store.cc:269] 0812 08:02:39.465960 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:39.466068 (+   108us) service_pool.cc:224] Handling call
0812 08:02:39.467707 (+  1639us) log.cc:844] Serialized 618 byte log entry
0812 08:02:40.222803 (+755096us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91,"raft.queue_time_us":515,"raft.run_cpu_time_us":683,"raft.run_wall_time_us":735,"spinlock_wait_cycles":353024}
W20260812 08:02:40.462795  8116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260812 08:02:40.560310  8116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260812 08:02:40.597416 32702 raft_consensus_election-itest.cc:719] Resuming remaining nodes...
I20260812 08:02:40.599164  8038 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 1 FOLLOWER]: Refusing update from remote peer 6abe9e66218746fc8ef2d4531e2f97f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 08:02:40.599735  8651 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 1 FOLLOWER]: Refusing update from remote peer 6abe9e66218746fc8ef2d4531e2f97f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260812 08:02:40.605723  8037 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:40.606921  8037 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 2 FOLLOWER]: Refusing update from remote peer 367fc6cd2fc3430f812c5eb7383ac742: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 08:02:40.607290  8038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4" candidate_uuid: "367fc6cd2fc3430f812c5eb7383ac742" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "50d0634a93164b219b1a26c0fe866fee"
I20260812 08:02:40.607380  8038 raft_consensus.cc:1813] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 2 FOLLOWER]: Handling vote request from an unknown peer 367fc6cd2fc3430f812c5eb7383ac742
I20260812 08:02:40.607508  8753 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:02:40.608306  8038 raft_consensus.cc:2468] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367fc6cd2fc3430f812c5eb7383ac742 in term 2.
I20260812 08:02:40.611229  8037 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 50d0634a93164b219b1a26c0fe866fee [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } } }
I20260812 08:02:40.612839  8651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e88e8870cf944d04ae545b794637b1a4" candidate_uuid: "367fc6cd2fc3430f812c5eb7383ac742" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "9e0639ccbaf2451dab5028d002c0d3fc"
I20260812 08:02:40.612914  8650 raft_consensus.cc:3060] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:40.614043  8650 raft_consensus.cc:1275] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 2 FOLLOWER]: Refusing update from remote peer 367fc6cd2fc3430f812c5eb7383ac742: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260812 08:02:40.614315  8651 raft_consensus.cc:1813] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 2 FOLLOWER]: Handling vote request from an unknown peer 367fc6cd2fc3430f812c5eb7383ac742
I20260812 08:02:40.615232  8651 raft_consensus.cc:2468] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367fc6cd2fc3430f812c5eb7383ac742 in term 2.
I20260812 08:02:40.616087  8788 consensus_queue.cc:1048] T e88e8870cf944d04ae545b794637b1a4 P 367fc6cd2fc3430f812c5eb7383ac742 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:02:40.619544  8651 raft_consensus.cc:2955] T e88e8870cf944d04ae545b794637b1a4 P 9e0639ccbaf2451dab5028d002c0d3fc [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, VOTER 367fc6cd2fc3430f812c5eb7383ac742 (127.31.239.131) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63886079289b42c1a995ffbc1cd3196c" member_type: VOTER last_known_addr { host: "127.31.239.132" port: 37061 } } peers { permanent_uuid: "9e0639ccbaf2451dab5028d002c0d3fc" member_type: VOTER last_known_addr { host: "127.31.239.133" port: 36773 } } peers { permanent_uuid: "50d0634a93164b219b1a26c0fe866fee" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 46371 } } peers { permanent_uuid: "6abe9e66218746fc8ef2d4531e2f97f0" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 37031 } } peers { permanent_uuid: "367fc6cd2fc3430f812c5eb7383ac742" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 38191 } attrs { } } }
I20260812 08:02:40.622272  8812 mvcc.cc:204] Tried to move back new op lower bound from 7317593131442274304 to 7317593127284830208. Current Snapshot: MvccSnapshot[applied={T|T < 7317593131442274304}]
I20260812 08:02:40.627564 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 7939
I20260812 08:02:40.637552 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 8095
I20260812 08:02:40.646723 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 8250
I20260812 08:02:40.657464 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 8401
I20260812 08:02:40.668591 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 8554
2026-08-12T08:02:40Z chronyd exiting
[       OK ] RaftConsensusElectionITest.ElectPendingVoter (3107 ms)
[ RUN      ] RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy
I20260812 08:02:40.697038 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:40.697096 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:40.697109 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:02:40.697126 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:02:40.697137 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:40Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:40Z Disabled control of system clock
I20260812 08:02:40.707118 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:40653
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:36323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:40653
--master_add_server_when_underreplicated=false
--raft_prepare_replacement_before_eviction=false with env {}
W20260812 08:02:40.815335  8824 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:40.815634  8824 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:40.815711  8824 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:40.819265  8824 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:40.819403  8824 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:40.819439  8824 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:40.819482  8824 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:40.819527  8824 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:40.823899  8824 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:40653
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:40653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.8824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:40.825096  8824 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:40.826337  8824 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:40.832182  8834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:40.832183  8831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:40.832368  8830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:40.832677  8824 server_base.cc:1061] running on GCE node
I20260812 08:02:40.833140  8824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:40.834007  8824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:40.835183  8824 hybrid_clock.cc:648] HybridClock initialized: now 1786521760835166 us; error 27 us; skew 500 ppm
I20260812 08:02:40.837055  8824 webserver.cc:533] Webserver started at http://127.31.239.190:41209/ using document root <none> and password file <none>
I20260812 08:02:40.837685  8824 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:40.837769  8824 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:40.838047  8824 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:40.839797  8824 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "a1df50dc33f64cdd85f9294f44709619"
format_stamp: "Formatted at 2026-08-12 08:02:40 on dist-test-slave-9jjr"
I20260812 08:02:40.840348  8824 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "a1df50dc33f64cdd85f9294f44709619"
format_stamp: "Formatted at 2026-08-12 08:02:40 on dist-test-slave-9jjr"
I20260812 08:02:40.844224  8824 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:40.846804  8840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:40.847926  8824 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:40.848155  8824 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "a1df50dc33f64cdd85f9294f44709619"
format_stamp: "Formatted at 2026-08-12 08:02:40 on dist-test-slave-9jjr"
I20260812 08:02:40.848306  8824 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:40.873970  8824 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:40.874809  8824 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:40.875041  8824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:40.883231  8824 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:40653
I20260812 08:02:40.883257  8899 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:40653 every 8 connection(s)
I20260812 08:02:40.884433  8824 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:40.887539  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:40.893224  8901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Bootstrap starting.
I20260812 08:02:40.893587 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 8824
I20260812 08:02:40.893724 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:40.896220  8901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:40.897028  8901 log.cc:826] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:40.898972  8901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: No bootstrap required, opened a new log
I20260812 08:02:40.901865  8901 raft_consensus.cc:359] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } }
I20260812 08:02:40.902105  8901 raft_consensus.cc:385] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:40.902221  8901 raft_consensus.cc:740] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1df50dc33f64cdd85f9294f44709619, State: Initialized, Role: FOLLOWER
I20260812 08:02:40.902658  8901 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } }
I20260812 08:02:40.902823  8901 raft_consensus.cc:399] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:40.902901  8901 raft_consensus.cc:493] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:40.903013  8901 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:40.904359  8901 raft_consensus.cc:515] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } }
I20260812 08:02:40.904726  8901 leader_election.cc:304] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1df50dc33f64cdd85f9294f44709619; no voters: 
I20260812 08:02:40.905010  8901 leader_election.cc:290] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:40.905195  8906 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:40.905472  8906 raft_consensus.cc:697] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 1 LEADER]: Becoming Leader. State: Replica: a1df50dc33f64cdd85f9294f44709619, State: Running, Role: LEADER
I20260812 08:02:40.905793  8906 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } }
I20260812 08:02:40.906339  8901 sys_catalog.cc:565] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:40.907773  8908 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1df50dc33f64cdd85f9294f44709619" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } } }
I20260812 08:02:40.907907  8908 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:40.908687  8909 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1df50dc33f64cdd85f9294f44709619. Latest consensus state: current_term: 1 leader_uuid: "a1df50dc33f64cdd85f9294f44709619" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } } }
I20260812 08:02:40.908794  8909 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:40.909257  8918 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:40.912025  8918 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:40.917769  8918 catalog_manager.cc:1383] Generated new cluster ID: 83069dc452c34f24b6c0c143be4fea3d
I20260812 08:02:40.917883  8918 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:40.929811  8918 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:40.931005  8918 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:40.939337  8918 catalog_manager.cc:6092] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Generated new TSK 0
I20260812 08:02:40.939975  8918 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:40.950537 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40653
--builtin_ntp_servers=127.31.239.148:36323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20260812 08:02:41.061925  8930 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:02:41.062319  8930 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:41.062357  8930 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:41.062434  8930 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:41.066016  8930 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:02:41.066102  8930 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:02:41.066190  8930 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:41.066260  8930 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:41.066398  8930 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:02:41.066435  8930 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:41.070679  8930 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40653
--never_fsync=true
--heap_profile_path=/tmp/kudu.8930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:41.071858  8930 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:41.073264  8930 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:41.080044  8936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.080045  8940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.080045  8938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.080391  8930 server_base.cc:1061] running on GCE node
I20260812 08:02:41.080865  8930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:41.081545  8930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:41.082743  8930 hybrid_clock.cc:648] HybridClock initialized: now 1786521761082688 us; error 68 us; skew 500 ppm
I20260812 08:02:41.085011  8930 webserver.cc:533] Webserver started at http://127.31.239.129:44143/ using document root <none> and password file <none>
I20260812 08:02:41.085723  8930 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:41.085786  8930 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:41.085951  8930 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:41.087734  8930 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "8155ee9e10f646f7be71c52b760edfbb"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.088186  8930 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "8155ee9e10f646f7be71c52b760edfbb"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.091799  8930 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
I20260812 08:02:41.094304  8946 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.095470  8930 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260812 08:02:41.095575  8930 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "8155ee9e10f646f7be71c52b760edfbb"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.095669  8930 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:41.122535  8930 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:41.123281  8930 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:41.123448  8930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:41.124178  8930 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:41.125212  8930 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:41.125262  8930 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.125303  8930 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:41.125317  8930 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.135797  8930 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:42521
I20260812 08:02:41.135823  9083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:42521 every 8 connection(s)
I20260812 08:02:41.136852  8930 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:41.138320 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 8930
I20260812 08:02:41.138477 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:41.140864 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40653
--builtin_ntp_servers=127.31.239.148:36323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260812 08:02:41.147306  9084 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40653
I20260812 08:02:41.147658  9084 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:41.148234  9084 heartbeater.cc:507] Master 127.31.239.190:40653 requested a full tablet report, sending...
I20260812 08:02:41.150094  8861 ts_manager.cc:194] Registered new tserver with Master: 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521)
I20260812 08:02:41.151930  8861 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:49477
W20260812 08:02:41.255318  9087 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:02:41.255616  9087 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:41.255638  9087 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:41.255681  9087 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:41.259330  9087 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:02:41.259404  9087 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:02:41.259433  9087 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:41.259460  9087 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:41.259523  9087 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:02:41.259547  9087 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:41.263715  9087 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40653
--never_fsync=true
--heap_profile_path=/tmp/kudu.9087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:41.264868  9087 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:41.265990  9087 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:41.273181  9092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.273248  9087 server_base.cc:1061] running on GCE node
W20260812 08:02:41.273248  9098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.273509  9093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.273983  9087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:41.274645  9087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:41.275838  9087 hybrid_clock.cc:648] HybridClock initialized: now 1786521761275814 us; error 42 us; skew 500 ppm
I20260812 08:02:41.277897  9087 webserver.cc:533] Webserver started at http://127.31.239.130:42953/ using document root <none> and password file <none>
I20260812 08:02:41.278577  9087 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:41.278666  9087 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:41.278910  9087 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:41.280568  9087 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "0ba29ed110c14d41b150bbc1c237b617"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.281085  9087 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "0ba29ed110c14d41b150bbc1c237b617"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.284729  9087 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:02:41.287298  9104 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.288528  9087 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:41.288681  9087 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "0ba29ed110c14d41b150bbc1c237b617"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.288839  9087 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:41.306952  9087 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:41.307696  9087 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:41.307945  9087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:41.308640  9087 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:41.309721  9087 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:41.309811  9087 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.309876  9087 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:41.309926  9087 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.319631  9087 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:46207
I20260812 08:02:41.319661  9233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:46207 every 8 connection(s)
I20260812 08:02:41.320616  9087 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:41.328608 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 9087
I20260812 08:02:41.328773 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:02:41.330597  9234 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40653
I20260812 08:02:41.330904  9234 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:41.331497  9234 heartbeater.cc:507] Master 127.31.239.190:40653 requested a full tablet report, sending...
I20260812 08:02:41.331607 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40653
--builtin_ntp_servers=127.31.239.148:36323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260812 08:02:41.332739  8861 ts_manager.cc:194] Registered new tserver with Master: 0ba29ed110c14d41b150bbc1c237b617 (127.31.239.130:46207)
I20260812 08:02:41.333493  8861 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:54301
W20260812 08:02:41.443652  9237 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:02:41.443998  9237 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:41.444058  9237 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:41.444139  9237 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:41.447659  9237 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:02:41.447759  9237 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:02:41.447808  9237 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:41.447871  9237 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:41.447999  9237 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:02:41.448058  9237 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:02:41.452227  9237 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:40653
--never_fsync=true
--heap_profile_path=/tmp/kudu.9237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:41.453449  9237 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:41.454715  9237 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:41.462206  9244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.462437  9237 server_base.cc:1061] running on GCE node
W20260812 08:02:41.462193  9245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:41.462196  9247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:41.462950  9237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:41.463588  9237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:41.464807  9237 hybrid_clock.cc:648] HybridClock initialized: now 1786521761464794 us; error 30 us; skew 500 ppm
I20260812 08:02:41.467136  9237 webserver.cc:533] Webserver started at http://127.31.239.131:34511/ using document root <none> and password file <none>
I20260812 08:02:41.467803  9237 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:41.467866  9237 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:41.468101  9237 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:41.469914  9237 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "bf783896a9ce4f86ab1becb2c2480ab4"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.470602  9237 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "bf783896a9ce4f86ab1becb2c2480ab4"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.475157  9237 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:41.477862  9254 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.479332  9237 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:41.479507  9237 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "bf783896a9ce4f86ab1becb2c2480ab4"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:41.479640  9237 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:41.492267  9237 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:41.492973  9237 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:41.493247  9237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:41.493904  9237 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:41.495034  9237 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:41.495085  9237 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.495157  9237 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:41.495193  9237 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:41.506757  9237 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:37503
I20260812 08:02:41.506808  9381 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:37503 every 8 connection(s)
I20260812 08:02:41.507920  9237 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:02:41.509367 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 9237
I20260812 08:02:41.509510 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:02:41.518275  9382 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40653
I20260812 08:02:41.518582  9382 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:41.519117  9382 heartbeater.cc:507] Master 127.31.239.190:40653 requested a full tablet report, sending...
I20260812 08:02:41.520390  8861 ts_manager.cc:194] Registered new tserver with Master: bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503)
I20260812 08:02:41.520956  8861 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:32871
I20260812 08:02:41.524343 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:41.534216  8861 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38636:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
I20260812 08:02:41.553434  9003 tablet_service.cc:1511] Processing CreateTablet for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 (DEFAULT_TABLE table=TestTable [id=ca32a56ba7824eaf8f6ed2522a59d6c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:41.554605  9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:41.554487  9308 tablet_service.cc:1511] Processing CreateTablet for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 (DEFAULT_TABLE table=TestTable [id=ca32a56ba7824eaf8f6ed2522a59d6c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:41.554493  9156 tablet_service.cc:1511] Processing CreateTablet for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 (DEFAULT_TABLE table=TestTable [id=ca32a56ba7824eaf8f6ed2522a59d6c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:41.555490  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:41.555497  9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:41.561381  9403 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Bootstrap starting.
I20260812 08:02:41.561661  9402 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Bootstrap starting.
I20260812 08:02:41.562328  9405 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Bootstrap starting.
I20260812 08:02:41.563928  9402 tablet_bootstrap.cc:654] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.563931  9403 tablet_bootstrap.cc:654] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.564354  9405 tablet_bootstrap.cc:654] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:41.564756  9402 log.cc:826] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.564815  9403 log.cc:826] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.565088  9405 log.cc:826] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:41.566582  9402 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: No bootstrap required, opened a new log
I20260812 08:02:41.566630  9405 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: No bootstrap required, opened a new log
I20260812 08:02:41.566627  9403 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: No bootstrap required, opened a new log
I20260812 08:02:41.566813  9402 ts_tablet_manager.cc:1403] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:41.566816  9403 ts_tablet_manager.cc:1403] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:41.566816  9405 ts_tablet_manager.cc:1403] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:41.569226  9402 raft_consensus.cc:359] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.569443  9402 raft_consensus.cc:385] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.569517  9402 raft_consensus.cc:740] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba29ed110c14d41b150bbc1c237b617, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.569990  9402 consensus_queue.cc:260] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.569918  9403 raft_consensus.cc:359] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.570163  9403 raft_consensus.cc:385] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.570231  9403 raft_consensus.cc:740] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf783896a9ce4f86ab1becb2c2480ab4, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.570730  9234 heartbeater.cc:499] Master 127.31.239.190:40653 was elected leader, sending a full tablet report...
I20260812 08:02:41.570709  9403 consensus_queue.cc:260] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.571028  9402 ts_tablet_manager.cc:1434] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:41.571102  9405 raft_consensus.cc:359] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.571308  9405 raft_consensus.cc:385] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:41.571377  9405 raft_consensus.cc:740] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8155ee9e10f646f7be71c52b760edfbb, State: Initialized, Role: FOLLOWER
I20260812 08:02:41.571636  9403 ts_tablet_manager.cc:1434] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:41.571764  9405 consensus_queue.cc:260] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.571875  9382 heartbeater.cc:499] Master 127.31.239.190:40653 was elected leader, sending a full tablet report...
I20260812 08:02:41.572606  9405 ts_tablet_manager.cc:1434] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:41.572916  9084 heartbeater.cc:499] Master 127.31.239.190:40653 was elected leader, sending a full tablet report...
I20260812 08:02:41.586030  9412 raft_consensus.cc:493] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:41.586387  9412 raft_consensus.cc:515] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.587667  9412 leader_election.cc:290] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521), 0ba29ed110c14d41b150bbc1c237b617 (127.31.239.130:46207)
I20260812 08:02:41.591763  9027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8155ee9e10f646f7be71c52b760edfbb" is_pre_election: true
I20260812 08:02:41.592136  9027 raft_consensus.cc:2468] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf783896a9ce4f86ab1becb2c2480ab4 in term 0.
I20260812 08:02:41.592407  9181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba29ed110c14d41b150bbc1c237b617" is_pre_election: true
I20260812 08:02:41.592697  9181 raft_consensus.cc:2468] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf783896a9ce4f86ab1becb2c2480ab4 in term 0.
I20260812 08:02:41.592736  9260 leader_election.cc:304] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8155ee9e10f646f7be71c52b760edfbb, bf783896a9ce4f86ab1becb2c2480ab4; no voters: 
I20260812 08:02:41.593045  9412 raft_consensus.cc:2804] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:41.593145  9412 raft_consensus.cc:493] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:41.593225  9412 raft_consensus.cc:3060] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.594254  9412 raft_consensus.cc:515] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.594688  9412 leader_election.cc:290] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [CANDIDATE]: Term 1 election: Requested vote from peers 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521), 0ba29ed110c14d41b150bbc1c237b617 (127.31.239.130:46207)
I20260812 08:02:41.595112  9027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8155ee9e10f646f7be71c52b760edfbb"
I20260812 08:02:41.595273  9027 raft_consensus.cc:3060] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.595280  9181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba29ed110c14d41b150bbc1c237b617"
I20260812 08:02:41.595432  9181 raft_consensus.cc:3060] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:41.596733  9027 raft_consensus.cc:2468] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf783896a9ce4f86ab1becb2c2480ab4 in term 1.
I20260812 08:02:41.596937  9181 raft_consensus.cc:2468] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf783896a9ce4f86ab1becb2c2480ab4 in term 1.
I20260812 08:02:41.597198  9260 leader_election.cc:304] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8155ee9e10f646f7be71c52b760edfbb, bf783896a9ce4f86ab1becb2c2480ab4; no voters: 
I20260812 08:02:41.597407  9412 raft_consensus.cc:2804] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:41.597652  9412 raft_consensus.cc:697] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 1 LEADER]: Becoming Leader. State: Replica: bf783896a9ce4f86ab1becb2c2480ab4, State: Running, Role: LEADER
I20260812 08:02:41.598021  9412 consensus_queue.cc:237] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:41.601486  8859 catalog_manager.cc:5719] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131). New cstate: current_term: 1 leader_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } } }
W20260812 08:02:41.608995  9384 tablet.cc:2406] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:41.618664 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:41.620398 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 8155ee9e10f646f7be71c52b760edfbb to finish bootstrapping
W20260812 08:02:41.622014  9235 tablet.cc:2406] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:41.626760 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 0ba29ed110c14d41b150bbc1c237b617 to finish bootstrapping
I20260812 08:02:41.632520 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver bf783896a9ce4f86ab1becb2c2480ab4 to finish bootstrapping
W20260812 08:02:41.638744  9085 tablet.cc:2406] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:41.651862 32702 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
I20260812 08:02:41.755493 32702 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
I20260812 08:02:41.958964 32702 cluster_itest_util.cc:258] Not converged past 1 yet: 0.0 1.1 0.0
I20260812 08:02:41.991308  9412 consensus_queue.cc:1048] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:41.994169  9412 consensus_queue.cc:1048] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:43.497540  9428 raft_consensus.cc:493] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf783896a9ce4f86ab1becb2c2480ab4)
I20260812 08:02:43.497696  9428 raft_consensus.cc:515] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:43.498821  9428 leader_election.cc:290] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521), bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503)
I20260812 08:02:43.499652  9432 raft_consensus.cc:493] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf783896a9ce4f86ab1becb2c2480ab4)
I20260812 08:02:43.499794  9432 raft_consensus.cc:515] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:43.500993  9432 leader_election.cc:290] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ba29ed110c14d41b150bbc1c237b617 (127.31.239.130:46207), bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503)
I20260812 08:02:43.503423  9027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "0ba29ed110c14d41b150bbc1c237b617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8155ee9e10f646f7be71c52b760edfbb" is_pre_election: true
I20260812 08:02:43.503583  9027 raft_consensus.cc:2468] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba29ed110c14d41b150bbc1c237b617 in term 1.
I20260812 08:02:43.504040  9108 leader_election.cc:304] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba29ed110c14d41b150bbc1c237b617, 8155ee9e10f646f7be71c52b760edfbb; no voters: 
I20260812 08:02:43.504334  9428 raft_consensus.cc:2804] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:02:43.504424  9428 raft_consensus.cc:493] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf783896a9ce4f86ab1becb2c2480ab4)
I20260812 08:02:43.504472  9428 raft_consensus.cc:3060] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:43.504870  9181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "8155ee9e10f646f7be71c52b760edfbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ba29ed110c14d41b150bbc1c237b617" is_pre_election: true
I20260812 08:02:43.505494  9428 raft_consensus.cc:515] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:43.505774  9181 raft_consensus.cc:2393] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8155ee9e10f646f7be71c52b760edfbb in current term 2: Already voted for candidate 0ba29ed110c14d41b150bbc1c237b617 in this term.
I20260812 08:02:43.505963  9428 leader_election.cc:290] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 2 election: Requested vote from peers 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521), bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503)
I20260812 08:02:43.506335  9027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "0ba29ed110c14d41b150bbc1c237b617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8155ee9e10f646f7be71c52b760edfbb"
I20260812 08:02:43.506469  9027 raft_consensus.cc:3060] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:43.507261  9027 raft_consensus.cc:2468] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba29ed110c14d41b150bbc1c237b617 in term 2.
I20260812 08:02:43.507614  9108 leader_election.cc:304] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba29ed110c14d41b150bbc1c237b617, 8155ee9e10f646f7be71c52b760edfbb; no voters: 
I20260812 08:02:43.507819  9428 raft_consensus.cc:2804] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:43.508086  9428 raft_consensus.cc:697] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 LEADER]: Becoming Leader. State: Replica: 0ba29ed110c14d41b150bbc1c237b617, State: Running, Role: LEADER
I20260812 08:02:43.508419  9428 consensus_queue.cc:237] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:43.510707  8861 catalog_manager.cc:5719] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 reported cstate change: term changed from 1 to 2, leader changed from bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131) to 0ba29ed110c14d41b150bbc1c237b617 (127.31.239.130). New cstate: current_term: 2 leader_uuid: "0ba29ed110c14d41b150bbc1c237b617" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } } }
I20260812 08:02:43.612015 32702 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20260812 08:02:43.612398 32702 raft_consensus-itest-base.cc:268] Waiting until we've written at least 4MB...
I20260812 08:02:43.626803  9027 raft_consensus.cc:1275] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 2 FOLLOWER]: Refusing update from remote peer 0ba29ed110c14d41b150bbc1c237b617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 08:02:43.627475  9428 consensus_queue.cc:1048] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:02:43.639209  9457 mvcc.cc:204] Tried to move back new op lower bound from 7317593143816572928 to 7317593143333322752. Current Snapshot: MvccSnapshot[applied={T|T < 7317593143808069632}]
I20260812 08:02:43.711140 32702 raft_consensus-itest-base.cc:274] Waiting for log GC on 0ba29ed110c14d41b150bbc1c237b617
I20260812 08:02:43.731247  9235 maintenance_manager.cc:419] P 0ba29ed110c14d41b150bbc1c237b617: Scheduling FlushMRSOp(8f53b78433d54753bdcf2c7c2ef6ccc8): 4602312 bytes log retention, and flush 6119689 bytes memory
I20260812 08:02:43.747821  9085 maintenance_manager.cc:419] P 8155ee9e10f646f7be71c52b760edfbb: Scheduling FlushMRSOp(8f53b78433d54753bdcf2c7c2ef6ccc8): 3944809 bytes log retention, and flush 6119689 bytes memory
I20260812 08:02:43.788511  9109 maintenance_manager.cc:643] P 0ba29ed110c14d41b150bbc1c237b617: FlushMRSOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.057s	user 0.050s	sys 0.004s Metrics: {"bytes_written":136001,"cfile_init":1,"compiler_manager_pool.queue_time_us":275,"drs_written":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4,"lbm_write_time_us":688,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":36,"thread_start_us":283,"threads_started":2}
I20260812 08:02:43.789727  9235 maintenance_manager.cc:419] P 0ba29ed110c14d41b150bbc1c237b617: Scheduling LogGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8): free 2761438 bytes of WAL
I20260812 08:02:43.790056  9109 log_reader.cc:385] T 8f53b78433d54753bdcf2c7c2ef6ccc8: removed 3 log segments from log reader
I20260812 08:02:43.790205  9109 log.cc:1079] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Deleting log segment in path: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8/wal-000000001 (ops 1-9)
I20260812 08:02:43.790329  9109 log.cc:1079] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Deleting log segment in path: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8/wal-000000002 (ops 10-16)
I20260812 08:02:43.790421  9109 log.cc:1079] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Deleting log segment in path: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8/wal-000000003 (ops 17-23)
I20260812 08:02:43.791515  9109 maintenance_manager.cc:643] P 0ba29ed110c14d41b150bbc1c237b617: LogGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {}
I20260812 08:02:43.791882  9235 maintenance_manager.cc:419] P 0ba29ed110c14d41b150bbc1c237b617: Scheduling UndoDeltaBlockGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8): 534 bytes on disk
I20260812 08:02:43.792558  9109 maintenance_manager.cc:643] P 0ba29ed110c14d41b150bbc1c237b617: UndoDeltaBlockGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20260812 08:02:43.793522 32702 raft_consensus-itest-base.cc:279] Log GC complete on 0ba29ed110c14d41b150bbc1c237b617
I20260812 08:02:43.807878  8953 maintenance_manager.cc:643] P 8155ee9e10f646f7be71c52b760edfbb: FlushMRSOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.060s	user 0.058s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_init":1,"compiler_manager_pool.queue_time_us":3195,"dirs.queue_time_us":251,"dirs.run_cpu_time_us":215,"dirs.run_wall_time_us":887,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":664,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":36,"thread_start_us":280,"threads_started":2}
I20260812 08:02:43.808974  9085 maintenance_manager.cc:419] P 8155ee9e10f646f7be71c52b760edfbb: Scheduling LogGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8): free 2235448 bytes of WAL
I20260812 08:02:43.809264  8953 log_reader.cc:385] T 8f53b78433d54753bdcf2c7c2ef6ccc8: removed 3 log segments from log reader
I20260812 08:02:43.809343  8953 log.cc:1079] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Deleting log segment in path: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8/wal-000000001 (ops 1-7)
I20260812 08:02:43.809448  8953 log.cc:1079] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Deleting log segment in path: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8/wal-000000002 (ops 8-14)
I20260812 08:02:43.809514  8953 log.cc:1079] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Deleting log segment in path: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8/wal-000000003 (ops 15-19)
I20260812 08:02:43.810491  8953 maintenance_manager.cc:643] P 8155ee9e10f646f7be71c52b760edfbb: LogGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.001s	user 0.000s	sys 0.001s Metrics: {}
I20260812 08:02:43.810802  9085 maintenance_manager.cc:419] P 8155ee9e10f646f7be71c52b760edfbb: Scheduling UndoDeltaBlockGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8): 534 bytes on disk
I20260812 08:02:43.811329  8953 maintenance_manager.cc:643] P 8155ee9e10f646f7be71c52b760edfbb: UndoDeltaBlockGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
W20260812 08:02:45.535907  9107 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.31.239.131:37503 for RPC RequestConsensusVote timed out after 2.029s (ON_OUTBOUND_QUEUE)
W20260812 08:02:45.747215  8949 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.31.239.131:37503 for RPC RequestConsensusVote timed out after 2.245s (ON_OUTBOUND_QUEUE)
I20260812 08:02:45.795022 32702 raft_consensus-itest-base.cc:295] Servers converged with original term 2
I20260812 08:02:45.795125 32702 raft_consensus-itest-base.cc:300] Resuming bf783896a9ce4f86ab1becb2c2480ab4
I20260812 08:02:45.797857  9181 raft_consensus.cc:1240] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 LEADER]: Rejecting Update request from peer bf783896a9ce4f86ab1becb2c2480ab4 for earlier term 1. Current term is 2. Ops: []
I20260812 08:02:45.799029  9412 consensus_queue.cc:1059] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 38, Time since last communication: 0.000s
I20260812 08:02:45.799220  9412 consensus_queue.cc:1243] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [LEADER]: Peer 0ba29ed110c14d41b150bbc1c237b617 log is divergent from this leader: its last log entry 2.38 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 38
I20260812 08:02:45.799310  9412 raft_consensus.cc:3055] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:45.799350  9412 raft_consensus.cc:740] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf783896a9ce4f86ab1becb2c2480ab4, State: Running, Role: LEADER
I20260812 08:02:45.799510  9412 consensus_queue.cc:260] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } }
I20260812 08:02:45.799798  9412 raft_consensus.cc:3060] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:45.801802  9027 raft_consensus.cc:1240] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 2 FOLLOWER]: Rejecting Update request from peer bf783896a9ce4f86ab1becb2c2480ab4 for earlier term 1. Current term is 2. Ops: []
I20260812 08:02:45.803221  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "0ba29ed110c14d41b150bbc1c237b617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf783896a9ce4f86ab1becb2c2480ab4"
I20260812 08:02:45.803364  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "0ba29ed110c14d41b150bbc1c237b617" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" is_pre_election: true
I20260812 08:02:45.803414  9325 raft_consensus.cc:1275] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 2 FOLLOWER]: Refusing update from remote peer 0ba29ed110c14d41b150bbc1c237b617: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 08:02:45.803433  9330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "8155ee9e10f646f7be71c52b760edfbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" is_pre_election: true
I20260812 08:02:45.803893  8949 leader_election.cc:304] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8155ee9e10f646f7be71c52b760edfbb; no voters: 0ba29ed110c14d41b150bbc1c237b617, bf783896a9ce4f86ab1becb2c2480ab4
I20260812 08:02:45.804294  9481 raft_consensus.cc:2749] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:02:45.804584  9482 consensus_queue.cc:1048] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 08:02:45.804947  9482 consensus_queue.cc:753] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: The logs necessary to catch up peer bf783896a9ce4f86ab1becb2c2480ab4 have been garbage collected. The follower will never be able to catch up (Not found: failed to read ops 2..31: Segment 1 which contained index 2 has been GCed)
I20260812 08:02:45.805281  9483 raft_consensus.cc:1012] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Attempting to remove follower bf783896a9ce4f86ab1becb2c2480ab4 from the Raft config. Reason: The logs necessary to catch up peer bf783896a9ce4f86ab1becb2c2480ab4 have been garbage collected. The replica will never be able to catch up
I20260812 08:02:45.805925  9483 consensus_queue.cc:237] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 38, Committed index: 38, Last appended: 2.38, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } }
I20260812 08:02:45.807257  9027 raft_consensus.cc:1275] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 2 FOLLOWER]: Refusing update from remote peer 0ba29ed110c14d41b150bbc1c237b617: Log matching property violated. Preceding OpId in replica: term: 2 index: 38. Preceding OpId from leader: term: 2 index: 39. (index mismatch)
I20260812 08:02:45.807641  9482 consensus_queue.cc:1048] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 39, Last known committed idx: 38, Time since last communication: 0.000s
I20260812 08:02:45.809670  9483 raft_consensus.cc:2955] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 LEADER]: Committing config change with OpId 2.39: config changed from index -1 to 39, VOTER bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131) evicted. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } }
I20260812 08:02:45.810118  9027 raft_consensus.cc:2955] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 2 FOLLOWER]: Committing config change with OpId 2.39: config changed from index -1 to 39, VOTER bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131) evicted. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } }
I20260812 08:02:45.812379  8856 catalog_manager.cc:5719] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 reported cstate change: config changed from index -1 to 39, VOTER bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131) evicted. New cstate: current_term: 2 leader_uuid: "0ba29ed110c14d41b150bbc1c237b617" committed_config { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } }
I20260812 08:02:45.816147  9308 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 with delete_type TABLET_DATA_TOMBSTONED (TS bf783896a9ce4f86ab1becb2c2480ab4 not found in new config with opid_index 39) from {username='slave'} at 127.0.0.1:34770
I20260812 08:02:45.816650  9491 tablet_replica.cc:333] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: stopping tablet replica
I20260812 08:02:45.816941  9491 raft_consensus.cc:2243] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:45.817106  9491 raft_consensus.cc:2272] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:45.818001  9491 ts_tablet_manager.cc:1916] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:45.819916  9491 ts_tablet_manager.cc:1929] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:45.820026  9491 log.cc:1199] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8
I20260812 08:02:45.820456  9085 maintenance_manager.cc:419] P 8155ee9e10f646f7be71c52b760edfbb: Scheduling LogGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8): free 1709361 bytes of WAL
I20260812 08:02:45.820703  8953 log_reader.cc:385] T 8f53b78433d54753bdcf2c7c2ef6ccc8: removed 2 log segments from log reader
I20260812 08:02:45.820756  8953 log.cc:1079] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Deleting log segment in path: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8/wal-000000004 (ops 20-25)
I20260812 08:02:45.820808  8953 log.cc:1079] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb: Deleting log segment in path: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/8f53b78433d54753bdcf2c7c2ef6ccc8/wal-000000005 (ops 26-32)
I20260812 08:02:45.820786  8843 catalog_manager.cc:5050] TS bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503): tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 (table TestTable [id=ca32a56ba7824eaf8f6ed2522a59d6c9]) successfully deleted
I20260812 08:02:45.821092  9373 generic_service.cc:175] {username='slave'} at 127.0.0.1:34778 changed flags via RPC: tablet_copy_fault_crash_on_fetch_all from '0' to '1.0'
I20260812 08:02:45.821449  8953 maintenance_manager.cc:643] P 8155ee9e10f646f7be71c52b760edfbb: LogGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.001s	user 0.000s	sys 0.001s Metrics: {}
I20260812 08:02:45.822476  9181 consensus_queue.cc:237] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 2.39, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } }
I20260812 08:02:45.823944  9027 raft_consensus.cc:1275] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 2 FOLLOWER]: Refusing update from remote peer 0ba29ed110c14d41b150bbc1c237b617: Log matching property violated. Preceding OpId in replica: term: 2 index: 39. Preceding OpId from leader: term: 2 index: 40. (index mismatch)
W20260812 08:02:45.824420  9107 consensus_peers.cc:597] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 -> Peer bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503): Couldn't send request to peer bf783896a9ce4f86ab1becb2c2480ab4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:45.824434  9482 consensus_queue.cc:1048] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260812 08:02:45.826006  9483 raft_consensus.cc:2955] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 LEADER]: Committing config change with OpId 2.40: config changed from index 39 to 40, VOTER bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131) added. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } } }
I20260812 08:02:45.826632  9027 raft_consensus.cc:2955] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 8155ee9e10f646f7be71c52b760edfbb [term 2 FOLLOWER]: Committing config change with OpId 2.40: config changed from index 39 to 40, VOTER bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131) added. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } } }
I20260812 08:02:45.828646  8859 catalog_manager.cc:5719] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 reported cstate change: config changed from index 39 to 40, VOTER bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131) added. New cstate: current_term: 2 leader_uuid: "0ba29ed110c14d41b150bbc1c237b617" committed_config { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } } }
I20260812 08:02:46.341336  9493 ts_tablet_manager.cc:933] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Initiating tablet copy from peer 0ba29ed110c14d41b150bbc1c237b617 (127.31.239.130:46207)
I20260812 08:02:46.341956  9493 tablet_copy_client.cc:323] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.31.239.130:46207
I20260812 08:02:46.342907  9203 tablet_copy_service.cc:140] P 0ba29ed110c14d41b150bbc1c237b617: Received BeginTabletCopySession request for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 from peer bf783896a9ce4f86ab1becb2c2480ab4 ({username='slave'} at 127.31.239.131:42975)
I20260812 08:02:46.343101  9203 tablet_copy_service.cc:161] P 0ba29ed110c14d41b150bbc1c237b617: Beginning new tablet copy session on tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 from peer bf783896a9ce4f86ab1becb2c2480ab4 at {username='slave'} at 127.31.239.131:42975: session id = bf783896a9ce4f86ab1becb2c2480ab4-8f53b78433d54753bdcf2c7c2ef6ccc8
I20260812 08:02:46.344599  9203 tablet_copy_source_session.cc:215] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Tablet Copy: opened 5 blocks and 3 log segments
I20260812 08:02:46.346263  9493 ts_tablet_manager.cc:1916] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:46.348170  9493 ts_tablet_manager.cc:1929] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260812 08:02:46.348419  9493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 08:02:46.349502  9493 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 08:02:46.349567  9493 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20260812 08:02:46.349601  9493 fault_injection.cc:59] injecting fault for kudu (pid 9237): FLAGS_tablet_copy_fault_crash_on_fetch_all (process will exit)
I20260812 08:02:46.379323 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 8930
I20260812 08:02:46.390877 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 9087
I20260812 08:02:46.402231 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 8824
I20260812 08:02:46.413586 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:40653
--webserver_interface=127.31.239.190
--webserver_port=41209
--builtin_ntp_servers=127.31.239.148:36323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:40653
--master_add_server_when_underreplicated=false
--raft_prepare_replacement_before_eviction=false with env {}
W20260812 08:02:46.518374  9495 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:46.518661  9495 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:46.518770  9495 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:46.522229  9495 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:46.522323  9495 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:46.522367  9495 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:46.522408  9495 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:46.522445  9495 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:46.526448  9495 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--master_add_server_when_underreplicated=false
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:40653
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:40653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=41209
--never_fsync=true
--heap_profile_path=/tmp/kudu.9495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:46.527700  9495 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:46.528855  9495 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:46.534233  9501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:46.534284  9504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:46.534228  9500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:46.534657  9495 server_base.cc:1061] running on GCE node
I20260812 08:02:46.535163  9495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:46.536057  9495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:46.537294  9495 hybrid_clock.cc:648] HybridClock initialized: now 1786521766537276 us; error 37 us; skew 500 ppm
I20260812 08:02:46.539348  9495 webserver.cc:533] Webserver started at http://127.31.239.190:41209/ using document root <none> and password file <none>
I20260812 08:02:46.539938  9495 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:46.540043  9495 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:46.543584  9495 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:46.545650  9511 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:46.546681  9495 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:46.546833  9495 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "a1df50dc33f64cdd85f9294f44709619"
format_stamp: "Formatted at 2026-08-12 08:02:40 on dist-test-slave-9jjr"
I20260812 08:02:46.547293  9495 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:46.556941  9495 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:46.557663  9495 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:46.557873  9495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:46.566040  9495 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:40653
I20260812 08:02:46.566082  9570 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:40653 every 8 connection(s)
I20260812 08:02:46.567260  9495 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:46.570322 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 9495
I20260812 08:02:46.570832 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:46207
--local_ip_for_outbound_sockets=127.31.239.130
--tserver_master_addrs=127.31.239.190:40653
--webserver_port=42953
--webserver_interface=127.31.239.130
--builtin_ntp_servers=127.31.239.148:36323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260812 08:02:46.571522  9571 sys_catalog.cc:263] Verifying existing consensus state
I20260812 08:02:46.573762  9571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Bootstrap starting.
I20260812 08:02:46.589731  9571 log.cc:826] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:46.598824  9571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=5 ignored=0} mutations{seen=5 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:02:46.599294  9571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Bootstrap complete.
I20260812 08:02:46.602979  9571 raft_consensus.cc:359] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } }
I20260812 08:02:46.603309  9571 raft_consensus.cc:740] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1df50dc33f64cdd85f9294f44709619, State: Initialized, Role: FOLLOWER
I20260812 08:02:46.603796  9571 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } }
I20260812 08:02:46.603909  9571 raft_consensus.cc:399] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:46.604009  9571 raft_consensus.cc:493] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:46.604157  9571 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:46.605724  9571 raft_consensus.cc:515] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } }
I20260812 08:02:46.606065  9571 leader_election.cc:304] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1df50dc33f64cdd85f9294f44709619; no voters: 
I20260812 08:02:46.606457  9571 leader_election.cc:290] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 08:02:46.606559  9577 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:02:46.606756  9577 raft_consensus.cc:697] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [term 2 LEADER]: Becoming Leader. State: Replica: a1df50dc33f64cdd85f9294f44709619, State: Running, Role: LEADER
I20260812 08:02:46.607122  9577 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } }
I20260812 08:02:46.607632  9571 sys_catalog.cc:565] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:46.608022  9577 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1df50dc33f64cdd85f9294f44709619. Latest consensus state: current_term: 2 leader_uuid: "a1df50dc33f64cdd85f9294f44709619" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } } }
I20260812 08:02:46.608215  9577 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:46.608398  9579 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a1df50dc33f64cdd85f9294f44709619" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1df50dc33f64cdd85f9294f44709619" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 40653 } } }
I20260812 08:02:46.608577  9579 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619 [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:46.608650  9584 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:46.612437  9584 catalog_manager.cc:679] Loaded metadata for table TestTable [id=ca32a56ba7824eaf8f6ed2522a59d6c9]
I20260812 08:02:46.613898  9584 tablet_loader.cc:96] loaded metadata for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 (table TestTable [id=ca32a56ba7824eaf8f6ed2522a59d6c9])
I20260812 08:02:46.614089  9584 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:46.614820  9584 catalog_manager.cc:1295] Loaded cluster ID: 83069dc452c34f24b6c0c143be4fea3d
I20260812 08:02:46.614885  9584 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:46.617214  9584 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:46.617923  9584 catalog_manager.cc:6103] T 00000000000000000000000000000000 P a1df50dc33f64cdd85f9294f44709619: Loaded TSK: 0
I20260812 08:02:46.618920  9584 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260812 08:02:46.688026  9575 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:02:46.688383  9575 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:46.688441  9575 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:46.688524  9575 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:46.692132  9575 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:02:46.692241  9575 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:02:46.692291  9575 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:46.692346  9575 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:46.692457  9575 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:02:46.692519  9575 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:46.696729  9575 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:46207
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=42953
--tserver_master_addrs=127.31.239.190:40653
--never_fsync=true
--heap_profile_path=/tmp/kudu.9575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:46.698161  9575 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:46.699381  9575 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:46.706322  9606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:46.706332  9605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:46.706612  9575 server_base.cc:1061] running on GCE node
W20260812 08:02:46.706341  9608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:46.707212  9575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:46.707810  9575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:46.708992  9575 hybrid_clock.cc:648] HybridClock initialized: now 1786521766708949 us; error 63 us; skew 500 ppm
I20260812 08:02:46.711012  9575 webserver.cc:533] Webserver started at http://127.31.239.130:42953/ using document root <none> and password file <none>
I20260812 08:02:46.711633  9575 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:46.711736  9575 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:46.715376  9575 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.003s
I20260812 08:02:46.720976  9620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:46.721968  9575 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.000s
I20260812 08:02:46.722069  9575 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "0ba29ed110c14d41b150bbc1c237b617"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:46.722559  9575 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 5
Total live bytes: 136535
Total live bytes (after alignment): 155648
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:46.741232  9575 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:46.741961  9575 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:46.742220  9575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:46.742878  9575 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:46.744202  9627 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:02:46.749290  9575 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:02:46.749406  9575 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s	user 0.000s	sys 0.000s
I20260812 08:02:46.749506  9575 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:02:46.751186  9575 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:02:46.751267  9575 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:46.751725  9627 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Bootstrap starting.
I20260812 08:02:46.763512  9575 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:46207
I20260812 08:02:46.763619  9743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:46207 every 8 connection(s)
I20260812 08:02:46.764644  9575 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:46.766594  9627 log.cc:826] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:46.769604 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 9575
I20260812 08:02:46.770190 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:37503
--local_ip_for_outbound_sockets=127.31.239.131
--tserver_master_addrs=127.31.239.190:40653
--webserver_port=34511
--webserver_interface=127.31.239.131
--builtin_ntp_servers=127.31.239.148:36323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=false
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20260812 08:02:46.776355  9627 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Bootstrap replayed 1/3 log segments. Stats: ops{read=7 overwritten=0 applied=4 ignored=4} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 3 replicates
I20260812 08:02:46.779270  9744 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40653
I20260812 08:02:46.779567  9744 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:46.780097  9744 heartbeater.cc:507] Master 127.31.239.190:40653 requested a full tablet report, sending...
I20260812 08:02:46.782449  9627 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Bootstrap replayed 2/3 log segments. Stats: ops{read=14 overwritten=0 applied=12 ignored=12} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 2 replicates
I20260812 08:02:46.782976  9529 ts_manager.cc:194] Registered new tserver with Master: 0ba29ed110c14d41b150bbc1c237b617 (127.31.239.130:46207)
I20260812 08:02:46.785166  9627 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Bootstrap replayed 3/3 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=15} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates
I20260812 08:02:46.785676  9627 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Bootstrap complete.
I20260812 08:02:46.786121  9529 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:48839
I20260812 08:02:46.786968  9627 ts_tablet_manager.cc:1403] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Time spent bootstrapping tablet: real 0.036s	user 0.030s	sys 0.003s
I20260812 08:02:46.789662  9627 raft_consensus.cc:359] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } }
I20260812 08:02:46.790189  9627 raft_consensus.cc:740] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba29ed110c14d41b150bbc1c237b617, State: Initialized, Role: FOLLOWER
I20260812 08:02:46.790776  9627 consensus_queue.cc:260] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 40, Last appended: 2.40, Last appended by leader: 40, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } }
I20260812 08:02:46.791530  9744 heartbeater.cc:499] Master 127.31.239.190:40653 was elected leader, sending a full tablet report...
I20260812 08:02:46.791815  9627 ts_tablet_manager.cc:1434] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260812 08:02:46.866825  9745 maintenance_manager.cc:419] P 0ba29ed110c14d41b150bbc1c237b617: Scheduling UndoDeltaBlockGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8): 534 bytes on disk
I20260812 08:02:46.867920  9625 maintenance_manager.cc:643] P 0ba29ed110c14d41b150bbc1c237b617: UndoDeltaBlockGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
W20260812 08:02:46.890372  9750 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20260812 08:02:46.890648  9750 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:46.890671  9750 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:46.890821  9750 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:46.894368  9750 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20260812 08:02:46.894438  9750 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20260812 08:02:46.894464  9750 flags.cc:432] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false
W20260812 08:02:46.894488  9750 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:46.894626  9750 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20260812 08:02:46.894665  9750 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:02:46.898893  9750 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:36323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--raft_prepare_replacement_before_eviction=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:37503
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=34511
--tserver_master_addrs=127.31.239.190:40653
--never_fsync=true
--heap_profile_path=/tmp/kudu.9750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:46.900063  9750 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:46.901243  9750 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:46.908325  9757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:46.908332  9758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:46.908387  9760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:46.908581  9750 server_base.cc:1061] running on GCE node
I20260812 08:02:46.909134  9750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:46.909825  9750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:46.910991  9750 hybrid_clock.cc:648] HybridClock initialized: now 1786521766910951 us; error 55 us; skew 500 ppm
I20260812 08:02:46.912937  9750 webserver.cc:533] Webserver started at http://127.31.239.131:34511/ using document root <none> and password file <none>
I20260812 08:02:46.913543  9750 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:46.913645  9750 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:46.917222  9750 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:46.919483  9767 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:46.920884  9750 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.001s
I20260812 08:02:46.920996  9750 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "bf783896a9ce4f86ab1becb2c2480ab4"
format_stamp: "Formatted at 2026-08-12 08:02:41 on dist-test-slave-9jjr"
I20260812 08:02:46.921501  9750 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:46.940356  9750 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:46.941071  9750 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:46.941277  9750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:46.941888  9750 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:46.943183  9774 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260812 08:02:46.946350  9774 ts_tablet_manager.cc:1863] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_COPYING
I20260812 08:02:46.947465  9774 ts_tablet_manager.cc:1916] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:46.950932  9774 ts_tablet_manager.cc:1929] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:46.951798  9750 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260812 08:02:46.951884  9750 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.009s	user 0.000s	sys 0.000s
I20260812 08:02:46.951960  9750 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:46.952003  9750 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:46.962047  9750 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:37503
I20260812 08:02:46.962070  9896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:37503 every 8 connection(s)
I20260812 08:02:46.963128  9750 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:02:46.969137 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 9750
I20260812 08:02:46.972378  9898 heartbeater.cc:344] Connected to a master server at 127.31.239.190:40653
I20260812 08:02:46.972669  9898 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:46.973137  9898 heartbeater.cc:507] Master 127.31.239.190:40653 requested a full tablet report, sending...
I20260812 08:02:46.974810  9529 ts_manager.cc:194] Registered new tserver with Master: bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503)
I20260812 08:02:46.975554  9529 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:49533
I20260812 08:02:46.980350 32702 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
W20260812 08:02:47.006662  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.006662  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.006662  9650 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.006662  9647 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.012073  9904 meta_cache.cc:302] tablet 8f53b78433d54753bdcf2c7c2ef6ccc8: replica 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521) has failed: Network error: Client connection negotiation failed: client connection to 127.31.239.129:42521: connect: Connection refused (error 111)
W20260812 08:02:47.025434  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.026165  9650 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.026505  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.036471  9650 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.036489  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.036489  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.047767  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.055783  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.068050  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.068050  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.082525  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.082525  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.093313  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.101305  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.113564  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.126717  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.145046  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.150995  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.168100  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.187882  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.208292  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.232420  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.254637  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.263906  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.286003  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.306571  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.333801  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.333801  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.360993  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.361076  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.361747  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.390931  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.390923  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.418933  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.442027  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.475582  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.497826  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.514953  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.539812  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.572078  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.572908  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.605883  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.632668  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.652405  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.679509  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.713804  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.746793  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.764820  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.807615  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.835361  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.876253  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.877048  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.920219  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.920219  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.962637  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:47.963567  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
I20260812 08:02:47.977322  9898 heartbeater.cc:499] Master 127.31.239.190:40653 was elected leader, sending a full tablet report...
W20260812 08:02:48.006857  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.007721  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.021714  9904 meta_cache.cc:302] tablet 8f53b78433d54753bdcf2c7c2ef6ccc8: replica 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521) has failed: Network error: Client connection negotiation failed: client connection to 127.31.239.129:42521: connect: Connection refused (error 111)
W20260812 08:02:48.053915  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.054585  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.104035  9649 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.104071  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.151297  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.178791  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.208339  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.249572  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.296104  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
W20260812 08:02:48.329294  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
I20260812 08:02:48.354112  9914 raft_consensus.cc:493] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:48.354401  9914 raft_consensus.cc:515] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } }
I20260812 08:02:48.355489  9914 leader_election.cc:290] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521), bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503)
W20260812 08:02:48.356320  9624 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.239.129:42521: connect: Connection refused (error 111)
W20260812 08:02:48.357259  9624 leader_election.cc:336] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521): Network error: Client connection negotiation failed: client connection to 127.31.239.129:42521: connect: Connection refused (error 111)
I20260812 08:02:48.359805  9844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "0ba29ed110c14d41b150bbc1c237b617" candidate_term: 3 candidate_status { last_received { term: 2 index: 40 } } ignore_live_leader: false dest_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" is_pre_election: true
I20260812 08:02:48.360724  9844 raft_consensus.cc:1803] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.1
I20260812 08:02:48.361102  9844 raft_consensus.cc:2468] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba29ed110c14d41b150bbc1c237b617 in term 2.
I20260812 08:02:48.361541  9623 leader_election.cc:304] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ba29ed110c14d41b150bbc1c237b617, bf783896a9ce4f86ab1becb2c2480ab4; no voters: 8155ee9e10f646f7be71c52b760edfbb
I20260812 08:02:48.361776  9914 raft_consensus.cc:2804] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:02:48.361867  9914 raft_consensus.cc:493] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:48.361927  9914 raft_consensus.cc:3060] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 2 FOLLOWER]: Advancing to term 3
W20260812 08:02:48.363015  9648 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35326: Illegal state: replica 0ba29ed110c14d41b150bbc1c237b617 is not leader of this config: current role FOLLOWER
I20260812 08:02:48.363843  9914 raft_consensus.cc:515] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } }
I20260812 08:02:48.364207  9914 leader_election.cc:290] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 3 election: Requested vote from peers 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521), bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503)
I20260812 08:02:48.364698  9844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f53b78433d54753bdcf2c7c2ef6ccc8" candidate_uuid: "0ba29ed110c14d41b150bbc1c237b617" candidate_term: 3 candidate_status { last_received { term: 2 index: 40 } } ignore_live_leader: false dest_uuid: "bf783896a9ce4f86ab1becb2c2480ab4"
I20260812 08:02:48.364840  9844 raft_consensus.cc:1803] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.1
I20260812 08:02:48.364925  9844 raft_consensus.cc:3060] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 2 FOLLOWER]: Advancing to term 3
W20260812 08:02:48.365279  9624 leader_election.cc:336] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521): Network error: Client connection negotiation failed: client connection to 127.31.239.129:42521: connect: Connection refused (error 111)
I20260812 08:02:48.365965  9844 raft_consensus.cc:2468] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba29ed110c14d41b150bbc1c237b617 in term 3.
I20260812 08:02:48.366308  9623 leader_election.cc:304] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ba29ed110c14d41b150bbc1c237b617, bf783896a9ce4f86ab1becb2c2480ab4; no voters: 8155ee9e10f646f7be71c52b760edfbb
I20260812 08:02:48.366489  9914 raft_consensus.cc:2804] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:02:48.366709  9914 raft_consensus.cc:697] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [term 3 LEADER]: Becoming Leader. State: Replica: 0ba29ed110c14d41b150bbc1c237b617, State: Running, Role: LEADER
I20260812 08:02:48.367023  9914 consensus_queue.cc:237] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 2.40, Last appended by leader: 40, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } }
I20260812 08:02:48.369774  9528 catalog_manager.cc:5719] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "0ba29ed110c14d41b150bbc1c237b617" committed_config { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } } }
W20260812 08:02:48.408234  9623 consensus_peers.cc:597] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 -> Peer bf783896a9ce4f86ab1becb2c2480ab4 (127.31.239.131:37503): Couldn't send request to peer bf783896a9ce4f86ab1becb2c2480ab4. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:48.408377  9624 consensus_peers.cc:597] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617 -> Peer 8155ee9e10f646f7be71c52b760edfbb (127.31.239.129:42521): Couldn't send request to peer 8155ee9e10f646f7be71c52b760edfbb. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.129:42521: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:02:49.016661  9928 tablet_replica.cc:333] stopping tablet replica
I20260812 08:02:49.016865  9928 raft_consensus.cc:2243] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:49.016954  9928 raft_consensus.cc:2272] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:49.017119  9928 ts_tablet_manager.cc:933] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Initiating tablet copy from peer 0ba29ed110c14d41b150bbc1c237b617 (127.31.239.130:46207)
I20260812 08:02:49.017658  9928 tablet_copy_client.cc:323] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.31.239.130:46207
I20260812 08:02:49.021898  9716 tablet_copy_service.cc:140] P 0ba29ed110c14d41b150bbc1c237b617: Received BeginTabletCopySession request for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 from peer bf783896a9ce4f86ab1becb2c2480ab4 ({username='slave'} at 127.31.239.131:56173)
I20260812 08:02:49.022037  9716 tablet_copy_service.cc:161] P 0ba29ed110c14d41b150bbc1c237b617: Beginning new tablet copy session on tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 from peer bf783896a9ce4f86ab1becb2c2480ab4 at {username='slave'} at 127.31.239.131:56173: session id = bf783896a9ce4f86ab1becb2c2480ab4-8f53b78433d54753bdcf2c7c2ef6ccc8
I20260812 08:02:49.023435  9716 tablet_copy_source_session.cc:215] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P 0ba29ed110c14d41b150bbc1c237b617: Tablet Copy: opened 5 blocks and 3 log segments
I20260812 08:02:49.025329  9928 ts_tablet_manager.cc:1916] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260812 08:02:49.027781  9928 ts_tablet_manager.cc:1929] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.1
I20260812 08:02:49.028121  9928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f53b78433d54753bdcf2c7c2ef6ccc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:49.029386  9928 tablet_copy_client.cc:806] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet copy: Starting download of 5 data blocks...
I20260812 08:02:49.037925  9928 tablet_copy_client.cc:670] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet copy: Starting download of 3 WAL segments...
I20260812 08:02:49.048228  9928 tablet_copy_client.cc:538] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 08:02:49.050392  9928 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Bootstrap starting.
I20260812 08:02:49.057473  9928 log.cc:826] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:49.063948  9928 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Bootstrap replayed 1/3 log segments. Stats: ops{read=7 overwritten=0 applied=4 ignored=4} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260812 08:02:49.068710  9928 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Bootstrap replayed 2/3 log segments. Stats: ops{read=14 overwritten=0 applied=12 ignored=12} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260812 08:02:49.071478  9928 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Bootstrap replayed 3/3 log segments. Stats: ops{read=22 overwritten=0 applied=17 ignored=15} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 5 replicates
I20260812 08:02:49.071861  9928 tablet_bootstrap.cc:492] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Bootstrap complete.
I20260812 08:02:49.072564  9928 ts_tablet_manager.cc:1403] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260812 08:02:49.074012  9928 raft_consensus.cc:359] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 3 FOLLOWER]: Replica starting. Triggering 5 pending ops. Active config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } }
I20260812 08:02:49.075683  9928 raft_consensus.cc:740] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf783896a9ce4f86ab1becb2c2480ab4, State: Initialized, Role: FOLLOWER
I20260812 08:02:49.076155  9928 consensus_queue.cc:260] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 40, Last appended: 3.45, Last appended by leader: 45, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "8155ee9e10f646f7be71c52b760edfbb" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 42521 } } peers { permanent_uuid: "0ba29ed110c14d41b150bbc1c237b617" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 46207 } } peers { permanent_uuid: "bf783896a9ce4f86ab1becb2c2480ab4" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 37503 } attrs { } }
I20260812 08:02:49.077049  9928 ts_tablet_manager.cc:1434] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:02:49.078047  9715 tablet_copy_service.cc:342] P 0ba29ed110c14d41b150bbc1c237b617: Request end of tablet copy session bf783896a9ce4f86ab1becb2c2480ab4-8f53b78433d54753bdcf2c7c2ef6ccc8 received from {username='slave'} at 127.31.239.131:56173
I20260812 08:02:49.078197  9715 tablet_copy_service.cc:434] P 0ba29ed110c14d41b150bbc1c237b617: ending tablet copy session bf783896a9ce4f86ab1becb2c2480ab4-8f53b78433d54753bdcf2c7c2ef6ccc8 on tablet 8f53b78433d54753bdcf2c7c2ef6ccc8 with peer bf783896a9ce4f86ab1becb2c2480ab4
I20260812 08:02:49.169392  9899 maintenance_manager.cc:419] P bf783896a9ce4f86ab1becb2c2480ab4: Scheduling UndoDeltaBlockGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8): 534 bytes on disk
I20260812 08:02:49.170663  9772 maintenance_manager.cc:643] P bf783896a9ce4f86ab1becb2c2480ab4: UndoDeltaBlockGCOp(8f53b78433d54753bdcf2c7c2ef6ccc8) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":99,"lbm_reads_lt_1ms":4}
I20260812 08:02:49.610155  9844 raft_consensus.cc:1217] T 8f53b78433d54753bdcf2c7c2ef6ccc8 P bf783896a9ce4f86ab1becb2c2480ab4 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 2.40->[3.41-3.45]   Dedup: 3.45->[]
I20260812 08:02:49.618167  9947 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35326 (ReqId={client: 9604ac22ed7147c08ebf54ff226260c6, seq_no=1, attempt_no=51}) took 1093 ms. Trace:
I20260812 08:02:49.618219  9946 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35326 (ReqId={client: 9604ac22ed7147c08ebf54ff226260c6, seq_no=0, attempt_no=49}) took 1163 ms. Trace:
I20260812 08:02:49.618510  9946 rpcz_store.cc:276] 0812 08:02:48.454406 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:48.454491 (+    85us) service_pool.cc:224] Handling call
0812 08:02:49.618205 (+1163714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:48.455023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 8f53b78433d54753bdcf2c7c2ef6ccc8
0812 08:02:48.455144 (+   121us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:48.455151 (+     7us) write_op.cc:435] Acquired schema lock
0812 08:02:48.455154 (+     3us) tablet.cc:662] Decoding operations
0812 08:02:48.455475 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:48.455528 (+    53us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:48.455533 (+     5us) tablet.cc:685] Acquiring locks for 50 operations
0812 08:02:48.455870 (+   337us) tablet.cc:701] Row locks acquired
0812 08:02:48.455872 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:48.455921 (+    49us) write_op.cc:270] Start()
0812 08:02:48.455955 (+    34us) write_op.cc:276] Timestamp: P: 1786521768455869 usec, L: 0
0812 08:02:48.455958 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:48.456139 (+   181us) log.cc:844] Serialized 2455 byte log entry
0812 08:02:49.612416 (+1156277us) op_driver.cc:464] REPLICATION: finished
0812 08:02:49.612973 (+   557us) write_op.cc:301] APPLY: starting
0812 08:02:49.612987 (+    14us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:49.613908 (+   921us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:49.613926 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:49.617551 (+  3625us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:49.617683 (+   132us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=49,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:49.617697 (+    14us) write_op.cc:312] APPLY: finished
0812 08:02:49.617839 (+   142us) log.cc:844] Serialized 319 byte log entry
0812 08:02:49.618033 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:49.618052 (+    19us) write_op.cc:454] Released schema lock
0812 08:02:49.618151 (+    99us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":503,"cfile_cache_miss":2,"cfile_cache_miss_bytes":4127,"lbm_read_time_us":40,"lbm_reads_lt_1ms":2,"mutex_wait_us":20,"num_ops":50,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":1261,"prepare.run_wall_time_us":1264,"raft.queue_time_us":118,"raft.run_cpu_time_us":17,"raft.run_wall_time_us":18,"replication_time_us":1156437,"spinlock_wait_cycles":10496,"thread_start_us":116,"threads_started":1}]]}
I20260812 08:02:49.618381  9947 rpcz_store.cc:276] 0812 08:02:48.524785 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:48.524893 (+   108us) service_pool.cc:224] Handling call
0812 08:02:49.618096 (+1093203us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:48.525412 (+     0us) write_op.cc:183] PREPARE: starting on tablet 8f53b78433d54753bdcf2c7c2ef6ccc8
0812 08:02:48.525542 (+   130us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:48.525547 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:48.525548 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:48.525808 (+   260us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:48.525817 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:48.525820 (+     3us) tablet.cc:685] Acquiring locks for 50 operations
0812 08:02:48.525991 (+   171us) tablet.cc:701] Row locks acquired
0812 08:02:48.525992 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:48.526038 (+    46us) write_op.cc:270] Start()
0812 08:02:48.526113 (+    75us) write_op.cc:276] Timestamp: P: 1786521768525983 usec, L: 0
0812 08:02:48.526114 (+     1us) op_driver.cc:348] REPLICATION: starting
0812 08:02:48.526326 (+   212us) log.cc:844] Serialized 2455 byte log entry
0812 08:02:49.612589 (+1086263us) op_driver.cc:464] REPLICATION: finished
0812 08:02:49.613008 (+   419us) write_op.cc:301] APPLY: starting
0812 08:02:49.613025 (+    17us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:49.613909 (+   884us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:49.613926 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:49.617594 (+  3668us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:49.617684 (+    90us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:49.617699 (+    15us) write_op.cc:312] APPLY: finished
0812 08:02:49.617849 (+   150us) log.cc:844] Serialized 319 byte log entry
0812 08:02:49.617915 (+    66us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:49.617971 (+    56us) write_op.cc:454] Released schema lock
0812 08:02:49.617982 (+    11us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":375,"cfile_cache_miss":2,"cfile_cache_miss_bytes":4127,"lbm_read_time_us":42,"lbm_reads_lt_1ms":2,"mutex_wait_us":51,"num_ops":50,"prepare.queue_time_us":65,"prepare.run_cpu_time_us":1106,"prepare.run_wall_time_us":1106,"raft.queue_time_us":163,"raft.run_cpu_time_us":16,"raft.run_wall_time_us":18,"replication_time_us":1086457,"spinlock_wait_cycles":5888,"thread_start_us":75,"threads_started":1}]]}
I20260812 08:02:49.618243  9945 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:35326 (ReqId={client: 9604ac22ed7147c08ebf54ff226260c6, seq_no=2, attempt_no=48}) took 1214 ms. Trace:
I20260812 08:02:49.619462  9945 rpcz_store.cc:276] 0812 08:02:48.404042 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:48.404121 (+    79us) service_pool.cc:224] Handling call
0812 08:02:49.618233 (+1214112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:48.404893 (+     0us) write_op.cc:183] PREPARE: starting on tablet 8f53b78433d54753bdcf2c7c2ef6ccc8
0812 08:02:48.405016 (+   123us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:48.405025 (+     9us) write_op.cc:435] Acquired schema lock
0812 08:02:48.405026 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:48.405630 (+   604us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:48.405681 (+    51us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:48.405685 (+     4us) tablet.cc:685] Acquiring locks for 50 operations
0812 08:02:48.406440 (+   755us) tablet.cc:701] Row locks acquired
0812 08:02:48.406442 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:48.406509 (+    67us) write_op.cc:270] Start()
0812 08:02:48.406545 (+    36us) write_op.cc:276] Timestamp: P: 1786521768406461 usec, L: 0
0812 08:02:48.406548 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:48.406745 (+   197us) log.cc:844] Serialized 2455 byte log entry
0812 08:02:49.612228 (+1205483us) op_driver.cc:464] REPLICATION: finished
0812 08:02:49.612496 (+   268us) write_op.cc:301] APPLY: starting
0812 08:02:49.612522 (+    26us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:49.614859 (+  2337us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:49.614869 (+    10us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:49.617920 (+  3051us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:49.617963 (+    43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:49.617968 (+     5us) write_op.cc:312] APPLY: finished
0812 08:02:49.618039 (+    71us) log.cc:844] Serialized 319 byte log entry
0812 08:02:49.618102 (+    63us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:49.618143 (+    41us) write_op.cc:454] Released schema lock
0812 08:02:49.618150 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":156,"cfile_cache_hit":2,"cfile_cache_hit_bytes":4127,"cfile_init":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4,"num_ops":50,"prepare.queue_time_us":268,"prepare.run_cpu_time_us":2037,"prepare.run_wall_time_us":2037,"raft.queue_time_us":144,"raft.run_cpu_time_us":563,"raft.run_wall_time_us":564,"replication_time_us":1205622,"spinlock_wait_cycles":274176,"thread_start_us":207,"threads_started":2}]]}
I20260812 08:02:50.014880 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 9575
I20260812 08:02:50.025848 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 9750
I20260812 08:02:50.035115 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 9495
2026-08-12T08:02:50Z chronyd exiting
[       OK ] RaftConsensusElectionITest.TombstonedVoteAfterFailedTabletCopy (9367 ms)
[ RUN      ] RaftConsensusElectionITest.DisruptiveServerAndSlowWAL
I20260812 08:02:50.064496 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:50.064555 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:50.064567 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:02:50.064579 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:02:50.064589 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:50Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:50Z Disabled control of system clock
I20260812 08:02:50.074658 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:35885
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:32931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:35885 with env {}
W20260812 08:02:50.179800  9968 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:50.180086  9968 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:50.180174  9968 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:50.183614  9968 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:50.183717  9968 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:50.183754  9968 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:50.183784  9968 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:50.187597  9968 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:35885
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:35885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:50.188748  9968 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:50.189911  9968 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:50.195611  9973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.195663  9976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.195611  9974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:50.195961  9968 server_base.cc:1061] running on GCE node
I20260812 08:02:50.196491  9968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:50.197429  9968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:50.198613  9968 hybrid_clock.cc:648] HybridClock initialized: now 1786521770198593 us; error 36 us; skew 500 ppm
I20260812 08:02:50.200525  9968 webserver.cc:533] Webserver started at http://127.31.239.190:34829/ using document root <none> and password file <none>
I20260812 08:02:50.201138  9968 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:50.201227  9968 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:50.201470  9968 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:50.203150  9968 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "1d6d9aedff554fd89886ac0ef3dd179b"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.203663  9968 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "1d6d9aedff554fd89886ac0ef3dd179b"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.207170  9968 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:50.209537  9984 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.210736  9968 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:50.210896  9968 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "1d6d9aedff554fd89886ac0ef3dd179b"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.211011  9968 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:50.224828  9968 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:50.225560  9968 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:50.225772  9968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:50.233825 10045 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:35885 every 8 connection(s)
I20260812 08:02:50.233834  9968 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:35885
I20260812 08:02:50.234972  9968 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:50.237877 10046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:50.240419 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 9968
I20260812 08:02:50.240585 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:50.243676 10046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b: Bootstrap starting.
I20260812 08:02:50.246409 10046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:50.247215 10046 log.cc:826] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:50.248970 10046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b: No bootstrap required, opened a new log
I20260812 08:02:50.251533 10046 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6d9aedff554fd89886ac0ef3dd179b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 35885 } }
I20260812 08:02:50.251709 10046 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:50.251770 10046 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6d9aedff554fd89886ac0ef3dd179b, State: Initialized, Role: FOLLOWER
I20260812 08:02:50.252210 10046 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6d9aedff554fd89886ac0ef3dd179b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 35885 } }
I20260812 08:02:50.252332 10046 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:50.252419 10046 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:50.252560 10046 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:50.253470 10046 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6d9aedff554fd89886ac0ef3dd179b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 35885 } }
I20260812 08:02:50.253851 10046 leader_election.cc:304] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d6d9aedff554fd89886ac0ef3dd179b; no voters: 
I20260812 08:02:50.254251 10046 leader_election.cc:290] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:50.254340 10054 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:50.254549 10054 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [term 1 LEADER]: Becoming Leader. State: Replica: 1d6d9aedff554fd89886ac0ef3dd179b, State: Running, Role: LEADER
I20260812 08:02:50.254885 10054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6d9aedff554fd89886ac0ef3dd179b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 35885 } }
I20260812 08:02:50.255463 10046 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:50.256500 10055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d6d9aedff554fd89886ac0ef3dd179b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6d9aedff554fd89886ac0ef3dd179b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 35885 } } }
I20260812 08:02:50.256676 10055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:50.257422 10056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d6d9aedff554fd89886ac0ef3dd179b. Latest consensus state: current_term: 1 leader_uuid: "1d6d9aedff554fd89886ac0ef3dd179b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6d9aedff554fd89886ac0ef3dd179b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 35885 } } }
I20260812 08:02:50.257530 10056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b [sys.catalog]: This master's current role is: LEADER
W20260812 08:02:50.260776 10071 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 08:02:50.260915 10071 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 08:02:50.261000 10064 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:50.261770 10064 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:50.266943 10064 catalog_manager.cc:1383] Generated new cluster ID: cca2a1ca1ad34da1b03f74e340c6c313
I20260812 08:02:50.267017 10064 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:50.288671 10064 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:50.289950 10064 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:50.297997 10064 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 1d6d9aedff554fd89886ac0ef3dd179b: Generated new TSK 0
I20260812 08:02:50.298921 10064 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:50.310194 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:35885
--builtin_ntp_servers=127.31.239.148:32931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--leader_failure_max_missed_heartbeat_periods=3 with env {}
W20260812 08:02:50.425415 10074 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:50.425648 10074 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:50.425695 10074 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:50.429582 10074 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:50.429723 10074 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:50.434062 10074 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:35885
--never_fsync=true
--heap_profile_path=/tmp/kudu.10074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:50.435410 10074 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:50.436723 10074 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:50.443629 10081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.443707 10082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.443661 10085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:50.443945 10074 server_base.cc:1061] running on GCE node
I20260812 08:02:50.444453 10074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:50.445078 10074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:50.446266 10074 hybrid_clock.cc:648] HybridClock initialized: now 1786521770446235 us; error 57 us; skew 500 ppm
I20260812 08:02:50.448153 10074 webserver.cc:533] Webserver started at http://127.31.239.129:34939/ using document root <none> and password file <none>
I20260812 08:02:50.448776 10074 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:50.448868 10074 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:50.449143 10074 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:50.450889 10074 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "2a23723760e9427bade6faec52f732a1"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.451402 10074 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "2a23723760e9427bade6faec52f732a1"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.455052 10074 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:02:50.457398 10092 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.458500 10074 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:50.458597 10074 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "2a23723760e9427bade6faec52f732a1"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.458683 10074 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:50.476444 10074 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:50.477137 10074 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:50.477417 10074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:50.478063 10074 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:50.479202 10074 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:50.479252 10074 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.479326 10074 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:50.479365 10074 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.489434 10074 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:34743
I20260812 08:02:50.489467 10222 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:34743 every 8 connection(s)
I20260812 08:02:50.490610 10074 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:50.497843 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 10074
I20260812 08:02:50.498020 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:50.500434 10223 heartbeater.cc:344] Connected to a master server at 127.31.239.190:35885
I20260812 08:02:50.500737 10223 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.500833 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:35885
--builtin_ntp_servers=127.31.239.148:32931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--leader_failure_max_missed_heartbeat_periods=3 with env {}
I20260812 08:02:50.501379 10223 heartbeater.cc:507] Master 127.31.239.190:35885 requested a full tablet report, sending...
I20260812 08:02:50.502990 10002 ts_manager.cc:194] Registered new tserver with Master: 2a23723760e9427bade6faec52f732a1 (127.31.239.129:34743)
I20260812 08:02:50.504264 10002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:37173
W20260812 08:02:50.613612 10227 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:50.613875 10227 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:50.613926 10227 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:50.617772 10227 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:50.617903 10227 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:50.622251 10227 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:35885
--never_fsync=true
--heap_profile_path=/tmp/kudu.10227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:50.623477 10227 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:50.624652 10227 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:50.631644 10233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.631645 10236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:50.631744 10227 server_base.cc:1061] running on GCE node
W20260812 08:02:50.631654 10234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:50.632298 10227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:50.632925 10227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:50.634110 10227 hybrid_clock.cc:648] HybridClock initialized: now 1786521770634075 us; error 51 us; skew 500 ppm
I20260812 08:02:50.636054 10227 webserver.cc:533] Webserver started at http://127.31.239.130:38121/ using document root <none> and password file <none>
I20260812 08:02:50.636685 10227 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:50.636777 10227 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:50.636982 10227 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:50.638775 10227 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "8120afcb83af4da0896fe18194b6bfed"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.639310 10227 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "8120afcb83af4da0896fe18194b6bfed"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.643029 10227 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:50.645566 10242 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.646826 10227 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:50.646977 10227 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "8120afcb83af4da0896fe18194b6bfed"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.647143 10227 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:50.679059 10227 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:50.679837 10227 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:50.680064 10227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:50.680744 10227 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:50.681872 10227 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:50.681926 10227 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.681994 10227 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:50.682034 10227 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.692386 10227 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:35475
I20260812 08:02:50.692423 10372 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:35475 every 8 connection(s)
I20260812 08:02:50.693516 10227 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:50.699015 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 10227
I20260812 08:02:50.699167 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:02:50.702219 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:35885
--builtin_ntp_servers=127.31.239.148:32931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--leader_failure_max_missed_heartbeat_periods=3 with env {}
I20260812 08:02:50.704135 10373 heartbeater.cc:344] Connected to a master server at 127.31.239.190:35885
I20260812 08:02:50.704469 10373 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.705056 10373 heartbeater.cc:507] Master 127.31.239.190:35885 requested a full tablet report, sending...
I20260812 08:02:50.706338 10002 ts_manager.cc:194] Registered new tserver with Master: 8120afcb83af4da0896fe18194b6bfed (127.31.239.130:35475)
I20260812 08:02:50.707167 10002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:40531
W20260812 08:02:50.814885 10376 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:50.815124 10376 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:50.815167 10376 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:50.818732 10376 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:50.818863 10376 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:02:50.822921 10376 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=200
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:35885
--never_fsync=true
--heap_profile_path=/tmp/kudu.10376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:50.824075 10376 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:50.825261 10376 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:50.831857 10381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.831887 10382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:50.831857 10385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:50.832641 10376 server_base.cc:1061] running on GCE node
I20260812 08:02:50.833032 10376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:50.833580 10376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:50.834753 10376 hybrid_clock.cc:648] HybridClock initialized: now 1786521770834739 us; error 47 us; skew 500 ppm
I20260812 08:02:50.836472 10376 webserver.cc:533] Webserver started at http://127.31.239.131:36315/ using document root <none> and password file <none>
I20260812 08:02:50.837051 10376 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:50.837136 10376 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:50.837369 10376 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:50.838986 10376 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "e0d8da967d024e1eb65622ce61e1f40e"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.839479 10376 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "e0d8da967d024e1eb65622ce61e1f40e"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.842864 10376 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:50.845093 10393 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.846092 10376 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:50.846271 10376 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "e0d8da967d024e1eb65622ce61e1f40e"
format_stamp: "Formatted at 2026-08-12 08:02:50 on dist-test-slave-9jjr"
I20260812 08:02:50.846439 10376 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:50.857268 10376 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:50.857970 10376 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:50.858258 10376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:50.858882 10376 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:50.859913 10376 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:50.859962 10376 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.860033 10376 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:50.860076 10376 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:50.869989 10376 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:39915
I20260812 08:02:50.870020 10518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:39915 every 8 connection(s)
I20260812 08:02:50.871068 10376 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:02:50.880187 10519 heartbeater.cc:344] Connected to a master server at 127.31.239.190:35885
I20260812 08:02:50.880505 10519 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:50.881021 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 10376
I20260812 08:02:50.881162 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.RaftConsensusElectionITest.DisruptiveServerAndSlowWAL.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:02:50.881212 10519 heartbeater.cc:507] Master 127.31.239.190:35885 requested a full tablet report, sending...
I20260812 08:02:50.882470 10003 ts_manager.cc:194] Registered new tserver with Master: e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915)
I20260812 08:02:50.883139 10003 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:52561
I20260812 08:02:50.883924 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:50.893640 10002 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58666:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
W20260812 08:02:50.896363 10002 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:50.914266 10445 tablet_service.cc:1511] Processing CreateTablet for tablet fc56223a77a845679e5ccee3f661363f (DEFAULT_TABLE table=TestTable [id=8832c5935a6840b29bd8348380ba48dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:50.914314 10151 tablet_service.cc:1511] Processing CreateTablet for tablet fc56223a77a845679e5ccee3f661363f (DEFAULT_TABLE table=TestTable [id=8832c5935a6840b29bd8348380ba48dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:50.914314 10301 tablet_service.cc:1511] Processing CreateTablet for tablet fc56223a77a845679e5ccee3f661363f (DEFAULT_TABLE table=TestTable [id=8832c5935a6840b29bd8348380ba48dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 08:02:50.915359 10445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc56223a77a845679e5ccee3f661363f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:50.915355 10151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc56223a77a845679e5ccee3f661363f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:50.915374 10301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc56223a77a845679e5ccee3f661363f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:50.920744 10538 tablet_bootstrap.cc:492] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e: Bootstrap starting.
I20260812 08:02:50.922224 10540 tablet_bootstrap.cc:492] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Bootstrap starting.
I20260812 08:02:50.922224 10539 tablet_bootstrap.cc:492] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Bootstrap starting.
I20260812 08:02:50.923825 10538 tablet_bootstrap.cc:654] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:50.924599 10538 log.cc:826] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:50.924681 10540 tablet_bootstrap.cc:654] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:50.924681 10539 tablet_bootstrap.cc:654] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:50.925603 10540 log.cc:826] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:50.925603 10539 log.cc:826] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:50.926496 10538 tablet_bootstrap.cc:492] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e: No bootstrap required, opened a new log
I20260812 08:02:50.926715 10538 ts_tablet_manager.cc:1403] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:50.927340 10540 tablet_bootstrap.cc:492] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: No bootstrap required, opened a new log
I20260812 08:02:50.927537 10540 ts_tablet_manager.cc:1403] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:50.929534 10538 raft_consensus.cc:359] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:50.929710 10538 raft_consensus.cc:385] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:50.929770 10538 raft_consensus.cc:740] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d8da967d024e1eb65622ce61e1f40e, State: Initialized, Role: FOLLOWER
I20260812 08:02:50.930290 10538 consensus_queue.cc:260] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:50.930325 10540 raft_consensus.cc:359] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:50.930529 10540 raft_consensus.cc:385] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:50.930583 10540 raft_consensus.cc:740] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a23723760e9427bade6faec52f732a1, State: Initialized, Role: FOLLOWER
I20260812 08:02:50.930981 10540 consensus_queue.cc:260] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:50.931212 10538 ts_tablet_manager.cc:1434] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:02:50.931335 10539 tablet_bootstrap.cc:492] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: No bootstrap required, opened a new log
I20260812 08:02:50.931599 10539 ts_tablet_manager.cc:1403] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.000s
I20260812 08:02:50.931596 10519 heartbeater.cc:499] Master 127.31.239.190:35885 was elected leader, sending a full tablet report...
I20260812 08:02:50.931651 10223 heartbeater.cc:499] Master 127.31.239.190:35885 was elected leader, sending a full tablet report...
I20260812 08:02:50.931819 10540 ts_tablet_manager.cc:1434] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:50.935047 10539 raft_consensus.cc:359] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:50.935352 10539 raft_consensus.cc:385] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:50.935467 10539 raft_consensus.cc:740] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8120afcb83af4da0896fe18194b6bfed, State: Initialized, Role: FOLLOWER
I20260812 08:02:50.936009 10539 consensus_queue.cc:260] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:50.937036 10539 ts_tablet_manager.cc:1434] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:02:50.937405 10373 heartbeater.cc:499] Master 127.31.239.190:35885 was elected leader, sending a full tablet report...
W20260812 08:02:50.944521 10374 tablet.cc:2406] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:02:50.991959 10225 tablet.cc:2406] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:51.075642 10547 raft_consensus.cc:493] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:51.075938 10547 raft_consensus.cc:515] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:51.077229 10547 leader_election.cc:290] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915), 2a23723760e9427bade6faec52f732a1 (127.31.239.129:34743)
I20260812 08:02:51.078907 10544 raft_consensus.cc:493] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:02:51.079142 10544 raft_consensus.cc:515] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:51.080507 10544 leader_election.cc:290] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8120afcb83af4da0896fe18194b6bfed (127.31.239.130:35475), 2a23723760e9427bade6faec52f732a1 (127.31.239.129:34743)
I20260812 08:02:51.082779 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "8120afcb83af4da0896fe18194b6bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: true
I20260812 08:02:51.082782 10469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "8120afcb83af4da0896fe18194b6bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d8da967d024e1eb65622ce61e1f40e" is_pre_election: true
I20260812 08:02:51.083016 10469 raft_consensus.cc:2468] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8120afcb83af4da0896fe18194b6bfed in term 0.
I20260812 08:02:51.083119 10174 raft_consensus.cc:2468] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8120afcb83af4da0896fe18194b6bfed in term 0.
I20260812 08:02:51.083591 10243 leader_election.cc:304] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8120afcb83af4da0896fe18194b6bfed, e0d8da967d024e1eb65622ce61e1f40e; no voters: 
I20260812 08:02:51.083940 10547 raft_consensus.cc:2804] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:02:51.084026 10547 raft_consensus.cc:493] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:02:51.084067 10547 raft_consensus.cc:3060] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:51.085335 10547 raft_consensus.cc:515] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:51.085608 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: true
I20260812 08:02:51.085811 10547 leader_election.cc:290] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [CANDIDATE]: Term 1 election: Requested vote from peers e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915), 2a23723760e9427bade6faec52f732a1 (127.31.239.129:34743)
I20260812 08:02:51.085877 10324 raft_consensus.cc:2393] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0d8da967d024e1eb65622ce61e1f40e in current term 1: Already voted for candidate 8120afcb83af4da0896fe18194b6bfed in this term.
I20260812 08:02:51.086414 10469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "8120afcb83af4da0896fe18194b6bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d8da967d024e1eb65622ce61e1f40e"
I20260812 08:02:51.086517 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "8120afcb83af4da0896fe18194b6bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1"
I20260812 08:02:51.086575 10469 raft_consensus.cc:3060] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:51.086676 10174 raft_consensus.cc:3060] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:51.087244 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: true
I20260812 08:02:51.087757 10174 raft_consensus.cc:2468] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8120afcb83af4da0896fe18194b6bfed in term 1.
I20260812 08:02:51.087906 10396 leader_election.cc:304] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0d8da967d024e1eb65622ce61e1f40e; no voters: 2a23723760e9427bade6faec52f732a1, 8120afcb83af4da0896fe18194b6bfed
I20260812 08:02:51.087996 10469 raft_consensus.cc:2468] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8120afcb83af4da0896fe18194b6bfed in term 1.
I20260812 08:02:51.088063 10245 leader_election.cc:304] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a23723760e9427bade6faec52f732a1, 8120afcb83af4da0896fe18194b6bfed; no voters: 
I20260812 08:02:51.088305 10547 raft_consensus.cc:2804] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:51.088366 10544 raft_consensus.cc:2749] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 08:02:51.088598 10547 raft_consensus.cc:697] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [term 1 LEADER]: Becoming Leader. State: Replica: 8120afcb83af4da0896fe18194b6bfed, State: Running, Role: LEADER
I20260812 08:02:51.088960 10547 consensus_queue.cc:237] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } }
I20260812 08:02:51.092200 10002 catalog_manager.cc:5719] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to 8120afcb83af4da0896fe18194b6bfed (127.31.239.130). New cstate: current_term: 1 leader_uuid: "8120afcb83af4da0896fe18194b6bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8120afcb83af4da0896fe18194b6bfed" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 35475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:51.098958 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:51.100560 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 2a23723760e9427bade6faec52f732a1 to finish bootstrapping
I20260812 08:02:51.106871 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 8120afcb83af4da0896fe18194b6bfed to finish bootstrapping
I20260812 08:02:51.112779 32702 ts_itest-base.cc:246] Waiting for 1 tablets on tserver e0d8da967d024e1eb65622ce61e1f40e to finish bootstrapping
I20260812 08:02:51.119482 10216 generic_service.cc:175] {username='slave'} at 127.0.0.1:44736 changed flags via RPC: log_inject_latency from 'false' to 'false'
I20260812 08:02:51.120834 10367 generic_service.cc:175] {username='slave'} at 127.0.0.1:47624 changed flags via RPC: log_inject_latency from 'false' to 'false'
W20260812 08:02:51.121958 10520 tablet.cc:2406] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:51.121978 10512 generic_service.cc:175] {username='slave'} at 127.0.0.1:33628 changed flags via RPC: log_inject_latency from 'false' to 'false'
I20260812 08:02:51.134536 10174 raft_consensus.cc:1275] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1 [term 1 FOLLOWER]: Refusing update from remote peer 8120afcb83af4da0896fe18194b6bfed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:51.134573 10469 raft_consensus.cc:1275] T fc56223a77a845679e5ccee3f661363f P e0d8da967d024e1eb65622ce61e1f40e [term 1 FOLLOWER]: Refusing update from remote peer 8120afcb83af4da0896fe18194b6bfed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:02:51.135370 10547 consensus_queue.cc:1048] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a23723760e9427bade6faec52f732a1" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:51.135615 10551 consensus_queue.cc:1048] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d8da967d024e1eb65622ce61e1f40e" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:02:51.142966 10556 mvcc.cc:204] Tried to move back new op lower bound from 7317593174558580736 to 7317593174382788608. Current Snapshot: MvccSnapshot[applied={T|T < 7317593174558580736}]
I20260812 08:02:51.143559 10557 mvcc.cc:204] Tried to move back new op lower bound from 7317593174558580736 to 7317593174382788608. Current Snapshot: MvccSnapshot[applied={T|T < 7317593174558580736}]
I20260812 08:02:51.144217 10559 mvcc.cc:204] Tried to move back new op lower bound from 7317593174558580736 to 7317593174382788608. Current Snapshot: MvccSnapshot[applied={T|T < 7317593174558580736}]
I20260812 08:02:51.158716 10367 generic_service.cc:175] {username='slave'} at 127.0.0.1:47624 changed flags via RPC: log_inject_latency_ms_mean from '100' to '1200'
I20260812 08:02:51.159821 10367 generic_service.cc:175] {username='slave'} at 127.0.0.1:47624 changed flags via RPC: log_inject_latency_ms_stddev from '100' to '0'
I20260812 08:02:51.160918 10367 generic_service.cc:175] {username='slave'} at 127.0.0.1:47624 changed flags via RPC: log_inject_latency from 'false' to 'true'
I20260812 08:02:51.162073 10216 generic_service.cc:175] {username='slave'} at 127.0.0.1:44736 changed flags via RPC: log_inject_latency_ms_mean from '100' to '600'
I20260812 08:02:51.163108 10216 generic_service.cc:175] {username='slave'} at 127.0.0.1:44736 changed flags via RPC: log_inject_latency_ms_stddev from '100' to '0'
I20260812 08:02:51.164099 10216 generic_service.cc:175] {username='slave'} at 127.0.0.1:44736 changed flags via RPC: log_inject_latency from 'false' to 'true'
I20260812 08:02:51.164558 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 10376
I20260812 08:02:51.189634 32702 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
W20260812 08:02:51.199513 10552 log.cc:510] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Injecting 1200ms of latency in SegmentAllocator::Sync()
W20260812 08:02:51.200184 10243 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.239.131:39915: connect: Connection refused (error 111)
W20260812 08:02:51.201267 10243 consensus_peers.cc:597] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed -> Peer e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915): Couldn't send request to peer e0d8da967d024e1eb65622ce61e1f40e. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.131:39915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:02:51.201479 10560 log.cc:510] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Injecting 600ms of latency in SegmentAllocator::Sync()
I20260812 08:02:51.240957 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 2 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.242650 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 2 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.294499 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 3 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.296010 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 3 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.347990 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 4 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.349440 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 4 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.401233 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 5 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.402714 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 5 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.454538 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 6 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.456032 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 6 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.507992 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 7 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.509647 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 7 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.561398 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 8 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.562796 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 8 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.614663 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 9 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.616464 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 9 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.668205 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 10 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.669680 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 10 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.721505 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 11 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.723136 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 11 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.774958 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 12 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.776439 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 12 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.828200 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 13 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.829715 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 13 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.881402 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 14 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.883067 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 14 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.934934 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 15 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.936549 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 15 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:51.988294 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 16 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:51.989647 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 16 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.041503 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 17 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.042963 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 17 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.094729 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 18 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.096228 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 18 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.147894 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 19 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.149290 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 19 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.200987 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 20 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.202477 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 20 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
W20260812 08:02:52.237306 10243 consensus_peers.cc:597] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed -> Peer e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915): Couldn't send request to peer e0d8da967d024e1eb65622ce61e1f40e. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.131:39915: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 08:02:52.254109 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 21 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.255546 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 21 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.307245 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 22 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.308626 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 22 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.360282 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 23 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.361600 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 23 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.401000 10574 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47636 (ReqId={client: 2e4058086af24a0293659ad14ddbd80f, seq_no=0, attempt_no=0}) took 1203 ms. Trace:
I20260812 08:02:52.401144 10574 rpcz_store.cc:276] 0812 08:02:51.197546 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:51.197614 (+    68us) service_pool.cc:224] Handling call
0812 08:02:52.400980 (+1203366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:51.198635 (+     0us) write_op.cc:183] PREPARE: starting on tablet fc56223a77a845679e5ccee3f661363f
0812 08:02:51.198740 (+   105us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:51.198745 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:51.198746 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:51.198807 (+    61us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:51.198815 (+     8us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:51.198817 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:51.198853 (+    36us) tablet.cc:701] Row locks acquired
0812 08:02:51.198853 (+     0us) write_op.cc:260] PREPARE: finished
0812 08:02:51.198960 (+   107us) write_op.cc:270] Start()
0812 08:02:51.198985 (+    25us) write_op.cc:276] Timestamp: P: 1786521771198915 usec, L: 0
0812 08:02:51.198987 (+     2us) op_driver.cc:348] REPLICATION: starting
0812 08:02:51.199195 (+   208us) log.cc:844] Serialized 345 byte log entry
0812 08:02:52.400083 (+1200888us) op_driver.cc:464] REPLICATION: finished
0812 08:02:52.400385 (+   302us) write_op.cc:301] APPLY: starting
0812 08:02:52.400404 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:52.400432 (+    28us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:52.400448 (+    16us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:52.400531 (+    83us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:52.400556 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:52.400559 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:52.400624 (+    65us) log.cc:844] Serialized 22 byte log entry
0812 08:02:52.400722 (+    98us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:52.400743 (+    21us) write_op.cc:454] Released schema lock
0812 08:02:52.400750 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":223,"mutex_wait_us":2,"num_ops":1,"prepare.queue_time_us":78,"prepare.run_cpu_time_us":707,"prepare.run_wall_time_us":708,"raft.queue_time_us":134,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":434,"replication_time_us":1201054,"spinlock_wait_cycles":88320,"thread_start_us":117,"threads_started":1}]]}
I20260812 08:02:52.413169 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 24 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.414620 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 24 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.466344 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 25 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.467715 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 25 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.519385 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 26 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.520789 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 26 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.572625 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 27 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.574035 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 27 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
W20260812 08:02:52.605453 10552 log.cc:510] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Injecting 1200ms of latency in SegmentAllocator::Sync()
W20260812 08:02:52.606942 10560 log.cc:510] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Injecting 600ms of latency in SegmentAllocator::Sync()
I20260812 08:02:52.625785 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 28 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.627162 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 28 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.678872 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 29 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.680262 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 29 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.731905 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 30 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.733268 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 30 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.785049 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 31 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.786581 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 31 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.838359 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 32 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.839946 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 32 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.891696 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 33 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.893124 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 33 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.944890 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 34 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.946395 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 34 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:52.998066 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 35 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:52.999539 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 35 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.051326 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 36 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.052898 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 36 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.104630 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 37 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.106108 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 37 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.157826 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 38 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.159147 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 38 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.210888 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 39 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.212356 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 39 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
W20260812 08:02:53.258508 10243 consensus_peers.cc:597] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed -> Peer e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915): Couldn't send request to peer e0d8da967d024e1eb65622ce61e1f40e. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.131:39915: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 08:02:53.264005 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 40 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.265566 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 40 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.317477 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 41 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.319128 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 41 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.371129 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 42 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.372750 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 42 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.424659 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 43 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.426177 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 43 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.477978 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 44 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.479652 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 44 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.531654 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 45 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.533245 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 45 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.585052 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 46 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.586476 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 46 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.638406 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 47 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.639806 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 47 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.691493 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 48 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.693171 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 48 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.744982 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 49 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.746404 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 49 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.798291 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 50 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.799839 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 50 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.806854 10580 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47636 (ReqId={client: 2e4058086af24a0293659ad14ddbd80f, seq_no=1, attempt_no=0}) took 1203 ms. Trace:
I20260812 08:02:53.806972 10580 rpcz_store.cc:276] 0812 08:02:52.603786 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:52.603873 (+    87us) service_pool.cc:224] Handling call
0812 08:02:53.806803 (+1202930us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:52.604699 (+     0us) write_op.cc:183] PREPARE: starting on tablet fc56223a77a845679e5ccee3f661363f
0812 08:02:52.604827 (+   128us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:52.604830 (+     3us) write_op.cc:435] Acquired schema lock
0812 08:02:52.604832 (+     2us) tablet.cc:662] Decoding operations
0812 08:02:52.604892 (+    60us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:52.604901 (+     9us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:52.604903 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:52.604938 (+    35us) tablet.cc:701] Row locks acquired
0812 08:02:52.604939 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:52.604974 (+    35us) write_op.cc:270] Start()
0812 08:02:52.604997 (+    23us) write_op.cc:276] Timestamp: P: 1786521772604914 usec, L: 0
0812 08:02:52.604998 (+     1us) op_driver.cc:348] REPLICATION: starting
0812 08:02:52.605152 (+   154us) log.cc:844] Serialized 354 byte log entry
0812 08:02:53.806045 (+1200893us) op_driver.cc:464] REPLICATION: finished
0812 08:02:53.806349 (+   304us) write_op.cc:301] APPLY: starting
0812 08:02:53.806368 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:53.806397 (+    29us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:53.806417 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:53.806474 (+    57us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:53.806499 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:53.806502 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:53.806569 (+    67us) log.cc:844] Serialized 22 byte log entry
0812 08:02:53.806686 (+   117us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:53.806703 (+    17us) write_op.cc:454] Released schema lock
0812 08:02:53.806709 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":236,"num_ops":1,"prepare.queue_time_us":192,"prepare.run_cpu_time_us":583,"prepare.run_wall_time_us":584,"raft.queue_time_us":163,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":197,"replication_time_us":1200996,"thread_start_us":208,"threads_started":2}]]}
I20260812 08:02:53.851608 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 51 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.853027 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 51 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.904785 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 52 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.906186 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 52 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:53.957659 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 53 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:53.959007 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 53 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.010476 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 54 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
W20260812 08:02:54.010938 10552 log.cc:510] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Injecting 1200ms of latency in SegmentAllocator::Sync()
I20260812 08:02:54.011667 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 54 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
W20260812 08:02:54.012434 10560 log.cc:510] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Injecting 600ms of latency in SegmentAllocator::Sync()
I20260812 08:02:54.063539 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 55 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.064997 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 55 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.116596 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 56 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.118003 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 56 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.169759 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 57 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.171264 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 57 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.223089 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 58 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.224607 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 58 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.276454 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 59 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.278167 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 59 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.330097 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 60 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.331574 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 60 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.383313 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 61 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.384675 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 61 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
W20260812 08:02:54.428174 10243 consensus_peers.cc:597] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed -> Peer e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915): Couldn't send request to peer e0d8da967d024e1eb65622ce61e1f40e. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.131:39915: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 08:02:54.436442 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 62 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.437896 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 62 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.489646 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 63 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.491140 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 63 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.543028 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 64 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.544566 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 64 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.596333 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 65 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.597801 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 65 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.649597 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 66 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.651015 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 66 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.702595 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 67 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.703994 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 67 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.755728 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 68 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.757210 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 68 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.809016 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 69 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.810583 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 69 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.862311 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 70 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.863754 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 70 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.915527 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 71 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.916919 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 71 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:54.968532 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 72 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:54.969859 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 72 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.021557 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 73 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.023178 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 73 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.075018 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 74 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.076552 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 74 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.128263 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 75 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.129747 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 75 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.181414 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 76 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.182902 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 76 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.212324 10589 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47636 (ReqId={client: 2e4058086af24a0293659ad14ddbd80f, seq_no=2, attempt_no=0}) took 1203 ms. Trace:
I20260812 08:02:55.212464 10589 rpcz_store.cc:276] 0812 08:02:54.009258 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:54.009360 (+   102us) service_pool.cc:224] Handling call
0812 08:02:55.212297 (+1202937us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:54.010066 (+     0us) write_op.cc:183] PREPARE: starting on tablet fc56223a77a845679e5ccee3f661363f
0812 08:02:54.010265 (+   199us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:54.010270 (+     5us) write_op.cc:435] Acquired schema lock
0812 08:02:54.010271 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:54.010362 (+    91us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:54.010376 (+    14us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:54.010379 (+     3us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:54.010426 (+    47us) tablet.cc:701] Row locks acquired
0812 08:02:54.010427 (+     1us) write_op.cc:260] PREPARE: finished
0812 08:02:54.010465 (+    38us) write_op.cc:270] Start()
0812 08:02:54.010497 (+    32us) write_op.cc:276] Timestamp: P: 1786521774010415 usec, L: 0
0812 08:02:54.010500 (+     3us) op_driver.cc:348] REPLICATION: starting
0812 08:02:54.010667 (+   167us) log.cc:844] Serialized 354 byte log entry
0812 08:02:55.211533 (+1200866us) op_driver.cc:464] REPLICATION: finished
0812 08:02:55.211865 (+   332us) write_op.cc:301] APPLY: starting
0812 08:02:55.211884 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:55.211912 (+    28us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:55.211929 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:55.211989 (+    60us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:55.212013 (+    24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:55.212016 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:55.212081 (+    65us) log.cc:844] Serialized 22 byte log entry
0812 08:02:55.212179 (+    98us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:55.212196 (+    17us) write_op.cc:454] Released schema lock
0812 08:02:55.212202 (+     6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":257,"num_ops":1,"prepare.queue_time_us":218,"prepare.run_cpu_time_us":704,"prepare.run_wall_time_us":704,"raft.queue_time_us":128,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":441,"replication_time_us":1200978,"thread_start_us":224,"threads_started":2}]]}
I20260812 08:02:55.234779 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 77 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.236253 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 77 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.287902 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 78 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.289230 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 78 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.340943 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 79 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.342481 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 79 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.394243 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 80 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.395617 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 80 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
W20260812 08:02:55.416186 10552 log.cc:510] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed: Injecting 1200ms of latency in SegmentAllocator::Sync()
W20260812 08:02:55.417560 10560 log.cc:510] T fc56223a77a845679e5ccee3f661363f P 2a23723760e9427bade6faec52f732a1: Injecting 600ms of latency in SegmentAllocator::Sync()
W20260812 08:02:55.444527 10243 consensus_peers.cc:597] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed -> Peer e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915): Couldn't send request to peer e0d8da967d024e1eb65622ce61e1f40e. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.131:39915: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260812 08:02:55.447026 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 81 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.448279 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 81 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.499960 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 82 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.501346 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 82 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.553066 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 83 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.554441 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 83 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.606184 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 84 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.607971 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 84 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.659657 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 85 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.660969 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 85 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.712692 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 86 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.714200 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 86 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.765817 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 87 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.767266 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 87 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.819128 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 88 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.820497 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 88 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.872292 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 89 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.873687 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 89 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.925458 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 90 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.926906 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 90 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:55.978585 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 91 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:55.979933 10174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 91 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.031703 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 92 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.033126 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 92 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.084815 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 93 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.086216 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 93 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.137916 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 94 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.139317 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 94 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.191068 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 95 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.192544 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 95 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.244376 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 96 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.245801 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 96 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
W20260812 08:02:56.288618 10243 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.239.131:39915: connect: Connection refused (error 111) [suppressed 23 similar messages]
I20260812 08:02:56.297415 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 97 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.298804 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 97 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.350447 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 98 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.351824 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 98 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.403386 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 99 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.404842 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 99 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.456405 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 100 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.457716 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 100 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
W20260812 08:02:56.496163 10243 consensus_peers.cc:597] T fc56223a77a845679e5ccee3f661363f P 8120afcb83af4da0896fe18194b6bfed -> Peer e0d8da967d024e1eb65622ce61e1f40e (127.31.239.131:39915): Couldn't send request to peer e0d8da967d024e1eb65622ce61e1f40e. Status: Network error: Client connection negotiation failed: client connection to 127.31.239.131:39915: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260812 08:02:56.509359 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 101 index: 0 } } ignore_live_leader: false dest_uuid: "8120afcb83af4da0896fe18194b6bfed" is_pre_election: false
I20260812 08:02:56.510824 10173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc56223a77a845679e5ccee3f661363f" candidate_uuid: "e0d8da967d024e1eb65622ce61e1f40e" candidate_term: 2 candidate_status { last_received { term: 101 index: 0 } } ignore_live_leader: false dest_uuid: "2a23723760e9427bade6faec52f732a1" is_pre_election: false
I20260812 08:02:56.617522 10597 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47636 (ReqId={client: 2e4058086af24a0293659ad14ddbd80f, seq_no=3, attempt_no=0}) took 1203 ms. Trace:
I20260812 08:02:56.617645 10597 rpcz_store.cc:276] 0812 08:02:55.414551 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:02:55.414659 (+   108us) service_pool.cc:224] Handling call
0812 08:02:56.617495 (+1202836us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 08:02:55.415440 (+     0us) write_op.cc:183] PREPARE: starting on tablet fc56223a77a845679e5ccee3f661363f
0812 08:02:55.415550 (+   110us) write_op.cc:432] Acquiring schema lock in shared mode
0812 08:02:55.415554 (+     4us) write_op.cc:435] Acquired schema lock
0812 08:02:55.415555 (+     1us) tablet.cc:662] Decoding operations
0812 08:02:55.415621 (+    66us) write_op.cc:620] Acquiring the partition lock for write op
0812 08:02:55.415629 (+     8us) write_op.cc:641] Partition lock acquired for write op
0812 08:02:55.415631 (+     2us) tablet.cc:685] Acquiring locks for 1 operations
0812 08:02:55.415666 (+    35us) tablet.cc:701] Row locks acquired
0812 08:02:55.415668 (+     2us) write_op.cc:260] PREPARE: finished
0812 08:02:55.415703 (+    35us) write_op.cc:270] Start()
0812 08:02:55.415750 (+    47us) write_op.cc:276] Timestamp: P: 1786521775415667 usec, L: 0
0812 08:02:55.415751 (+     1us) op_driver.cc:348] REPLICATION: starting
0812 08:02:55.415900 (+   149us) log.cc:844] Serialized 354 byte log entry
0812 08:02:56.616778 (+1200878us) op_driver.cc:464] REPLICATION: finished
0812 08:02:56.617070 (+   292us) write_op.cc:301] APPLY: starting
0812 08:02:56.617089 (+    19us) tablet.cc:1367] starting BulkCheckPresence
0812 08:02:56.617116 (+    27us) tablet.cc:1370] finished BulkCheckPresence
0812 08:02:56.617135 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 08:02:56.617193 (+    58us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 08:02:56.617218 (+    25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 08:02:56.617221 (+     3us) write_op.cc:312] APPLY: finished
0812 08:02:56.617288 (+    67us) log.cc:844] Serialized 22 byte log entry
0812 08:02:56.617370 (+    82us) write_op.cc:489] Releasing partition, row and schema locks
0812 08:02:56.617399 (+    29us) write_op.cc:454] Released schema lock
0812 08:02:56.617406 (+     7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":222,"num_ops":1,"prepare.queue_time_us":269,"prepare.run_cpu_time_us":586,"prepare.run_wall_time_us":586,"raft.queue_time_us":130,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":234,"replication_time_us":1200973,"spinlock_wait_cycles":3328,"thread_start_us":283,"threads_started":2}]]}
I20260812 08:02:56.819432 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 10074
I20260812 08:02:56.829766 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 10227
I20260812 08:02:56.839545 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 9968
2026-08-12T08:02:56Z chronyd exiting
[       OK ] RaftConsensusElectionITest.DisruptiveServerAndSlowWAL (6802 ms)
[----------] 12 tests from RaftConsensusElectionITest (137971 ms total)

[----------] 2 tests from NumReplicas/RaftConsensusNumLeadersMetricTest
[ RUN      ] NumReplicas/RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric/0
I20260812 08:02:56.867344 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:56.867429 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:56.867447 32702 ts_itest-base.cc:117] 1 tablet servers
I20260812 08:02:56.867465 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:02:56.867491 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:56Z Disabled control of system clock
I20260812 08:02:56.877117 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:36751
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:32879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:36751
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:02:56.983908 10609 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:56.984186 10609 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:56.984269 10609 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:56.987761 10609 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:56.987866 10609 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:56.987905 10609 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:56.987962 10609 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:56.992025 10609 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:36751
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:36751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.10609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:56.993186 10609 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:56.994361 10609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:56.999712 10615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:56.999716 10614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:56.999744 10617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:57.000120 10609 server_base.cc:1061] running on GCE node
I20260812 08:02:57.000591 10609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:57.001477 10609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:57.002660 10609 hybrid_clock.cc:648] HybridClock initialized: now 1786521777002634 us; error 43 us; skew 500 ppm
I20260812 08:02:57.004492 10609 webserver.cc:533] Webserver started at http://127.31.239.190:38177/ using document root <none> and password file <none>
I20260812 08:02:57.005072 10609 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:57.005156 10609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:57.005378 10609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:57.007012 10609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "80fade395b1b4a43bd5ef9d6ae8b628a"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.007504 10609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "80fade395b1b4a43bd5ef9d6ae8b628a"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.010870 10609 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:02:57.013008 10624 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:57.013983 10609 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:02:57.014161 10609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "80fade395b1b4a43bd5ef9d6ae8b628a"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.014304 10609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:57.023996 10609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:57.024703 10609 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:57.024905 10609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:57.032812 10684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:36751 every 8 connection(s)
I20260812 08:02:57.032848 10609 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:36751
I20260812 08:02:57.033921 10609 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:57.036871 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.042080 10685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a: Bootstrap starting.
I20260812 08:02:57.043040 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 10609
I20260812 08:02:57.043200 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:57.044888 10685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.045631 10685 log.cc:826] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:57.047394 10685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a: No bootstrap required, opened a new log
I20260812 08:02:57.050073 10685 raft_consensus.cc:359] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fade395b1b4a43bd5ef9d6ae8b628a" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36751 } }
I20260812 08:02:57.050329 10685 raft_consensus.cc:385] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:57.050457 10685 raft_consensus.cc:740] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80fade395b1b4a43bd5ef9d6ae8b628a, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.050895 10685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fade395b1b4a43bd5ef9d6ae8b628a" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36751 } }
I20260812 08:02:57.051031 10685 raft_consensus.cc:399] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:57.051105 10685 raft_consensus.cc:493] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:57.051213 10685 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.052105 10685 raft_consensus.cc:515] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fade395b1b4a43bd5ef9d6ae8b628a" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36751 } }
I20260812 08:02:57.052452 10685 leader_election.cc:304] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80fade395b1b4a43bd5ef9d6ae8b628a; no voters: 
I20260812 08:02:57.052762 10685 leader_election.cc:290] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.052910 10691 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.053150 10691 raft_consensus.cc:697] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [term 1 LEADER]: Becoming Leader. State: Replica: 80fade395b1b4a43bd5ef9d6ae8b628a, State: Running, Role: LEADER
I20260812 08:02:57.053493 10691 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fade395b1b4a43bd5ef9d6ae8b628a" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36751 } }
I20260812 08:02:57.054070 10685 sys_catalog.cc:565] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:57.055171 10693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80fade395b1b4a43bd5ef9d6ae8b628a. Latest consensus state: current_term: 1 leader_uuid: "80fade395b1b4a43bd5ef9d6ae8b628a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fade395b1b4a43bd5ef9d6ae8b628a" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36751 } } }
I20260812 08:02:57.055316 10693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:57.055663 10692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80fade395b1b4a43bd5ef9d6ae8b628a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80fade395b1b4a43bd5ef9d6ae8b628a" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 36751 } } }
I20260812 08:02:57.055811 10692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:57.056135 10700 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:57.059657 10700 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:57.065497 10700 catalog_manager.cc:1383] Generated new cluster ID: a39089cd905c47d68e25d01edf1f579f
I20260812 08:02:57.065593 10700 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:57.072649 10700 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:57.073477 10700 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:57.080886 10700 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 80fade395b1b4a43bd5ef9d6ae8b628a: Generated new TSK 0
I20260812 08:02:57.081526 10700 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:57.084800 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:36751
--builtin_ntp_servers=127.31.239.148:32879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:02:57.193387 10712 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:57.193630 10712 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:57.193653 10712 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:57.193732 10712 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:57.197310 10712 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:57.197436 10712 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:57.201627 10712 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:32879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:36751
--never_fsync=true
--heap_profile_path=/tmp/kudu.10712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:57.202817 10712 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:57.203992 10712 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:57.210574 10717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:57.210587 10720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:57.210599 10718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:57.211259 10712 server_base.cc:1061] running on GCE node
I20260812 08:02:57.211673 10712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:57.212322 10712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:57.213505 10712 hybrid_clock.cc:648] HybridClock initialized: now 1786521777213485 us; error 39 us; skew 500 ppm
I20260812 08:02:57.215389 10712 webserver.cc:533] Webserver started at http://127.31.239.129:33335/ using document root <none> and password file <none>
I20260812 08:02:57.215999 10712 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:57.216084 10712 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:57.216307 10712 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:57.217972 10712 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "d22c0914e9584654b3a387e3d436672e"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.218603 10712 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "d22c0914e9584654b3a387e3d436672e"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.222267 10712 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:02:57.224705 10729 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:57.225894 10712 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:57.226035 10712 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "d22c0914e9584654b3a387e3d436672e"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.226174 10712 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:57.239245 10712 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:57.239964 10712 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:57.240177 10712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:57.240785 10712 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:57.241866 10712 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:57.241940 10712 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:57.242012 10712 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:57.242058 10712 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:57.251823 10712 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:37547
I20260812 08:02:57.251906 10862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:37547 every 8 connection(s)
I20260812 08:02:57.252861 10712 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:57.262013 10863 heartbeater.cc:344] Connected to a master server at 127.31.239.190:36751
I20260812 08:02:57.262066 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 10712
I20260812 08:02:57.262213 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:57.262369 10863 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:57.263003 10863 heartbeater.cc:507] Master 127.31.239.190:36751 requested a full tablet report, sending...
I20260812 08:02:57.264703 10644 ts_manager.cc:194] Registered new tserver with Master: d22c0914e9584654b3a387e3d436672e (127.31.239.129:37547)
I20260812 08:02:57.265868 10644 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:49497
I20260812 08:02:57.276826 32702 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260812 08:02:57.287264 32702 external_mini_cluster.cc:955] 1 TS(s) registered with all masters
I20260812 08:02:57.297600 10644 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41816:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
  rows: "<redacted>""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 08:02:57.317598 10778 tablet_service.cc:1511] Processing CreateTablet for tablet 78c75626cfa24ace8e4ff5de709c7d1b (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260812 08:02:57.318929 10778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c75626cfa24ace8e4ff5de709c7d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.318068 10785 tablet_service.cc:1511] Processing CreateTablet for tablet 9731cc7acc01468f971483a08b924192 (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260812 08:02:57.321002 10785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9731cc7acc01468f971483a08b924192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.317562 10788 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6607aa216345c0b92dbf138ea2c68e (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260812 08:02:57.317468 10783 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba69a1ddbe5470fa7f54f9f23de257c (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260812 08:02:57.321331 10788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6607aa216345c0b92dbf138ea2c68e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.321504 10783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba69a1ddbe5470fa7f54f9f23de257c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.317981 10781 tablet_service.cc:1511] Processing CreateTablet for tablet 81ffdb05928b409481216c3a6e08928f (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260812 08:02:57.322290 10786 tablet_service.cc:1511] Processing CreateTablet for tablet a7d75025910b48c59d980c43325ded0c (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260812 08:02:57.322536 10781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81ffdb05928b409481216c3a6e08928f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.323108 10786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d75025910b48c59d980c43325ded0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.317468 10784 tablet_service.cc:1511] Processing CreateTablet for tablet 708d1bb5ed0f492698b34e3976fa4cc8 (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260812 08:02:57.317355 10782 tablet_service.cc:1511] Processing CreateTablet for tablet ff5807f671864faa9f07075ff8b564f0 (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260812 08:02:57.317355 10779 tablet_service.cc:1511] Processing CreateTablet for tablet 9abf0689227b4782809c398c00a6054f (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260812 08:02:57.325569 10779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abf0689227b4782809c398c00a6054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.325804 10882 tablet_bootstrap.cc:492] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.317355 10787 tablet_service.cc:1511] Processing CreateTablet for tablet d2ba24a0712e454ba12659c1143b934b (DEFAULT_TABLE table=test-workload [id=845450e2a45f47abb8e5290ee243f6b0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260812 08:02:57.326727 10787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ba24a0712e454ba12659c1143b934b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.328143 10882 tablet_bootstrap.cc:654] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.328718 10782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5807f671864faa9f07075ff8b564f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.330178 10882 log.cc:826] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:57.330438 10784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708d1bb5ed0f492698b34e3976fa4cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.332007 10882 tablet_bootstrap.cc:492] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.332218 10882 ts_tablet_manager.cc:1403] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 08:02:57.335084 10882 raft_consensus.cc:359] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.335268 10882 raft_consensus.cc:740] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.335506 10882 consensus_queue.cc:260] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.336155 10863 heartbeater.cc:499] Master 127.31.239.190:36751 was elected leader, sending a full tablet report...
I20260812 08:02:57.336228 10882 ts_tablet_manager.cc:1434] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:02:57.336506 10882 tablet_bootstrap.cc:492] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.337682 10882 tablet_bootstrap.cc:654] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.338846 10882 tablet_bootstrap.cc:492] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.338961 10882 ts_tablet_manager.cc:1403] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:57.339464 10882 raft_consensus.cc:359] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.339572 10882 raft_consensus.cc:740] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.339706 10882 consensus_queue.cc:260] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.339955 10882 ts_tablet_manager.cc:1434] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:57.340122 10882 tablet_bootstrap.cc:492] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.341032 10882 tablet_bootstrap.cc:654] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.342494 10882 tablet_bootstrap.cc:492] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.342621 10882 ts_tablet_manager.cc:1403] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:57.343046 10882 raft_consensus.cc:359] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.343169 10882 raft_consensus.cc:740] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.343300 10882 consensus_queue.cc:260] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.343556 10882 ts_tablet_manager.cc:1434] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:57.343775 10882 tablet_bootstrap.cc:492] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.344816 10882 tablet_bootstrap.cc:654] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.345958 10882 tablet_bootstrap.cc:492] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.346078 10882 ts_tablet_manager.cc:1403] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:57.346626 10882 raft_consensus.cc:359] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.346710 10882 raft_consensus.cc:740] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.346803 10882 consensus_queue.cc:260] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.347090 10882 ts_tablet_manager.cc:1434] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:57.347289 10882 tablet_bootstrap.cc:492] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.348366 10882 tablet_bootstrap.cc:654] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.349628 10882 tablet_bootstrap.cc:492] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.349730 10882 ts_tablet_manager.cc:1403] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:57.350277 10882 raft_consensus.cc:359] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.350404 10882 raft_consensus.cc:740] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.350497 10882 consensus_queue.cc:260] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.350770 10882 ts_tablet_manager.cc:1434] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:57.350943 10882 tablet_bootstrap.cc:492] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.351984 10882 tablet_bootstrap.cc:654] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.353324 10882 tablet_bootstrap.cc:492] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.353440 10882 ts_tablet_manager.cc:1403] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:57.353834 10882 raft_consensus.cc:359] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.353938 10882 raft_consensus.cc:740] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.354050 10882 consensus_queue.cc:260] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.354353 10882 ts_tablet_manager.cc:1434] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:57.354545 10882 tablet_bootstrap.cc:492] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.355631 10882 tablet_bootstrap.cc:654] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.356835 10882 tablet_bootstrap.cc:492] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.356938 10882 ts_tablet_manager.cc:1403] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:57.357575 10882 raft_consensus.cc:359] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.357693 10882 raft_consensus.cc:740] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.357795 10882 consensus_queue.cc:260] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.358095 10882 ts_tablet_manager.cc:1434] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:57.358314 10882 tablet_bootstrap.cc:492] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.359269 10882 tablet_bootstrap.cc:654] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.360410 10882 tablet_bootstrap.cc:492] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.360515 10882 ts_tablet_manager.cc:1403] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:02:57.361001 10882 raft_consensus.cc:359] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.361104 10882 raft_consensus.cc:740] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.361224 10882 consensus_queue.cc:260] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.361522 10882 ts_tablet_manager.cc:1434] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:57.361707 10882 tablet_bootstrap.cc:492] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.362704 10882 tablet_bootstrap.cc:654] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.363835 10882 tablet_bootstrap.cc:492] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.363922 10882 ts_tablet_manager.cc:1403] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:57.364414 10882 raft_consensus.cc:359] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.364514 10882 raft_consensus.cc:740] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.364617 10882 consensus_queue.cc:260] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.364895 10882 ts_tablet_manager.cc:1434] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:57.365109 10882 tablet_bootstrap.cc:492] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: Bootstrap starting.
I20260812 08:02:57.366065 10882 tablet_bootstrap.cc:654] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.367468 10882 tablet_bootstrap.cc:492] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: No bootstrap required, opened a new log
I20260812 08:02:57.367571 10882 ts_tablet_manager.cc:1403] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:57.368077 10882 raft_consensus.cc:359] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.368177 10882 raft_consensus.cc:740] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.368292 10882 consensus_queue.cc:260] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.368590 10882 ts_tablet_manager.cc:1434] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:57.395150 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "708d1bb5ed0f492698b34e3976fa4cc8"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.395419 10809 raft_consensus.cc:493] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.395558 10809 raft_consensus.cc:3060] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.396548 10809 raft_consensus.cc:515] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.396926 10809 leader_election.cc:304] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.397137 10809 leader_election.cc:290] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.397204 10884 raft_consensus.cc:2804] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.397538 10884 raft_consensus.cc:697] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.397894 10884 consensus_queue.cc:237] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.401057 10645 catalog_manager.cc:5719] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.406344 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9731cc7acc01468f971483a08b924192"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.406500 10809 raft_consensus.cc:493] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.406586 10809 raft_consensus.cc:3060] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.407402 10809 raft_consensus.cc:515] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.407567 10809 leader_election.cc:304] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.407685 10809 leader_election.cc:290] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.407758 10884 raft_consensus.cc:2804] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.407900 10884 raft_consensus.cc:697] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.408028 10884 consensus_queue.cc:237] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.409921 10645 catalog_manager.cc:5719] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.414641 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7d75025910b48c59d980c43325ded0c"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.414793 10809 raft_consensus.cc:493] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.414861 10809 raft_consensus.cc:3060] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.415647 10809 raft_consensus.cc:515] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.415797 10809 leader_election.cc:304] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.415918 10809 leader_election.cc:290] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.415975 10884 raft_consensus.cc:2804] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.416109 10884 raft_consensus.cc:697] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.416237 10884 consensus_queue.cc:237] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.417937 10645 catalog_manager.cc:5719] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.423240 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c75626cfa24ace8e4ff5de709c7d1b"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.423422 10809 raft_consensus.cc:493] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.423502 10809 raft_consensus.cc:3060] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.424324 10809 raft_consensus.cc:515] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.424491 10809 leader_election.cc:304] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.424616 10809 leader_election.cc:290] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.424670 10884 raft_consensus.cc:2804] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.424852 10884 raft_consensus.cc:697] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.425014 10884 consensus_queue.cc:237] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.426828 10645 catalog_manager.cc:5719] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.431602 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2ba24a0712e454ba12659c1143b934b"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.431740 10809 raft_consensus.cc:493] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.431792 10809 raft_consensus.cc:3060] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.432525 10809 raft_consensus.cc:515] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.432654 10809 leader_election.cc:304] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.432761 10809 leader_election.cc:290] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.432819 10884 raft_consensus.cc:2804] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.432910 10884 raft_consensus.cc:697] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.433058 10884 consensus_queue.cc:237] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.434872 10645 catalog_manager.cc:5719] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.440585 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ba69a1ddbe5470fa7f54f9f23de257c"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.440747 10809 raft_consensus.cc:493] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.440820 10809 raft_consensus.cc:3060] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.441594 10809 raft_consensus.cc:515] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.441757 10809 leader_election.cc:304] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.441886 10809 leader_election.cc:290] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.441969 10884 raft_consensus.cc:2804] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.442106 10884 raft_consensus.cc:697] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.442271 10884 consensus_queue.cc:237] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.443859 10645 catalog_manager.cc:5719] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.448833 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff5807f671864faa9f07075ff8b564f0"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.448983 10809 raft_consensus.cc:493] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.449054 10809 raft_consensus.cc:3060] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.449817 10809 raft_consensus.cc:515] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.449973 10809 leader_election.cc:304] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.450095 10809 leader_election.cc:290] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.450201 10884 raft_consensus.cc:2804] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.450350 10884 raft_consensus.cc:697] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.450479 10884 consensus_queue.cc:237] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.452001 10645 catalog_manager.cc:5719] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.457259 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9abf0689227b4782809c398c00a6054f"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.457407 10809 raft_consensus.cc:493] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.457456 10809 raft_consensus.cc:3060] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.458266 10809 raft_consensus.cc:515] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.458400 10809 leader_election.cc:304] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.458477 10809 leader_election.cc:290] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.458580 10884 raft_consensus.cc:2804] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.458712 10884 raft_consensus.cc:697] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.458848 10884 consensus_queue.cc:237] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.460451 10645 catalog_manager.cc:5719] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.465528 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81ffdb05928b409481216c3a6e08928f"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.465655 10809 raft_consensus.cc:493] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.465745 10809 raft_consensus.cc:3060] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.466544 10809 raft_consensus.cc:515] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.466701 10809 leader_election.cc:304] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.466825 10809 leader_election.cc:290] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.466918 10884 raft_consensus.cc:2804] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.467042 10884 raft_consensus.cc:697] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.467173 10884 consensus_queue.cc:237] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.468778 10645 catalog_manager.cc:5719] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.473793 10809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d6607aa216345c0b92dbf138ea2c68e"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.473932 10809 raft_consensus.cc:493] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:57.474006 10809 raft_consensus.cc:3060] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.474802 10809 raft_consensus.cc:515] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.474957 10809 leader_election.cc:304] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d22c0914e9584654b3a387e3d436672e; no voters: 
I20260812 08:02:57.475077 10809 leader_election.cc:290] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.475169 10884 raft_consensus.cc:2804] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.475297 10884 raft_consensus.cc:697] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Leader. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.475428 10884 consensus_queue.cc:237] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.477020 10645 catalog_manager.cc:5719] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e reported cstate change: term changed from 0 to 1, leader changed from <none> to d22c0914e9584654b3a387e3d436672e (127.31.239.129). New cstate: current_term: 1 leader_uuid: "d22c0914e9584654b3a387e3d436672e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } health_report { overall_health: HEALTHY } } }
I20260812 08:02:57.482508 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet 708d1bb5ed0f492698b34e3976fa4cc8 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.483105 10911 tablet_replica.cc:333] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.483395 10911 raft_consensus.cc:2243] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:57.483593 10911 raft_consensus.cc:2272] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.484845 10911 ts_tablet_manager.cc:1916] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.487015 10911 ts_tablet_manager.cc:1929] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.487102 10911 log.cc:1199] T 708d1bb5ed0f492698b34e3976fa4cc8 P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/708d1bb5ed0f492698b34e3976fa4cc8
I20260812 08:02:57.493386 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet 9731cc7acc01468f971483a08b924192 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.493649 10911 tablet_replica.cc:333] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.493772 10911 raft_consensus.cc:2243] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:57.493881 10911 raft_consensus.cc:2272] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.494546 10911 ts_tablet_manager.cc:1916] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.496434 10911 ts_tablet_manager.cc:1929] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.496505 10911 log.cc:1199] T 9731cc7acc01468f971483a08b924192 P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/9731cc7acc01468f971483a08b924192
I20260812 08:02:57.502731 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet a7d75025910b48c59d980c43325ded0c with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.502952 10911 tablet_replica.cc:333] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.503095 10911 raft_consensus.cc:2243] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:57.503211 10911 raft_consensus.cc:2272] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.503953 10911 ts_tablet_manager.cc:1916] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.506208 10911 ts_tablet_manager.cc:1929] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.506319 10911 log.cc:1199] T a7d75025910b48c59d980c43325ded0c P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/a7d75025910b48c59d980c43325ded0c
I20260812 08:02:57.512637 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet 78c75626cfa24ace8e4ff5de709c7d1b with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.512863 10911 tablet_replica.cc:333] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.512979 10911 raft_consensus.cc:2243] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:57.513085 10911 raft_consensus.cc:2272] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.513767 10911 ts_tablet_manager.cc:1916] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.515709 10911 ts_tablet_manager.cc:1929] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.515786 10911 log.cc:1199] T 78c75626cfa24ace8e4ff5de709c7d1b P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/78c75626cfa24ace8e4ff5de709c7d1b
I20260812 08:02:57.521997 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet d2ba24a0712e454ba12659c1143b934b with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.522255 10911 tablet_replica.cc:333] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.522377 10911 raft_consensus.cc:2243] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:57.522486 10911 raft_consensus.cc:2272] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.523190 10911 ts_tablet_manager.cc:1916] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.524897 10911 ts_tablet_manager.cc:1929] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.524961 10911 log.cc:1199] T d2ba24a0712e454ba12659c1143b934b P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/d2ba24a0712e454ba12659c1143b934b
I20260812 08:02:57.531286 10809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ba69a1ddbe5470fa7f54f9f23de257c"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.531461 10809 raft_consensus.cc:591] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Received request to step down
I20260812 08:02:57.531502 10809 raft_consensus.cc:3055] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:57.531528 10809 raft_consensus.cc:740] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.531641 10809 consensus_queue.cc:260] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.531705 10809 raft_consensus.cc:3060] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:57.537449 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ba69a1ddbe5470fa7f54f9f23de257c with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.537724 10911 tablet_replica.cc:333] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.537860 10911 raft_consensus.cc:2243] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:57.537982 10911 raft_consensus.cc:2272] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.538848 10911 ts_tablet_manager.cc:1916] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.540645 10911 ts_tablet_manager.cc:1929] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.540716 10911 log.cc:1199] T 9ba69a1ddbe5470fa7f54f9f23de257c P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/9ba69a1ddbe5470fa7f54f9f23de257c
I20260812 08:02:57.547004 10809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5807f671864faa9f07075ff8b564f0"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.547154 10809 raft_consensus.cc:591] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Received request to step down
I20260812 08:02:57.547188 10809 raft_consensus.cc:3055] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:57.547216 10809 raft_consensus.cc:740] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.547322 10809 consensus_queue.cc:260] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.547384 10809 raft_consensus.cc:3060] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:57.552789 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet ff5807f671864faa9f07075ff8b564f0 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.552999 10911 tablet_replica.cc:333] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.553119 10911 raft_consensus.cc:2243] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:57.553225 10911 raft_consensus.cc:2272] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.553910 10911 ts_tablet_manager.cc:1916] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.555789 10911 ts_tablet_manager.cc:1929] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.555873 10911 log.cc:1199] T ff5807f671864faa9f07075ff8b564f0 P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/ff5807f671864faa9f07075ff8b564f0
I20260812 08:02:57.561924 10809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9abf0689227b4782809c398c00a6054f"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.562060 10809 raft_consensus.cc:591] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Received request to step down
I20260812 08:02:57.562100 10809 raft_consensus.cc:3055] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:57.562181 10809 raft_consensus.cc:740] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.562323 10809 consensus_queue.cc:260] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.562390 10809 raft_consensus.cc:3060] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:57.567915 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet 9abf0689227b4782809c398c00a6054f with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.568130 10911 tablet_replica.cc:333] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.568238 10911 raft_consensus.cc:2243] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:57.568343 10911 raft_consensus.cc:2272] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.569051 10911 ts_tablet_manager.cc:1916] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.570868 10911 ts_tablet_manager.cc:1929] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.570932 10911 log.cc:1199] T 9abf0689227b4782809c398c00a6054f P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/9abf0689227b4782809c398c00a6054f
I20260812 08:02:57.576507 10809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81ffdb05928b409481216c3a6e08928f"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.576633 10809 raft_consensus.cc:591] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Received request to step down
I20260812 08:02:57.576689 10809 raft_consensus.cc:3055] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:57.576718 10809 raft_consensus.cc:740] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.576812 10809 consensus_queue.cc:260] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.576874 10809 raft_consensus.cc:3060] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:57.582547 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet 81ffdb05928b409481216c3a6e08928f with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.582803 10911 tablet_replica.cc:333] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.582947 10911 raft_consensus.cc:2243] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:57.583101 10911 raft_consensus.cc:2272] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.583787 10911 ts_tablet_manager.cc:1916] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.585597 10911 ts_tablet_manager.cc:1929] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.585662 10911 log.cc:1199] T 81ffdb05928b409481216c3a6e08928f P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/81ffdb05928b409481216c3a6e08928f
I20260812 08:02:57.592250 10809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d6607aa216345c0b92dbf138ea2c68e"
dest_uuid: "d22c0914e9584654b3a387e3d436672e"
 from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.592450 10809 raft_consensus.cc:591] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Received request to step down
I20260812 08:02:57.592522 10809 raft_consensus.cc:3055] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:57.592566 10809 raft_consensus.cc:740] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22c0914e9584654b3a387e3d436672e, State: Running, Role: LEADER
I20260812 08:02:57.592707 10809 consensus_queue.cc:260] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d22c0914e9584654b3a387e3d436672e" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 37547 } }
I20260812 08:02:57.592798 10809 raft_consensus.cc:3060] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:57.598538 10788 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d6607aa216345c0b92dbf138ea2c68e with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:47498
I20260812 08:02:57.598824 10911 tablet_replica.cc:333] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: stopping tablet replica
I20260812 08:02:57.598978 10911 raft_consensus.cc:2243] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:57.599131 10911 raft_consensus.cc:2272] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:57.599900 10911 ts_tablet_manager.cc:1916] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:57.601625 10911 ts_tablet_manager.cc:1929] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:57.601688 10911 log.cc:1199] T 3d6607aa216345c0b92dbf138ea2c68e P d22c0914e9584654b3a387e3d436672e: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_0.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/wals/3d6607aa216345c0b92dbf138ea2c68e
I20260812 08:02:57.607838 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 10712
I20260812 08:02:57.618629 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 10609
2026-08-12T08:02:57Z chronyd exiting
[       OK ] NumReplicas/RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric/0 (775 ms)
[ RUN      ] NumReplicas/RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric/1
I20260812 08:02:57.642998 32702 ts_itest-base.cc:115] Starting cluster with:
I20260812 08:02:57.643085 32702 ts_itest-base.cc:116] --------------
I20260812 08:02:57.643105 32702 ts_itest-base.cc:117] 3 tablet servers
I20260812 08:02:57.643122 32702 ts_itest-base.cc:118] 3 replicas per TS
I20260812 08:02:57.643148 32702 ts_itest-base.cc:119] --------------
2026-08-12T08:02:57Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:02:57Z Disabled control of system clock
I20260812 08:02:57.652488 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:44201
--webserver_interface=127.31.239.190
--webserver_port=0
--builtin_ntp_servers=127.31.239.148:35259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.31.239.190:44201
--catalog_manager_wait_for_new_tablets_to_elect_leader=false with env {}
W20260812 08:02:57.761524 10919 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:57.761806 10919 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:57.761886 10919 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:57.765367 10919 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:02:57.765439 10919 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:57.765460 10919 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:02:57.765478 10919 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:02:57.769480 10919 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.31.239.190:44201
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.31.239.190:44201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.31.239.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.10919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:57.770641 10919 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:57.771757 10919 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:57.777300 10925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:57.777326 10924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:57.777330 10927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:57.778083 10919 server_base.cc:1061] running on GCE node
I20260812 08:02:57.778653 10919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:57.779544 10919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:57.780728 10919 hybrid_clock.cc:648] HybridClock initialized: now 1786521777780721 us; error 32 us; skew 500 ppm
I20260812 08:02:57.782684 10919 webserver.cc:533] Webserver started at http://127.31.239.190:45135/ using document root <none> and password file <none>
I20260812 08:02:57.783309 10919 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:57.783399 10919 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:57.783628 10919 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:57.785208 10919 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "c822871138124a3db9a962bc0311c20b"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.785713 10919 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "c822871138124a3db9a962bc0311c20b"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.789191 10919 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:02:57.791563 10933 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:57.792536 10919 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:57.792673 10919 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
uuid: "c822871138124a3db9a962bc0311c20b"
format_stamp: "Formatted at 2026-08-12 08:02:57 on dist-test-slave-9jjr"
I20260812 08:02:57.792783 10919 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:57.801771 10919 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:57.802489 10919 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:57.802688 10919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:57.810297 10990 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.190:44201 every 8 connection(s)
I20260812 08:02:57.810302 10919 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.190:44201
I20260812 08:02:57.811424 10919 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20260812 08:02:57.814371 10991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:57.818063 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 10919
I20260812 08:02:57.818257 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/master-0/wal/instance
I20260812 08:02:57.819677 10991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b: Bootstrap starting.
I20260812 08:02:57.821938 10991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:57.822758 10991 log.cc:826] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:57.824579 10991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b: No bootstrap required, opened a new log
I20260812 08:02:57.827553 10991 raft_consensus.cc:359] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c822871138124a3db9a962bc0311c20b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 44201 } }
I20260812 08:02:57.827785 10991 raft_consensus.cc:385] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:02:57.827862 10991 raft_consensus.cc:740] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c822871138124a3db9a962bc0311c20b, State: Initialized, Role: FOLLOWER
I20260812 08:02:57.828249 10991 consensus_queue.cc:260] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c822871138124a3db9a962bc0311c20b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 44201 } }
I20260812 08:02:57.828374 10991 raft_consensus.cc:399] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:02:57.828419 10991 raft_consensus.cc:493] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:02:57.828493 10991 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:57.829259 10991 raft_consensus.cc:515] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c822871138124a3db9a962bc0311c20b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 44201 } }
I20260812 08:02:57.829559 10991 leader_election.cc:304] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c822871138124a3db9a962bc0311c20b; no voters: 
I20260812 08:02:57.829804 10991 leader_election.cc:290] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:02:57.829936 10997 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:57.830207 10997 raft_consensus.cc:697] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [term 1 LEADER]: Becoming Leader. State: Replica: c822871138124a3db9a962bc0311c20b, State: Running, Role: LEADER
I20260812 08:02:57.830509 10997 consensus_queue.cc:237] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c822871138124a3db9a962bc0311c20b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 44201 } }
I20260812 08:02:57.831022 10991 sys_catalog.cc:565] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:02:57.832150 10999 sys_catalog.cc:455] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c822871138124a3db9a962bc0311c20b. Latest consensus state: current_term: 1 leader_uuid: "c822871138124a3db9a962bc0311c20b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c822871138124a3db9a962bc0311c20b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 44201 } } }
I20260812 08:02:57.832291 10999 sys_catalog.cc:458] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:57.832711 11008 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:02:57.832603 10998 sys_catalog.cc:455] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c822871138124a3db9a962bc0311c20b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c822871138124a3db9a962bc0311c20b" member_type: VOTER last_known_addr { host: "127.31.239.190" port: 44201 } } }
I20260812 08:02:57.832962 10998 sys_catalog.cc:458] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b [sys.catalog]: This master's current role is: LEADER
I20260812 08:02:57.835949 11008 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:02:57.841404 11008 catalog_manager.cc:1383] Generated new cluster ID: 4a0f231617954485ae9cc6a061223adc
I20260812 08:02:57.841490 11008 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:02:57.861788 11008 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:02:57.863114 11008 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:02:57.876926 11008 catalog_manager.cc:6092] T 00000000000000000000000000000000 P c822871138124a3db9a962bc0311c20b: Generated new TSK 0
I20260812 08:02:57.877641 11008 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:02:57.891064 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.129:0
--local_ip_for_outbound_sockets=127.31.239.129
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:44201
--builtin_ntp_servers=127.31.239.148:35259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
W20260812 08:02:58.000113 11018 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:58.000365 11018 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:58.000387 11018 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:58.000487 11018 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:58.004071 11018 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:58.004248 11018 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.129
I20260812 08:02:58.008270 11018 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.31.239.129
--webserver_port=0
--tserver_master_addrs=127.31.239.190:44201
--never_fsync=true
--heap_profile_path=/tmp/kudu.11018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.129

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:58.009414 11018 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:58.010650 11018 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:58.017356 11026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:58.017373 11024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:58.017572 11018 server_base.cc:1061] running on GCE node
W20260812 08:02:58.017407 11023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:58.018118 11018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:58.018872 11018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:58.020087 11018 hybrid_clock.cc:648] HybridClock initialized: now 1786521778020063 us; error 39 us; skew 500 ppm
I20260812 08:02:58.022043 11018 webserver.cc:533] Webserver started at http://127.31.239.129:42329/ using document root <none> and password file <none>
I20260812 08:02:58.022697 11018 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:58.022792 11018 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:58.023023 11018 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:58.024644 11018 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "e8a65542b9a14175a057ae20d16f6ba6"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.025159 11018 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "e8a65542b9a14175a057ae20d16f6ba6"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.029184 11018 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:02:58.031620 11032 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.032761 11018 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:58.032927 11018 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "e8a65542b9a14175a057ae20d16f6ba6"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.033039 11018 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:58.050386 11018 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:58.051106 11018 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:58.051314 11018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:58.051931 11018 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:58.052959 11018 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:58.053032 11018 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.053102 11018 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:58.053138 11018 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.063366 11018 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.129:38073
I20260812 08:02:58.063391 11160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.129:38073 every 8 connection(s)
I20260812 08:02:58.064404 11018 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20260812 08:02:58.068699 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 11018
I20260812 08:02:58.068799 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20260812 08:02:58.071064 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.130:0
--local_ip_for_outbound_sockets=127.31.239.130
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:44201
--builtin_ntp_servers=127.31.239.148:35259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:02:58.074261 11161 heartbeater.cc:344] Connected to a master server at 127.31.239.190:44201
I20260812 08:02:58.074545 11161 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:58.075085 11161 heartbeater.cc:507] Master 127.31.239.190:44201 requested a full tablet report, sending...
I20260812 08:02:58.076648 10951 ts_manager.cc:194] Registered new tserver with Master: e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073)
I20260812 08:02:58.077811 10951 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.129:55369
W20260812 08:02:58.180657 11166 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:58.180956 11166 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:58.181025 11166 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:58.181102 11166 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:58.184759 11166 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:58.184973 11166 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.130
I20260812 08:02:58.189030 11166 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.31.239.130
--webserver_port=0
--tserver_master_addrs=127.31.239.190:44201
--never_fsync=true
--heap_profile_path=/tmp/kudu.11166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.130

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:58.190304 11166 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:58.191474 11166 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:58.198107 11171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:58.198105 11174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:58.198230 11172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:58.198622 11166 server_base.cc:1061] running on GCE node
I20260812 08:02:58.199021 11166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:58.199594 11166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:58.200758 11166 hybrid_clock.cc:648] HybridClock initialized: now 1786521778200742 us; error 31 us; skew 500 ppm
I20260812 08:02:58.202736 11166 webserver.cc:533] Webserver started at http://127.31.239.130:46081/ using document root <none> and password file <none>
I20260812 08:02:58.203366 11166 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:58.203426 11166 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:58.203683 11166 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:58.205329 11166 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "7e74710d82ae407587c229c937852007"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.205839 11166 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "7e74710d82ae407587c229c937852007"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.209385 11166 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 08:02:58.211925 11180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.212962 11166 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:58.213107 11166 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "7e74710d82ae407587c229c937852007"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.213223 11166 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:58.233620 11166 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:58.234625 11166 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:58.234917 11166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:58.235714 11166 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:58.237116 11166 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:58.237229 11166 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.237324 11166 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:58.237380 11166 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.251211 11166 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.130:44301
I20260812 08:02:58.251227 11308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.130:44301 every 8 connection(s)
I20260812 08:02:58.252542 11166 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20260812 08:02:58.260249 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 11166
I20260812 08:02:58.260413 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20260812 08:02:58.263803 32702 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
/tmp/dist-test-taskA7XbNu/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.31.239.131:0
--local_ip_for_outbound_sockets=127.31.239.131
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:44201
--builtin_ntp_servers=127.31.239.148:35259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false with env {}
I20260812 08:02:58.269495 11309 heartbeater.cc:344] Connected to a master server at 127.31.239.190:44201
I20260812 08:02:58.269852 11309 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:58.270725 11309 heartbeater.cc:507] Master 127.31.239.190:44201 requested a full tablet report, sending...
I20260812 08:02:58.272310 10951 ts_manager.cc:194] Registered new tserver with Master: 7e74710d82ae407587c229c937852007 (127.31.239.130:44301)
I20260812 08:02:58.273206 10951 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.130:58937
W20260812 08:02:58.378536 11313 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 08:02:58.378844 11313 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:02:58.378908 11313 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:02:58.378990 11313 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:02:58.382700 11313 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:02:58.382892 11313 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.239.131
I20260812 08:02:58.387215 11313 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.31.239.148:35259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.31.239.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.31.239.131
--webserver_port=0
--tserver_master_addrs=127.31.239.190:44201
--never_fsync=true
--heap_profile_path=/tmp/kudu.11313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.31.239.131

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:02:58.388470 11313 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:02:58.389658 11313 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:02:58.396613 11321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:58.396559 11318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:02:58.396559 11319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:02:58.397200 11313 server_base.cc:1061] running on GCE node
I20260812 08:02:58.397558 11313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:02:58.398176 11313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:02:58.399355 11313 hybrid_clock.cc:648] HybridClock initialized: now 1786521778399338 us; error 32 us; skew 500 ppm
I20260812 08:02:58.401253 11313 webserver.cc:533] Webserver started at http://127.31.239.131:34231/ using document root <none> and password file <none>
I20260812 08:02:58.401918 11313 fs_manager.cc:362] Metadata directory not provided
I20260812 08:02:58.402010 11313 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:02:58.402316 11313 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:02:58.403926 11313 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.404439 11313 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.408030 11313 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:02:58.410395 11328 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.411473 11313 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:02:58.411615 11313 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
format_stamp: "Formatted at 2026-08-12 08:02:58 on dist-test-slave-9jjr"
I20260812 08:02:58.411727 11313 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:02:58.430907 11313 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:02:58.431665 11313 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:02:58.431932 11313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:02:58.432590 11313 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 08:02:58.433749 11313 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:02:58.433825 11313 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.433905 11313 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:02:58.433948 11313 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:02:58.444233 11313 rpc_server.cc:307] RPC server started. Bound to: 127.31.239.131:39573
I20260812 08:02:58.444257 11458 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.239.131:39573 every 8 connection(s)
I20260812 08:02:58.445243 11313 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20260812 08:02:58.452960 32702 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu as pid 11313
I20260812 08:02:58.453101 32702 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20260812 08:02:58.454659 11459 heartbeater.cc:344] Connected to a master server at 127.31.239.190:44201
I20260812 08:02:58.454967 11459 heartbeater.cc:461] Registering TS with master...
I20260812 08:02:58.455598 11459 heartbeater.cc:507] Master 127.31.239.190:44201 requested a full tablet report, sending...
I20260812 08:02:58.456707 10950 ts_manager.cc:194] Registered new tserver with Master: 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.457319 10950 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.239.131:41341
I20260812 08:02:58.468370 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:58.478551 32702 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:02:58.488657 10950 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55888:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 08:02:58.490177 10950 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:02:58.512624 11087 tablet_service.cc:1511] Processing CreateTablet for tablet 916b2ea582f046818ced8b818861d5cc (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260812 08:02:58.512858 11381 tablet_service.cc:1511] Processing CreateTablet for tablet 916b2ea582f046818ced8b818861d5cc (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260812 08:02:58.513079 11379 tablet_service.cc:1511] Processing CreateTablet for tablet e78fc8d6680f446cbe6bebfc08644bcb (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260812 08:02:58.513616 11378 tablet_service.cc:1511] Processing CreateTablet for tablet fc2637cc089046a58e0eb3265fcc33a6 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260812 08:02:58.513207 11380 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8c9fa041534724bfbb9c53186fe227 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260812 08:02:58.512861 11374 tablet_service.cc:1511] Processing CreateTablet for tablet 5a85ec5a426c48df9eede02129cc4d3f (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260812 08:02:58.512630 11081 tablet_service.cc:1511] Processing CreateTablet for tablet 5a85ec5a426c48df9eede02129cc4d3f (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260812 08:02:58.513938 11080 tablet_service.cc:1511] Processing CreateTablet for tablet 3a67984c404c43d08b03d9d515dcbbdc (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260812 08:02:58.514096 11378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2637cc089046a58e0eb3265fcc33a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.513692 11086 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8c9fa041534724bfbb9c53186fe227 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260812 08:02:58.514321 11082 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1f4796f4c2474ba60c5a36cd8d4981 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260812 08:02:58.514503 11380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8c9fa041534724bfbb9c53186fe227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.514642 11084 tablet_service.cc:1511] Processing CreateTablet for tablet fc2637cc089046a58e0eb3265fcc33a6 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260812 08:02:58.514654 11081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a85ec5a426c48df9eede02129cc4d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.515453 11084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2637cc089046a58e0eb3265fcc33a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.515743 11379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78fc8d6680f446cbe6bebfc08644bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.516039 11085 tablet_service.cc:1511] Processing CreateTablet for tablet e78fc8d6680f446cbe6bebfc08644bcb (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260812 08:02:58.516270 11085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78fc8d6680f446cbe6bebfc08644bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.516306 11374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a85ec5a426c48df9eede02129cc4d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.514987 11083 tablet_service.cc:1511] Processing CreateTablet for tablet 579b0351e04e48ff9e3085a8bda8f0ad (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260812 08:02:58.517632 11083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579b0351e04e48ff9e3085a8bda8f0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.518242 11381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916b2ea582f046818ced8b818861d5cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.518592 11377 tablet_service.cc:1511] Processing CreateTablet for tablet 579b0351e04e48ff9e3085a8bda8f0ad (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260812 08:02:58.518826 11377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579b0351e04e48ff9e3085a8bda8f0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.518950 11082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1f4796f4c2474ba60c5a36cd8d4981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.520977 11086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8c9fa041534724bfbb9c53186fe227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.520915 11375 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1f4796f4c2474ba60c5a36cd8d4981 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260812 08:02:58.521628 11375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1f4796f4c2474ba60c5a36cd8d4981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.521871 11373 tablet_service.cc:1511] Processing CreateTablet for tablet 3a67984c404c43d08b03d9d515dcbbdc (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260812 08:02:58.522215 11373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a67984c404c43d08b03d9d515dcbbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.522317 11080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a67984c404c43d08b03d9d515dcbbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.524456 11372 tablet_service.cc:1511] Processing CreateTablet for tablet d34fcc936f8c47088a8d1e0add0875f4 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260812 08:02:58.524724 11372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34fcc936f8c47088a8d1e0add0875f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.527105 11369 tablet_service.cc:1511] Processing CreateTablet for tablet 23ddaa983f724634995ed477fe2d587d (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260812 08:02:58.527374 11369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ddaa983f724634995ed477fe2d587d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.528244 11087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916b2ea582f046818ced8b818861d5cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.529296 11485 tablet_bootstrap.cc:492] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.530193 11083 tablet_service.cc:1511] Processing CreateTablet for tablet 23ddaa983f724634995ed477fe2d587d (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260812 08:02:58.530184 11082 tablet_service.cc:1511] Processing CreateTablet for tablet d34fcc936f8c47088a8d1e0add0875f4 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260812 08:02:58.530552 11083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ddaa983f724634995ed477fe2d587d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.531890 11485 tablet_bootstrap.cc:654] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.532742 11484 tablet_bootstrap.cc:492] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.532897 11485 log.cc:826] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:58.535221 11484 tablet_bootstrap.cc:654] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.534998 11225 tablet_service.cc:1511] Processing CreateTablet for tablet 3a67984c404c43d08b03d9d515dcbbdc (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260812 08:02:58.535267 11231 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8c9fa041534724bfbb9c53186fe227 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260812 08:02:58.535750 11230 tablet_service.cc:1511] Processing CreateTablet for tablet e78fc8d6680f446cbe6bebfc08644bcb (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260812 08:02:58.535480 11227 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1f4796f4c2474ba60c5a36cd8d4981 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260812 08:02:58.535295 11226 tablet_service.cc:1511] Processing CreateTablet for tablet 5a85ec5a426c48df9eede02129cc4d3f (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260812 08:02:58.534998 11224 tablet_service.cc:1511] Processing CreateTablet for tablet d34fcc936f8c47088a8d1e0add0875f4 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260812 08:02:58.536171 11484 log.cc:826] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:58.536285 11229 tablet_service.cc:1511] Processing CreateTablet for tablet fc2637cc089046a58e0eb3265fcc33a6 (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260812 08:02:58.536443 11228 tablet_service.cc:1511] Processing CreateTablet for tablet 579b0351e04e48ff9e3085a8bda8f0ad (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260812 08:02:58.536580 11223 tablet_service.cc:1511] Processing CreateTablet for tablet 23ddaa983f724634995ed477fe2d587d (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260812 08:02:58.536660 11231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8c9fa041534724bfbb9c53186fe227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.534998 11232 tablet_service.cc:1511] Processing CreateTablet for tablet 916b2ea582f046818ced8b818861d5cc (DEFAULT_TABLE table=test-workload [id=0ae3ae7341904d1f9fdb520d681ded1b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260812 08:02:58.537010 11230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78fc8d6680f446cbe6bebfc08644bcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.537166 11232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916b2ea582f046818ced8b818861d5cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.538213 11484 tablet_bootstrap.cc:492] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.538371 11223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ddaa983f724634995ed477fe2d587d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.538427 11484 ts_tablet_manager.cc:1403] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:58.538491 11224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34fcc936f8c47088a8d1e0add0875f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.538882 11227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1f4796f4c2474ba60c5a36cd8d4981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.538930 11082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34fcc936f8c47088a8d1e0add0875f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.541854 11484 raft_consensus.cc:359] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.542222 11226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a85ec5a426c48df9eede02129cc4d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.542222 11484 raft_consensus.cc:740] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.542622 11484 consensus_queue.cc:260] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.543737 11484 ts_tablet_manager.cc:1434] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:02:58.544111 11161 heartbeater.cc:499] Master 127.31.239.190:44201 was elected leader, sending a full tablet report...
I20260812 08:02:58.544461 11228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579b0351e04e48ff9e3085a8bda8f0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.545461 11484 tablet_bootstrap.cc:492] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.546545 11229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2637cc089046a58e0eb3265fcc33a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.547031 11484 tablet_bootstrap.cc:654] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.547384 11485 tablet_bootstrap.cc:492] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.547708 11485 ts_tablet_manager.cc:1403] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.000s
I20260812 08:02:58.548319 11484 tablet_bootstrap.cc:492] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.548419 11484 ts_tablet_manager.cc:1403] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:02:58.548983 11225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a67984c404c43d08b03d9d515dcbbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:02:58.549003 11484 raft_consensus.cc:359] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.551296 11484 raft_consensus.cc:740] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.551430 11484 consensus_queue.cc:260] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.551846 11484 ts_tablet_manager.cc:1434] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.001s
I20260812 08:02:58.551723 11485 raft_consensus.cc:359] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } }
I20260812 08:02:58.552062 11484 tablet_bootstrap.cc:492] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.552081 11485 raft_consensus.cc:740] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.552412 11485 consensus_queue.cc:260] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } }
I20260812 08:02:58.553198 11484 tablet_bootstrap.cc:654] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.553260 11459 heartbeater.cc:499] Master 127.31.239.190:44201 was elected leader, sending a full tablet report...
I20260812 08:02:58.553491 11485 ts_tablet_manager.cc:1434] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 08:02:58.553793 11485 tablet_bootstrap.cc:492] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.553982 11491 tablet_bootstrap.cc:492] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.555612 11485 tablet_bootstrap.cc:654] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.556378 11491 tablet_bootstrap.cc:654] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.557197 11484 tablet_bootstrap.cc:492] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.557356 11484 ts_tablet_manager.cc:1403] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.001s
I20260812 08:02:58.557343 11491 log.cc:826] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Log is configured to *not* fsync() on all Append() calls
I20260812 08:02:58.557410 11485 tablet_bootstrap.cc:492] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.557489 11485 ts_tablet_manager.cc:1403] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260812 08:02:58.558063 11484 raft_consensus.cc:359] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.558184 11485 raft_consensus.cc:359] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.558302 11485 raft_consensus.cc:740] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.558382 11484 raft_consensus.cc:740] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.558420 11485 consensus_queue.cc:260] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.558578 11484 consensus_queue.cc:260] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.558737 11485 ts_tablet_manager.cc:1434] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20260812 08:02:58.558962 11485 tablet_bootstrap.cc:492] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.558959 11484 ts_tablet_manager.cc:1434] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:58.559213 11484 tablet_bootstrap.cc:492] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.559428 11491 tablet_bootstrap.cc:492] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.559649 11491 ts_tablet_manager.cc:1403] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:02:58.560022 11485 tablet_bootstrap.cc:654] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.560526 11484 tablet_bootstrap.cc:654] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.561400 11485 tablet_bootstrap.cc:492] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.561486 11485 ts_tablet_manager.cc:1403] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:58.562001 11485 raft_consensus.cc:359] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.562114 11485 raft_consensus.cc:740] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.562251 11485 consensus_queue.cc:260] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.562597 11485 ts_tablet_manager.cc:1434] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:58.562850 11485 tablet_bootstrap.cc:492] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.563336 11491 raft_consensus.cc:359] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.563562 11491 raft_consensus.cc:740] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.563925 11485 tablet_bootstrap.cc:654] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.563875 11491 consensus_queue.cc:260] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.564872 11491 ts_tablet_manager.cc:1434] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260812 08:02:58.565191 11485 tablet_bootstrap.cc:492] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.565250 11309 heartbeater.cc:499] Master 127.31.239.190:44201 was elected leader, sending a full tablet report...
I20260812 08:02:58.565387 11485 ts_tablet_manager.cc:1403] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
W20260812 08:02:58.565732 11162 tablet.cc:2406] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:58.566007 11485 raft_consensus.cc:359] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.566211 11485 raft_consensus.cc:740] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.566367 11485 consensus_queue.cc:260] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.566704 11485 ts_tablet_manager.cc:1434] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.566948 11485 tablet_bootstrap.cc:492] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.567337 11484 tablet_bootstrap.cc:492] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.567457 11484 ts_tablet_manager.cc:1403] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.008s	user 0.000s	sys 0.002s
I20260812 08:02:58.567479 11491 tablet_bootstrap.cc:492] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.568003 11484 raft_consensus.cc:359] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.568116 11484 raft_consensus.cc:740] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.568215 11484 consensus_queue.cc:260] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.568542 11485 tablet_bootstrap.cc:654] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.568584 11484 ts_tablet_manager.cc:1434] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:58.568790 11484 tablet_bootstrap.cc:492] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.569038 11491 tablet_bootstrap.cc:654] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.570196 11484 tablet_bootstrap.cc:654] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.571003 11491 tablet_bootstrap.cc:492] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.571094 11491 ts_tablet_manager.cc:1403] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.001s
I20260812 08:02:58.571157 11485 tablet_bootstrap.cc:492] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.571230 11485 ts_tablet_manager.cc:1403] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260812 08:02:58.571333 11484 tablet_bootstrap.cc:492] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.571412 11484 ts_tablet_manager.cc:1403] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:02:58.571678 11485 raft_consensus.cc:359] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.571781 11485 raft_consensus.cc:740] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.571720 11491 raft_consensus.cc:359] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } }
I20260812 08:02:58.571830 11491 raft_consensus.cc:740] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.571874 11485 consensus_queue.cc:260] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.571867 11484 raft_consensus.cc:359] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.571916 11491 consensus_queue.cc:260] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } }
I20260812 08:02:58.571995 11484 raft_consensus.cc:740] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.572106 11484 consensus_queue.cc:260] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.572166 11491 ts_tablet_manager.cc:1434] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.572196 11485 ts_tablet_manager.cc:1434] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.572330 11491 tablet_bootstrap.cc:492] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.572357 11485 tablet_bootstrap.cc:492] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.572446 11484 ts_tablet_manager.cc:1434] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:58.572625 11484 tablet_bootstrap.cc:492] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.573350 11491 tablet_bootstrap.cc:654] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.573776 11484 tablet_bootstrap.cc:654] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.575150 11491 tablet_bootstrap.cc:492] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.575151 11484 tablet_bootstrap.cc:492] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.575237 11484 ts_tablet_manager.cc:1403] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:02:58.575237 11491 ts_tablet_manager.cc:1403] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:02:58.575690 11484 raft_consensus.cc:359] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.575701 11491 raft_consensus.cc:359] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.575814 11491 raft_consensus.cc:740] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.575814 11484 raft_consensus.cc:740] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.575913 11484 consensus_queue.cc:260] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.575917 11491 consensus_queue.cc:260] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.576189 11491 ts_tablet_manager.cc:1434] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.576210 11484 ts_tablet_manager.cc:1434] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.576344 11491 tablet_bootstrap.cc:492] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.576385 11484 tablet_bootstrap.cc:492] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.577395 11491 tablet_bootstrap.cc:654] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.577426 11484 tablet_bootstrap.cc:654] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.578751 11491 tablet_bootstrap.cc:492] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.578857 11491 ts_tablet_manager.cc:1403] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:02:58.579228 11485 tablet_bootstrap.cc:654] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.579332 11491 raft_consensus.cc:359] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.579443 11491 raft_consensus.cc:740] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.579545 11491 consensus_queue.cc:260] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.579839 11491 ts_tablet_manager.cc:1434] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.580005 11491 tablet_bootstrap.cc:492] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.580996 11484 tablet_bootstrap.cc:492] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.581106 11484 ts_tablet_manager.cc:1403] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.002s
I20260812 08:02:58.581189 11491 tablet_bootstrap.cc:654] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.581604 11484 raft_consensus.cc:359] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } }
I20260812 08:02:58.581705 11484 raft_consensus.cc:740] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.581805 11484 consensus_queue.cc:260] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } }
I20260812 08:02:58.582005 11485 tablet_bootstrap.cc:492] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.582098 11485 ts_tablet_manager.cc:1403] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.010s	user 0.002s	sys 0.000s
I20260812 08:02:58.582095 11484 ts_tablet_manager.cc:1434] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.582333 11484 tablet_bootstrap.cc:492] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.582494 11491 tablet_bootstrap.cc:492] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.582566 11491 ts_tablet_manager.cc:1403] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:02:58.582647 11485 raft_consensus.cc:359] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.582749 11485 raft_consensus.cc:740] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.582840 11485 consensus_queue.cc:260] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.583029 11491 raft_consensus.cc:359] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.583153 11491 raft_consensus.cc:740] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.583240 11491 consensus_queue.cc:260] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.583485 11491 ts_tablet_manager.cc:1434] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:58.583573 11484 tablet_bootstrap.cc:654] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.583657 11491 tablet_bootstrap.cc:492] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.584600 11485 ts_tablet_manager.cc:1434] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:02:58.584867 11485 tablet_bootstrap.cc:492] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.584879 11491 tablet_bootstrap.cc:654] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.586146 11491 tablet_bootstrap.cc:492] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.586243 11491 ts_tablet_manager.cc:1403] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20260812 08:02:58.586771 11491 raft_consensus.cc:359] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.586876 11491 raft_consensus.cc:740] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.586964 11491 consensus_queue.cc:260] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.587213 11491 ts_tablet_manager.cc:1434] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.587301 11484 tablet_bootstrap.cc:492] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.587378 11491 tablet_bootstrap.cc:492] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.587388 11484 ts_tablet_manager.cc:1403] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.000s
I20260812 08:02:58.587896 11484 raft_consensus.cc:359] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.588014 11484 raft_consensus.cc:740] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.588116 11484 consensus_queue.cc:260] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.588415 11484 ts_tablet_manager.cc:1434] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.588459 11491 tablet_bootstrap.cc:654] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.588655 11484 tablet_bootstrap.cc:492] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.589725 11484 tablet_bootstrap.cc:654] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.589814 11491 tablet_bootstrap.cc:492] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.589887 11491 ts_tablet_manager.cc:1403] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:02:58.590502 11491 raft_consensus.cc:359] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.590593 11485 tablet_bootstrap.cc:654] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.590624 11491 raft_consensus.cc:740] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.590718 11491 consensus_queue.cc:260] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.591001 11491 ts_tablet_manager.cc:1434] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.591113 11484 tablet_bootstrap.cc:492] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.591176 11491 tablet_bootstrap.cc:492] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.591187 11484 ts_tablet_manager.cc:1403] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:58.591682 11484 raft_consensus.cc:359] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.591784 11484 raft_consensus.cc:740] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.591885 11484 consensus_queue.cc:260] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.592144 11484 ts_tablet_manager.cc:1434] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.592211 11491 tablet_bootstrap.cc:654] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.592358 11484 tablet_bootstrap.cc:492] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6: Bootstrap starting.
I20260812 08:02:58.593411 11484 tablet_bootstrap.cc:654] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.593612 11485 tablet_bootstrap.cc:492] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.593704 11485 ts_tablet_manager.cc:1403] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.009s	user 0.002s	sys 0.000s
I20260812 08:02:58.594447 11485 raft_consensus.cc:359] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.594563 11485 raft_consensus.cc:740] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.594622 11484 tablet_bootstrap.cc:492] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6: No bootstrap required, opened a new log
I20260812 08:02:58.594697 11484 ts_tablet_manager.cc:1403] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:58.594655 11485 consensus_queue.cc:260] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.594743 11491 tablet_bootstrap.cc:492] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.594815 11491 ts_tablet_manager.cc:1403] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260812 08:02:58.594965 11485 ts_tablet_manager.cc:1434] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.595122 11485 tablet_bootstrap.cc:492] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.595257 11484 raft_consensus.cc:359] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.595257 11491 raft_consensus.cc:359] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.595361 11491 raft_consensus.cc:740] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.595361 11484 raft_consensus.cc:740] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a65542b9a14175a057ae20d16f6ba6, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.595458 11484 consensus_queue.cc:260] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.595469 11491 consensus_queue.cc:260] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.595706 11491 ts_tablet_manager.cc:1434] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.595706 11484 ts_tablet_manager.cc:1434] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.595875 11491 tablet_bootstrap.cc:492] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.596297 11485 tablet_bootstrap.cc:654] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.596917 11491 tablet_bootstrap.cc:654] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.597461 11485 tablet_bootstrap.cc:492] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.597540 11485 ts_tablet_manager.cc:1403] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:02:58.598018 11485 raft_consensus.cc:359] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.598179 11485 raft_consensus.cc:740] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.598325 11485 consensus_queue.cc:260] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.598624 11485 ts_tablet_manager.cc:1434] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 08:02:58.598819 11485 tablet_bootstrap.cc:492] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.599962 11485 tablet_bootstrap.cc:654] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.601281 11491 tablet_bootstrap.cc:492] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.601378 11491 ts_tablet_manager.cc:1403] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.006s	user 0.002s	sys 0.000s
I20260812 08:02:58.601933 11491 raft_consensus.cc:359] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.602056 11491 raft_consensus.cc:740] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.602193 11491 consensus_queue.cc:260] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.602511 11491 ts_tablet_manager.cc:1434] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 08:02:58.602586 11485 tablet_bootstrap.cc:492] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.602675 11485 ts_tablet_manager.cc:1403] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.004s	user 0.000s	sys 0.002s
I20260812 08:02:58.602727 11491 tablet_bootstrap.cc:492] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: Bootstrap starting.
I20260812 08:02:58.603178 11485 raft_consensus.cc:359] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.603291 11485 raft_consensus.cc:740] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.603376 11485 consensus_queue.cc:260] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.603679 11485 ts_tablet_manager.cc:1434] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.603919 11485 tablet_bootstrap.cc:492] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0: Bootstrap starting.
I20260812 08:02:58.604458 11491 tablet_bootstrap.cc:654] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.605058 11485 tablet_bootstrap.cc:654] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0: Neither blocks nor log segments found. Creating new log.
I20260812 08:02:58.606858 11485 tablet_bootstrap.cc:492] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0: No bootstrap required, opened a new log
I20260812 08:02:58.606989 11485 ts_tablet_manager.cc:1403] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:02:58.607460 11485 raft_consensus.cc:359] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.607604 11485 raft_consensus.cc:740] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 271e06aa7c8346c9bb3ff6be1dda60b0, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.607729 11491 tablet_bootstrap.cc:492] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: No bootstrap required, opened a new log
I20260812 08:02:58.607710 11485 consensus_queue.cc:260] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.607843 11491 ts_tablet_manager.cc:1403] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.000s
I20260812 08:02:58.608026 11485 ts_tablet_manager.cc:1434] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.608357 11491 raft_consensus.cc:359] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.608485 11491 raft_consensus.cc:740] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Initialized, Role: FOLLOWER
I20260812 08:02:58.608603 11491 consensus_queue.cc:260] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.608911 11491 ts_tablet_manager.cc:1434] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260812 08:02:58.642385 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d34fcc936f8c47088a8d1e0add0875f4"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.642653 11252 raft_consensus.cc:493] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.642833 11252 raft_consensus.cc:3060] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.643996 11252 raft_consensus.cc:515] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.645088 11252 leader_election.cc:290] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.650118 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34fcc936f8c47088a8d1e0add0875f4" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.650425 11110 raft_consensus.cc:3060] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.651707 11110 raft_consensus.cc:2468] T d34fcc936f8c47088a8d1e0add0875f4 P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.652292 11183 leader_election.cc:304] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e74710d82ae407587c229c937852007, e8a65542b9a14175a057ae20d16f6ba6; no voters: 
I20260812 08:02:58.652585 11501 raft_consensus.cc:2804] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.652841 11501 raft_consensus.cc:697] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.653204 11501 consensus_queue.cc:237] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.653283 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34fcc936f8c47088a8d1e0add0875f4" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.653488 11405 raft_consensus.cc:3060] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.654814 11405 raft_consensus.cc:2468] T d34fcc936f8c47088a8d1e0add0875f4 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.657138 10949 catalog_manager.cc:5719] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.665409 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23ddaa983f724634995ed477fe2d587d"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.665597 11252 raft_consensus.cc:493] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.665695 11252 raft_consensus.cc:3060] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.666893 11252 raft_consensus.cc:515] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.667388 11252 leader_election.cc:290] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.667975 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ddaa983f724634995ed477fe2d587d" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.668021 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ddaa983f724634995ed477fe2d587d" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.668123 11405 raft_consensus.cc:3060] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.668140 11110 raft_consensus.cc:3060] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.669112 11110 raft_consensus.cc:2468] T 23ddaa983f724634995ed477fe2d587d P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.669112 11405 raft_consensus.cc:2468] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.669534 11183 leader_election.cc:304] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271e06aa7c8346c9bb3ff6be1dda60b0, 7e74710d82ae407587c229c937852007; no voters: 
I20260812 08:02:58.669749 11501 raft_consensus.cc:2804] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.669865 11501 raft_consensus.cc:697] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.670053 11501 consensus_queue.cc:237] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.672276 10949 catalog_manager.cc:5719] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.678740 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a85ec5a426c48df9eede02129cc4d3f"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.678953 11252 raft_consensus.cc:493] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.679032 11252 raft_consensus.cc:3060] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.680292 11252 raft_consensus.cc:515] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.680780 11252 leader_election.cc:290] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.681300 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a85ec5a426c48df9eede02129cc4d3f" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.681438 11405 raft_consensus.cc:3060] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.682495 11405 raft_consensus.cc:2468] T 5a85ec5a426c48df9eede02129cc4d3f P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.682523 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a85ec5a426c48df9eede02129cc4d3f" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.682647 11110 raft_consensus.cc:3060] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.682933 11183 leader_election.cc:304] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271e06aa7c8346c9bb3ff6be1dda60b0, 7e74710d82ae407587c229c937852007; no voters: 
I20260812 08:02:58.683842 11110 raft_consensus.cc:2468] T 5a85ec5a426c48df9eede02129cc4d3f P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.684415 11501 raft_consensus.cc:2804] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.684535 11501 raft_consensus.cc:697] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.684703 11501 consensus_queue.cc:237] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.686831 10949 catalog_manager.cc:5719] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.693804 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "916b2ea582f046818ced8b818861d5cc"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.694007 11252 raft_consensus.cc:493] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.694088 11252 raft_consensus.cc:3060] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.695349 11252 raft_consensus.cc:515] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } }
I20260812 08:02:58.695886 11252 leader_election.cc:290] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573), e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073)
W20260812 08:02:58.696202 11460 tablet.cc:2406] T 23ddaa983f724634995ed477fe2d587d P 271e06aa7c8346c9bb3ff6be1dda60b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:58.696430 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916b2ea582f046818ced8b818861d5cc" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.696521 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916b2ea582f046818ced8b818861d5cc" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.696601 11405 raft_consensus.cc:3060] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.696676 11110 raft_consensus.cc:3060] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.697625 11405 raft_consensus.cc:2468] T 916b2ea582f046818ced8b818861d5cc P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.697965 11110 raft_consensus.cc:2468] T 916b2ea582f046818ced8b818861d5cc P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.698288 11183 leader_election.cc:304] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271e06aa7c8346c9bb3ff6be1dda60b0, 7e74710d82ae407587c229c937852007; no voters: 
I20260812 08:02:58.698463 11501 raft_consensus.cc:2804] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.698666 11501 raft_consensus.cc:697] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.698848 11501 consensus_queue.cc:237] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } }
I20260812 08:02:58.701174 10949 catalog_manager.cc:5719] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.706534 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1f4796f4c2474ba60c5a36cd8d4981"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.706708 11252 raft_consensus.cc:493] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.706785 11252 raft_consensus.cc:3060] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.708122 11252 raft_consensus.cc:515] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.708621 11252 leader_election.cc:290] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.709210 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1f4796f4c2474ba60c5a36cd8d4981" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.709246 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1f4796f4c2474ba60c5a36cd8d4981" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.709367 11405 raft_consensus.cc:3060] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.709528 11110 raft_consensus.cc:3060] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.710577 11110 raft_consensus.cc:2468] T 8a1f4796f4c2474ba60c5a36cd8d4981 P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.710631 11405 raft_consensus.cc:2468] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.710933 11183 leader_election.cc:304] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e74710d82ae407587c229c937852007, e8a65542b9a14175a057ae20d16f6ba6; no voters: 
I20260812 08:02:58.711155 11501 raft_consensus.cc:2804] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.711380 11501 raft_consensus.cc:697] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.711615 11501 consensus_queue.cc:237] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.713750 10949 catalog_manager.cc:5719] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.719576 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e78fc8d6680f446cbe6bebfc08644bcb"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.719769 11252 raft_consensus.cc:493] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.719851 11252 raft_consensus.cc:3060] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.721161 11252 raft_consensus.cc:515] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.721707 11252 leader_election.cc:290] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.722304 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78fc8d6680f446cbe6bebfc08644bcb" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.722368 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78fc8d6680f446cbe6bebfc08644bcb" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.722467 11405 raft_consensus.cc:3060] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.722517 11110 raft_consensus.cc:3060] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.723316 11110 raft_consensus.cc:2468] T e78fc8d6680f446cbe6bebfc08644bcb P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.723692 11405 raft_consensus.cc:2468] T e78fc8d6680f446cbe6bebfc08644bcb P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.723693 11183 leader_election.cc:304] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e74710d82ae407587c229c937852007, e8a65542b9a14175a057ae20d16f6ba6; no voters: 
I20260812 08:02:58.723927 11501 raft_consensus.cc:2804] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.724033 11501 raft_consensus.cc:697] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.724198 11501 consensus_queue.cc:237] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.726432 10949 catalog_manager.cc:5719] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.731809 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc2637cc089046a58e0eb3265fcc33a6"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.731987 11252 raft_consensus.cc:493] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.732057 11252 raft_consensus.cc:3060] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.733013 11252 raft_consensus.cc:515] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.733464 11252 leader_election.cc:290] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.734084 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2637cc089046a58e0eb3265fcc33a6" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.734069 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2637cc089046a58e0eb3265fcc33a6" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.734244 11405 raft_consensus.cc:3060] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.734246 11110 raft_consensus.cc:3060] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.735184 11110 raft_consensus.cc:2468] T fc2637cc089046a58e0eb3265fcc33a6 P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.735184 11405 raft_consensus.cc:2468] T fc2637cc089046a58e0eb3265fcc33a6 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.735536 11183 leader_election.cc:304] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e74710d82ae407587c229c937852007, e8a65542b9a14175a057ae20d16f6ba6; no voters: 
I20260812 08:02:58.735724 11501 raft_consensus.cc:2804] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.735813 11501 raft_consensus.cc:697] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.735955 11501 consensus_queue.cc:237] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.738240 10949 catalog_manager.cc:5719] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.743459 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a67984c404c43d08b03d9d515dcbbdc"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.743597 11252 raft_consensus.cc:493] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.743644 11252 raft_consensus.cc:3060] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.744464 11252 raft_consensus.cc:515] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.744800 11252 leader_election.cc:290] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.745260 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a67984c404c43d08b03d9d515dcbbdc" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.745394 11110 raft_consensus.cc:3060] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.745569 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a67984c404c43d08b03d9d515dcbbdc" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.745684 11405 raft_consensus.cc:3060] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.746428 11110 raft_consensus.cc:2468] T 3a67984c404c43d08b03d9d515dcbbdc P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.746699 11405 raft_consensus.cc:2468] T 3a67984c404c43d08b03d9d515dcbbdc P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.746779 11183 leader_election.cc:304] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e74710d82ae407587c229c937852007, e8a65542b9a14175a057ae20d16f6ba6; no voters: 
I20260812 08:02:58.746968 11501 raft_consensus.cc:2804] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.747059 11501 raft_consensus.cc:697] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.747205 11501 consensus_queue.cc:237] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.749066 10949 catalog_manager.cc:5719] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
W20260812 08:02:58.753700 11311 tablet.cc:2406] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:02:58.755298 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f8c9fa041534724bfbb9c53186fe227"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.755471 11252 raft_consensus.cc:493] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.755551 11252 raft_consensus.cc:3060] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.756834 11252 raft_consensus.cc:515] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.757400 11252 leader_election.cc:290] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.757997 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8c9fa041534724bfbb9c53186fe227" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.758164 11405 raft_consensus.cc:3060] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.758067 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8c9fa041534724bfbb9c53186fe227" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.758342 11110 raft_consensus.cc:3060] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.759222 11405 raft_consensus.cc:2468] T 9f8c9fa041534724bfbb9c53186fe227 P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.759593 11183 leader_election.cc:304] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271e06aa7c8346c9bb3ff6be1dda60b0, 7e74710d82ae407587c229c937852007; no voters: 
I20260812 08:02:58.759799 11501 raft_consensus.cc:2804] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.759853 11110 raft_consensus.cc:2468] T 9f8c9fa041534724bfbb9c53186fe227 P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.759915 11501 raft_consensus.cc:697] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.760063 11501 consensus_queue.cc:237] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.761960 10949 catalog_manager.cc:5719] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.767916 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "579b0351e04e48ff9e3085a8bda8f0ad"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.768112 11252 raft_consensus.cc:493] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 08:02:58.768186 11252 raft_consensus.cc:3060] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.769435 11252 raft_consensus.cc:515] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.769941 11252 leader_election.cc:290] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Requested vote from peers e8a65542b9a14175a057ae20d16f6ba6 (127.31.239.129:38073), 271e06aa7c8346c9bb3ff6be1dda60b0 (127.31.239.131:39573)
I20260812 08:02:58.770520 11405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579b0351e04e48ff9e3085a8bda8f0ad" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0"
I20260812 08:02:58.770684 11405 raft_consensus.cc:3060] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.770651 11110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579b0351e04e48ff9e3085a8bda8f0ad" candidate_uuid: "7e74710d82ae407587c229c937852007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8a65542b9a14175a057ae20d16f6ba6"
I20260812 08:02:58.770852 11110 raft_consensus.cc:3060] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:02:58.771713 11110 raft_consensus.cc:2468] T 579b0351e04e48ff9e3085a8bda8f0ad P e8a65542b9a14175a057ae20d16f6ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.771788 11405 raft_consensus.cc:2468] T 579b0351e04e48ff9e3085a8bda8f0ad P 271e06aa7c8346c9bb3ff6be1dda60b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e74710d82ae407587c229c937852007 in term 1.
I20260812 08:02:58.772169 11183 leader_election.cc:304] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 271e06aa7c8346c9bb3ff6be1dda60b0, 7e74710d82ae407587c229c937852007; no voters: 
I20260812 08:02:58.772365 11501 raft_consensus.cc:2804] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:02:58.772457 11501 raft_consensus.cc:697] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Leader. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.772603 11501 consensus_queue.cc:237] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.774612 10949 catalog_manager.cc:5719] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e74710d82ae407587c229c937852007 (127.31.239.130). New cstate: current_term: 1 leader_uuid: "7e74710d82ae407587c229c937852007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } health_report { overall_health: UNKNOWN } } }
I20260812 08:02:58.780792 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet d34fcc936f8c47088a8d1e0add0875f4 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.781513 11543 tablet_replica.cc:333] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.781845 11543 raft_consensus.cc:2243] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:58.782279 11543 pending_rounds.cc:70] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.782399 11543 pending_rounds.cc:77] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205367799808 op_type: NO_OP noop_request { }
I20260812 08:02:58.782532 11543 raft_consensus.cc:2889] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.782635 11543 raft_consensus.cc:2272] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.783918 11543 ts_tablet_manager.cc:1916] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.786360 11543 ts_tablet_manager.cc:1929] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.786475 11543 log.cc:1199] T d34fcc936f8c47088a8d1e0add0875f4 P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/d34fcc936f8c47088a8d1e0add0875f4
I20260812 08:02:58.792960 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet 23ddaa983f724634995ed477fe2d587d with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.793291 11543 tablet_replica.cc:333] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.793469 11543 raft_consensus.cc:2243] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:58.793718 11543 pending_rounds.cc:70] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.793757 11543 pending_rounds.cc:77] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205434458112 op_type: NO_OP noop_request { }
I20260812 08:02:58.793857 11543 raft_consensus.cc:2889] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.793931 11543 raft_consensus.cc:2272] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.794662 11543 ts_tablet_manager.cc:1916] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.796614 11543 ts_tablet_manager.cc:1929] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.796695 11543 log.cc:1199] T 23ddaa983f724634995ed477fe2d587d P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/23ddaa983f724634995ed477fe2d587d
I20260812 08:02:58.803896 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a85ec5a426c48df9eede02129cc4d3f with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.804250 11543 tablet_replica.cc:333] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.804450 11543 raft_consensus.cc:2243] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:58.804667 11543 pending_rounds.cc:70] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.804701 11543 pending_rounds.cc:77] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205494468608 op_type: NO_OP noop_request { }
I20260812 08:02:58.804798 11543 raft_consensus.cc:2889] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.804872 11543 raft_consensus.cc:2272] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.805653 11543 ts_tablet_manager.cc:1916] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.807838 11543 ts_tablet_manager.cc:1929] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.807919 11543 log.cc:1199] T 5a85ec5a426c48df9eede02129cc4d3f P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/5a85ec5a426c48df9eede02129cc4d3f
I20260812 08:02:58.814913 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet 916b2ea582f046818ced8b818861d5cc with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.815215 11543 tablet_replica.cc:333] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.815393 11543 raft_consensus.cc:2243] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:58.815609 11543 pending_rounds.cc:70] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.815649 11543 pending_rounds.cc:77] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205552578560 op_type: NO_OP noop_request { }
I20260812 08:02:58.815742 11543 raft_consensus.cc:2889] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.815809 11543 raft_consensus.cc:2272] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.816653 11543 ts_tablet_manager.cc:1916] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.819133 11543 ts_tablet_manager.cc:1929] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.819229 11543 log.cc:1199] T 916b2ea582f046818ced8b818861d5cc P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/916b2ea582f046818ced8b818861d5cc
I20260812 08:02:58.825834 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a1f4796f4c2474ba60c5a36cd8d4981 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.826093 11543 tablet_replica.cc:333] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.826301 11543 raft_consensus.cc:2243] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Raft consensus shutting down.
I20260812 08:02:58.826514 11543 pending_rounds.cc:70] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.826563 11543 pending_rounds.cc:77] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205604708352 op_type: NO_OP noop_request { }
I20260812 08:02:58.826642 11543 raft_consensus.cc:2889] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.826707 11543 raft_consensus.cc:2272] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.827395 11543 ts_tablet_manager.cc:1916] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.829581 11543 ts_tablet_manager.cc:1929] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.829689 11543 log.cc:1199] T 8a1f4796f4c2474ba60c5a36cd8d4981 P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/8a1f4796f4c2474ba60c5a36cd8d4981
I20260812 08:02:58.836202 11252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e78fc8d6680f446cbe6bebfc08644bcb"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.836472 11252 raft_consensus.cc:591] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Received request to step down
I20260812 08:02:58.836547 11252 raft_consensus.cc:3055] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:58.836572 11252 raft_consensus.cc:740] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.836758 11252 consensus_queue.cc:260] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.836939 11252 raft_consensus.cc:3060] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:58.843802 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet e78fc8d6680f446cbe6bebfc08644bcb with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.844154 11543 tablet_replica.cc:333] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.844288 11543 raft_consensus.cc:2243] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:58.844395 11543 pending_rounds.cc:70] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.844419 11543 pending_rounds.cc:77] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205656264704 op_type: NO_OP noop_request { }
I20260812 08:02:58.844480 11543 raft_consensus.cc:2889] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.844522 11543 raft_consensus.cc:2272] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.845296 11543 ts_tablet_manager.cc:1916] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.847241 11543 ts_tablet_manager.cc:1929] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.847314 11543 log.cc:1199] T e78fc8d6680f446cbe6bebfc08644bcb P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/e78fc8d6680f446cbe6bebfc08644bcb
I20260812 08:02:58.853752 11252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc2637cc089046a58e0eb3265fcc33a6"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.853936 11252 raft_consensus.cc:591] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Received request to step down
I20260812 08:02:58.853973 11252 raft_consensus.cc:3055] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:58.854000 11252 raft_consensus.cc:740] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.854105 11252 consensus_queue.cc:260] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.854326 11252 raft_consensus.cc:3060] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:58.860265 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet fc2637cc089046a58e0eb3265fcc33a6 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.860512 11543 tablet_replica.cc:333] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.860630 11543 raft_consensus.cc:2243] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:58.860736 11543 pending_rounds.cc:70] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.860760 11543 pending_rounds.cc:77] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205704577024 op_type: NO_OP noop_request { }
I20260812 08:02:58.860822 11543 raft_consensus.cc:2889] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.860868 11543 raft_consensus.cc:2272] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.861559 11543 ts_tablet_manager.cc:1916] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.863495 11543 ts_tablet_manager.cc:1929] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.863574 11543 log.cc:1199] T fc2637cc089046a58e0eb3265fcc33a6 P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/fc2637cc089046a58e0eb3265fcc33a6
I20260812 08:02:58.869688 11252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a67984c404c43d08b03d9d515dcbbdc"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.869869 11252 raft_consensus.cc:591] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Received request to step down
I20260812 08:02:58.869912 11252 raft_consensus.cc:3055] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:58.869933 11252 raft_consensus.cc:740] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.870044 11252 consensus_queue.cc:260] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.870231 11252 raft_consensus.cc:3060] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:58.876080 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a67984c404c43d08b03d9d515dcbbdc with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.876359 11543 tablet_replica.cc:333] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.876479 11543 raft_consensus.cc:2243] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:58.876583 11543 pending_rounds.cc:70] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.876606 11543 pending_rounds.cc:77] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205750370304 op_type: NO_OP noop_request { }
I20260812 08:02:58.876664 11543 raft_consensus.cc:2889] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.876705 11543 raft_consensus.cc:2272] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.877439 11543 ts_tablet_manager.cc:1916] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.879305 11543 ts_tablet_manager.cc:1929] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.879377 11543 log.cc:1199] T 3a67984c404c43d08b03d9d515dcbbdc P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/3a67984c404c43d08b03d9d515dcbbdc
I20260812 08:02:58.885749 11252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f8c9fa041534724bfbb9c53186fe227"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.885921 11252 raft_consensus.cc:591] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Received request to step down
I20260812 08:02:58.885962 11252 raft_consensus.cc:3055] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:58.885991 11252 raft_consensus.cc:740] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.886106 11252 consensus_queue.cc:260] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.886312 11252 raft_consensus.cc:3060] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:58.892746 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f8c9fa041534724bfbb9c53186fe227 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.893002 11543 tablet_replica.cc:333] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.893124 11543 raft_consensus.cc:2243] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:58.893225 11543 pending_rounds.cc:70] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.893249 11543 pending_rounds.cc:77] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205802835968 op_type: NO_OP noop_request { }
I20260812 08:02:58.893313 11543 raft_consensus.cc:2889] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.893357 11543 raft_consensus.cc:2272] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.894053 11543 ts_tablet_manager.cc:1916] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.895862 11543 ts_tablet_manager.cc:1929] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.895931 11543 log.cc:1199] T 9f8c9fa041534724bfbb9c53186fe227 P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/9f8c9fa041534724bfbb9c53186fe227
I20260812 08:02:58.902483 11252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "579b0351e04e48ff9e3085a8bda8f0ad"
dest_uuid: "7e74710d82ae407587c229c937852007"
 from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.902657 11252 raft_consensus.cc:591] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Received request to step down
I20260812 08:02:58.902700 11252 raft_consensus.cc:3055] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:02:58.902721 11252 raft_consensus.cc:740] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e74710d82ae407587c229c937852007, State: Running, Role: LEADER
I20260812 08:02:58.902835 11252 consensus_queue.cc:260] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8a65542b9a14175a057ae20d16f6ba6" member_type: VOTER last_known_addr { host: "127.31.239.129" port: 38073 } } peers { permanent_uuid: "7e74710d82ae407587c229c937852007" member_type: VOTER last_known_addr { host: "127.31.239.130" port: 44301 } } peers { permanent_uuid: "271e06aa7c8346c9bb3ff6be1dda60b0" member_type: VOTER last_known_addr { host: "127.31.239.131" port: 39573 } }
I20260812 08:02:58.902951 11252 raft_consensus.cc:3060] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:02:58.909850 11227 tablet_service.cc:1558] Processing DeleteTablet for tablet 579b0351e04e48ff9e3085a8bda8f0ad with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:51096
I20260812 08:02:58.910163 11543 tablet_replica.cc:333] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: stopping tablet replica
I20260812 08:02:58.910296 11543 raft_consensus.cc:2243] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 08:02:58.910450 11543 pending_rounds.cc:70] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: Trying to abort 1 pending ops.
I20260812 08:02:58.910506 11543 pending_rounds.cc:77] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317593205854281728 op_type: NO_OP noop_request { }
I20260812 08:02:58.910584 11543 raft_consensus.cc:2889] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 08:02:58.910665 11543 raft_consensus.cc:2272] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 08:02:58.911484 11543 ts_tablet_manager.cc:1916] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260812 08:02:58.914029 11543 ts_tablet_manager.cc:1929] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.1
I20260812 08:02:58.914182 11543 log.cc:1199] T 579b0351e04e48ff9e3085a8bda8f0ad P 7e74710d82ae407587c229c937852007: Deleting WAL directory at /tmp/dist-test-taskA7XbNu/test-tmp/raft_consensus_election-itest.0.NumReplicas_RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric_1.1786521638881425-32702-0/raft_consensus-itest-cluster/ts-1/wal/wals/579b0351e04e48ff9e3085a8bda8f0ad
I20260812 08:02:58.921084 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 11018
I20260812 08:02:58.930789 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 11166
I20260812 08:02:58.941186 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 11313
I20260812 08:02:58.950989 32702 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskA7XbNu/build/debug/bin/kudu with pid 10919
2026-08-12T08:02:58Z chronyd exiting
[       OK ] NumReplicas/RaftConsensusNumLeadersMetricTest.TestNumLeadersMetric/1 (1338 ms)
[----------] 2 tests from NumReplicas/RaftConsensusNumLeadersMetricTest (2115 ms total)

[----------] Global test environment tear-down
[==========] 14 tests from 2 test suites ran. (140086 ms total)
[  PASSED  ] 14 tests.
I20260812 08:02:58.981421 32702 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 12 messages since previous log ~10 seconds ago
